[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:22:26.701967 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:39585
I20260709 12:22:26.703469 14649 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:22:26.704469 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.721333 14656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.722499 14658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:26.722719 14649 server_base.cc:1061] running on GCE node
W20260709 12:22:26.722205 14655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:27.909986 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:27.910218 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:27.910398 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599747910363 us; error 0 us; skew 500 ppm
I20260709 12:22:27.911196 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:27.916527 14649 webserver.cc:533] Webserver started at http://127.14.78.126:38907/ using document root <none> and password file <none>
I20260709 12:22:27.917368 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:27.917563 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:27.917953 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:27.923702 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "6db4e3f32baa4c698458d23672deb3b5"
format_stamp: "Formatted at 2026-07-09 12:22:27 on dist-test-slave-vrh7"
I20260709 12:22:27.931135 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:22:27.936182 14664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:27.937300 14649 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:22:27.937592 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "6db4e3f32baa4c698458d23672deb3b5"
format_stamp: "Formatted at 2026-07-09 12:22:27 on dist-test-slave-vrh7"
I20260709 12:22:27.937870 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:27.998327 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:27.999784 14649 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:22:28.000181 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.069908 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:39585
I20260709 12:22:28.069983 14715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:39585 every 8 connection(s)
I20260709 12:22:28.077680 14716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.098476 14716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5: Bootstrap starting.
I20260709 12:22:28.104106 14716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.105963 14716 log.cc:826] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5: Log is configured to *not* fsync() on all Append() calls
I20260709 12:22:28.110287 14716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5: No bootstrap required, opened a new log
I20260709 12:22:28.130686 14716 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db4e3f32baa4c698458d23672deb3b5" member_type: VOTER }
I20260709 12:22:28.131207 14716 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.131459 14716 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db4e3f32baa4c698458d23672deb3b5, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.132402 14716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db4e3f32baa4c698458d23672deb3b5" member_type: VOTER }
I20260709 12:22:28.132894 14716 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:28.133222 14716 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:28.133579 14716 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.137576 14716 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db4e3f32baa4c698458d23672deb3b5" member_type: VOTER }
I20260709 12:22:28.138274 14716 leader_election.cc:304] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6db4e3f32baa4c698458d23672deb3b5; no voters: 
I20260709 12:22:28.139964 14716 leader_election.cc:290] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:28.140354 14719 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.142555 14719 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 1 LEADER]: Becoming Leader. State: Replica: 6db4e3f32baa4c698458d23672deb3b5, State: Running, Role: LEADER
I20260709 12:22:28.143469 14719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db4e3f32baa4c698458d23672deb3b5" member_type: VOTER }
I20260709 12:22:28.144481 14716 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:28.154083 14722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6db4e3f32baa4c698458d23672deb3b5. Latest consensus state: current_term: 1 leader_uuid: "6db4e3f32baa4c698458d23672deb3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db4e3f32baa4c698458d23672deb3b5" member_type: VOTER } }
I20260709 12:22:28.154280 14720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6db4e3f32baa4c698458d23672deb3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6db4e3f32baa4c698458d23672deb3b5" member_type: VOTER } }
I20260709 12:22:28.154896 14720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:28.154901 14722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:28.158406 14729 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:28.170208 14729 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:28.172628 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:28.187552 14729 catalog_manager.cc:1383] Generated new cluster ID: 87faa1b22fa540879b88ea0943c48b8b
I20260709 12:22:28.187841 14729 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:28.215101 14729 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:28.216919 14729 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:28.249245 14729 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5: Generated new TSK 0
I20260709 12:22:28.250507 14729 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:28.303886 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:28.313419 14739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.314777 14740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.321532 14649 server_base.cc:1061] running on GCE node
W20260709 12:22:28.322316 14742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.323308 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:28.323580 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:28.323776 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599748323760 us; error 0 us; skew 500 ppm
I20260709 12:22:28.324426 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:28.328771 14649 webserver.cc:533] Webserver started at http://127.14.78.65:38949/ using document root <none> and password file <none>
I20260709 12:22:28.329334 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:28.329542 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:28.329834 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:28.330924 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-vrh7"
I20260709 12:22:28.336548 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:28.340734 14747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.341619 14649 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:28.341944 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-vrh7"
I20260709 12:22:28.342303 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:28.371137 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:28.372779 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.375468 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:28.380770 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:28.381089 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:28.381399 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:28.381639 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.475250 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:33043
I20260709 12:22:28.475391 14809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:33043 every 8 connection(s)
I20260709 12:22:28.482465 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:28.500259 14814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.507885 14815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.511021 14817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.512261 14649 server_base.cc:1061] running on GCE node
I20260709 12:22:28.513266 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:28.513530 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:28.513741 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599748513723 us; error 0 us; skew 500 ppm
I20260709 12:22:28.514529 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:28.519726 14649 webserver.cc:533] Webserver started at http://127.14.78.66:34651/ using document root <none> and password file <none>
I20260709 12:22:28.520403 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:28.520653 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:28.520984 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:28.521925 14810 heartbeater.cc:344] Connected to a master server at 127.14.78.126:39585
I20260709 12:22:28.522357 14810 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:28.522441 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "00875a721cc546609dae20df0b678ece"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-vrh7"
I20260709 12:22:28.523309 14810 heartbeater.cc:507] Master 127.14.78.126:39585 requested a full tablet report, sending...
I20260709 12:22:28.526485 14681 ts_manager.cc:194] Registered new tserver with Master: 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043)
I20260709 12:22:28.528910 14681 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42144
I20260709 12:22:28.530053 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:22:28.535305 14822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.536175 14649 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:22:28.536538 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "00875a721cc546609dae20df0b678ece"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-vrh7"
I20260709 12:22:28.536934 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:28.569384 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:28.571034 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.574355 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:28.578239 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:28.578526 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.578801 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:28.578998 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.664618 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:36299
I20260709 12:22:28.664686 14884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:36299 every 8 connection(s)
I20260709 12:22:28.671633 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:28.682713 14888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.683553 14889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.686087 14885 heartbeater.cc:344] Connected to a master server at 127.14.78.126:39585
I20260709 12:22:28.686757 14885 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:28.687767 14885 heartbeater.cc:507] Master 127.14.78.126:39585 requested a full tablet report, sending...
W20260709 12:22:28.688330 14891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.690026 14681 ts_manager.cc:194] Registered new tserver with Master: 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:28.690984 14649 server_base.cc:1061] running on GCE node
I20260709 12:22:28.691579 14681 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42156
I20260709 12:22:28.692018 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:28.692282 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:28.692487 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599748692466 us; error 0 us; skew 500 ppm
I20260709 12:22:28.693281 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:28.696080 14649 webserver.cc:533] Webserver started at http://127.14.78.67:43745/ using document root <none> and password file <none>
I20260709 12:22:28.696542 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:28.696736 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:28.697028 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:28.698086 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-vrh7"
I20260709 12:22:28.702469 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:28.705663 14896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.706432 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:28.706707 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-vrh7"
I20260709 12:22:28.706985 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:28.728483 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:28.729713 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.731813 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:28.734562 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:28.734788 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.735042 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:28.735219 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.829502 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:37031
I20260709 12:22:28.829604 14960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:37031 every 8 connection(s)
I20260709 12:22:28.846870 14961 heartbeater.cc:344] Connected to a master server at 127.14.78.126:39585
I20260709 12:22:28.847224 14961 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:28.847906 14961 heartbeater.cc:507] Master 127.14.78.126:39585 requested a full tablet report, sending...
I20260709 12:22:28.849973 14681 ts_manager.cc:194] Registered new tserver with Master: 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:28.850584 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013542278s
I20260709 12:22:28.851655 14681 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42160
I20260709 12:22:28.907110 14681 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42172:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:28.910594 14681 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:29.029222 14850 tablet_service.cc:1511] Processing CreateTablet for tablet a3b488cf45f049b69116a31274d8bf6e (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:29.030902 14850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b488cf45f049b69116a31274d8bf6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.034787 14849 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6f1556f9694b5cb528a926abcc6ad8 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:29.036103 14849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6f1556f9694b5cb528a926abcc6ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.042222 14848 tablet_service.cc:1511] Processing CreateTablet for tablet 79ea5de9db4e44ea92ba2be675dd0613 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:29.042795 14775 tablet_service.cc:1511] Processing CreateTablet for tablet a3b488cf45f049b69116a31274d8bf6e (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:29.043591 14848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ea5de9db4e44ea92ba2be675dd0613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.044055 14775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b488cf45f049b69116a31274d8bf6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.053787 14770 tablet_service.cc:1511] Processing CreateTablet for tablet d20c707d10e648a18b079af473dc3276 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:29.061236 14773 tablet_service.cc:1511] Processing CreateTablet for tablet 79ea5de9db4e44ea92ba2be675dd0613 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:29.062469 14774 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6f1556f9694b5cb528a926abcc6ad8 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:29.059677 14768 tablet_service.cc:1511] Processing CreateTablet for tablet af1efe1b9c0a436cb6a8a1e099e67556 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:29.056826 14772 tablet_service.cc:1511] Processing CreateTablet for tablet 09fb9ff806884c07a0662e5c64ad5cbc (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:29.070732 14924 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6f1556f9694b5cb528a926abcc6ad8 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:29.073313 14770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20c707d10e648a18b079af473dc3276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.073009 14769 tablet_service.cc:1511] Processing CreateTablet for tablet ceccd12495244015832e1d08bae3663e (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:29.078053 14773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ea5de9db4e44ea92ba2be675dd0613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.077380 14924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6f1556f9694b5cb528a926abcc6ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.079810 14847 tablet_service.cc:1511] Processing CreateTablet for tablet 09fb9ff806884c07a0662e5c64ad5cbc (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:29.069944 14925 tablet_service.cc:1511] Processing CreateTablet for tablet a3b488cf45f049b69116a31274d8bf6e (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:29.088541 14847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fb9ff806884c07a0662e5c64ad5cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.068765 14771 tablet_service.cc:1511] Processing CreateTablet for tablet 85d2938371b5433ea76a69c82457b8b1 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:29.077008 14845 tablet_service.cc:1511] Processing CreateTablet for tablet d20c707d10e648a18b079af473dc3276 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:29.090034 14768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1efe1b9c0a436cb6a8a1e099e67556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.089829 14846 tablet_service.cc:1511] Processing CreateTablet for tablet 85d2938371b5433ea76a69c82457b8b1 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:29.101418 14846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d2938371b5433ea76a69c82457b8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.112419 14923 tablet_service.cc:1511] Processing CreateTablet for tablet 79ea5de9db4e44ea92ba2be675dd0613 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:29.098193 14922 tablet_service.cc:1511] Processing CreateTablet for tablet 09fb9ff806884c07a0662e5c64ad5cbc (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:29.091033 14844 tablet_service.cc:1511] Processing CreateTablet for tablet ceccd12495244015832e1d08bae3663e (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:29.116343 14844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceccd12495244015832e1d08bae3663e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.091981 14843 tablet_service.cc:1511] Processing CreateTablet for tablet af1efe1b9c0a436cb6a8a1e099e67556 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:29.122342 14845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20c707d10e648a18b079af473dc3276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.125384 14769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceccd12495244015832e1d08bae3663e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.129206 14925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b488cf45f049b69116a31274d8bf6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.132311 14921 tablet_service.cc:1511] Processing CreateTablet for tablet 85d2938371b5433ea76a69c82457b8b1 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:29.137428 14771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d2938371b5433ea76a69c82457b8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.131289 14920 tablet_service.cc:1511] Processing CreateTablet for tablet d20c707d10e648a18b079af473dc3276 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:29.138191 14843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1efe1b9c0a436cb6a8a1e099e67556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.135182 14919 tablet_service.cc:1511] Processing CreateTablet for tablet ceccd12495244015832e1d08bae3663e (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:29.140062 14921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d2938371b5433ea76a69c82457b8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.149135 14923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ea5de9db4e44ea92ba2be675dd0613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.151491 14918 tablet_service.cc:1511] Processing CreateTablet for tablet af1efe1b9c0a436cb6a8a1e099e67556 (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:29.167006 14920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20c707d10e648a18b079af473dc3276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.175666 14842 tablet_service.cc:1511] Processing CreateTablet for tablet 14b52ba25ab544b0a502162a99ca566b (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 12:22:29.183559 14730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:29.181618 14919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceccd12495244015832e1d08bae3663e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.181056 14842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b52ba25ab544b0a502162a99ca566b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.176461 14772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fb9ff806884c07a0662e5c64ad5cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.185294 14767 tablet_service.cc:1511] Processing CreateTablet for tablet 14b52ba25ab544b0a502162a99ca566b (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:29.196382 14922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fb9ff806884c07a0662e5c64ad5cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.199061 14767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b52ba25ab544b0a502162a99ca566b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.218762 14918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1efe1b9c0a436cb6a8a1e099e67556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.220130 14917 tablet_service.cc:1511] Processing CreateTablet for tablet 14b52ba25ab544b0a502162a99ca566b (DEFAULT_TABLE table=test-workload [id=0a16ad5ef3224cbe95644e8ba0bc1727]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:29.227250 14774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6f1556f9694b5cb528a926abcc6ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.266284 14917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b52ba25ab544b0a502162a99ca566b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.281102 14979 tablet_bootstrap.cc:492] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.340426 14979 tablet_bootstrap.cc:654] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.410703 14980 tablet_bootstrap.cc:492] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:29.412302 14981 tablet_bootstrap.cc:492] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.440491 14979 tablet_bootstrap.cc:492] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.440972 14979 ts_tablet_manager.cc:1403] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.016s
I20260709 12:22:29.442763 14981 tablet_bootstrap.cc:654] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.462411 14979 raft_consensus.cc:359] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.464079 14979 raft_consensus.cc:385] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.464394 14979 raft_consensus.cc:740] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.465380 14981 tablet_bootstrap.cc:492] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.465951 14981 ts_tablet_manager.cc:1403] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.012s
I20260709 12:22:29.465375 14979 consensus_queue.cc:260] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.469478 14981 raft_consensus.cc:359] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.470481 14981 raft_consensus.cc:385] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.470867 14981 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.471561 14980 tablet_bootstrap.cc:654] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.472040 14981 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.478066 14885 heartbeater.cc:499] Master 127.14.78.126:39585 was elected leader, sending a full tablet report...
I20260709 12:22:29.478600 14979 ts_tablet_manager.cc:1434] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.011s
I20260709 12:22:29.479290 14980 tablet_bootstrap.cc:492] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:29.479477 14979 tablet_bootstrap.cc:492] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.479694 14980 ts_tablet_manager.cc:1403] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:22:29.482975 14980 raft_consensus.cc:359] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.483644 14980 raft_consensus.cc:385] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.484107 14980 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.485915 14810 heartbeater.cc:499] Master 127.14.78.126:39585 was elected leader, sending a full tablet report...
I20260709 12:22:29.489413 14980 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.491401 14979 tablet_bootstrap.cc:654] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.493404 14987 raft_consensus.cc:493] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.493834 14987 raft_consensus.cc:515] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.494381 14981 ts_tablet_manager.cc:1434] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:22:29.496024 14981 tablet_bootstrap.cc:492] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.502645 14981 tablet_bootstrap.cc:654] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.506157 14961 heartbeater.cc:499] Master 127.14.78.126:39585 was elected leader, sending a full tablet report...
I20260709 12:22:29.506771 14980 ts_tablet_manager.cc:1434] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 12:22:29.507692 14980 tablet_bootstrap.cc:492] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:29.518639 14979 tablet_bootstrap.cc:492] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.519155 14979 ts_tablet_manager.cc:1403] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.001s
I20260709 12:22:29.522778 14979 raft_consensus.cc:359] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.523873 14979 raft_consensus.cc:385] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.524230 14979 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.524966 14979 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.527351 14979 ts_tablet_manager.cc:1434] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:29.527480 14981 tablet_bootstrap.cc:492] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.528003 14981 ts_tablet_manager.cc:1403] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.002s
I20260709 12:22:29.528292 14979 tablet_bootstrap.cc:492] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.530820 14981 raft_consensus.cc:359] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.532164 14981 raft_consensus.cc:385] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.532517 14981 raft_consensus.cc:740] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.534114 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:29.534754 14987 leader_election.cc:290] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043)
I20260709 12:22:29.534852 14860 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:29.536445 14899 leader_election.cc:304] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:29.533298 14981 consensus_queue.cc:260] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.538889 14987 raft_consensus.cc:2804] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.539057 14979 tablet_bootstrap.cc:654] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.539256 14987 raft_consensus.cc:493] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.539629 14987 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.541543 14981 ts_tablet_manager.cc:1434] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:22:29.542914 14981 tablet_bootstrap.cc:492] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.544516 14979 tablet_bootstrap.cc:492] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.544963 14979 ts_tablet_manager.cc:1403] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 12:22:29.548781 14979 raft_consensus.cc:359] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.549427 14979 raft_consensus.cc:385] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.549731 14979 raft_consensus.cc:740] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.550403 14979 consensus_queue.cc:260] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.551673 14981 tablet_bootstrap.cc:654] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.553397 14979 ts_tablet_manager.cc:1434] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:29.554322 14979 tablet_bootstrap.cc:492] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.562143 14979 tablet_bootstrap.cc:654] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.567755 14981 tablet_bootstrap.cc:492] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.568521 14981 ts_tablet_manager.cc:1403] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:22:29.570431 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:29.571285 14785 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:29.567806 14980 tablet_bootstrap.cc:654] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.574966 14979 tablet_bootstrap.cc:492] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.575400 14979 ts_tablet_manager.cc:1403] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:22:29.575246 14981 raft_consensus.cc:359] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.575624 14987 raft_consensus.cc:515] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.576082 14981 raft_consensus.cc:385] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.576511 14981 raft_consensus.cc:740] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.577787 14981 consensus_queue.cc:260] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.578336 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:29.578902 14860 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.579941 14981 ts_tablet_manager.cc:1434] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:22:29.582705 14981 tablet_bootstrap.cc:492] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.586154 14979 raft_consensus.cc:359] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.586884 14979 raft_consensus.cc:385] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.587178 14979 raft_consensus.cc:740] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.587862 14979 consensus_queue.cc:260] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
W20260709 12:22:29.589107 14962 tablet.cc:2406] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:29.589321 14981 tablet_bootstrap.cc:654] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.589597 14860 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:29.591614 14979 ts_tablet_manager.cc:1434] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:22:29.592697 14979 tablet_bootstrap.cc:492] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.599916 14987 leader_election.cc:290] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043)
I20260709 12:22:29.601514 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:29.602077 14785 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.604038 14979 tablet_bootstrap.cc:654] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.599902 14899 leader_election.cc:304] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:29.605387 14980 tablet_bootstrap.cc:492] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:29.605814 14980 ts_tablet_manager.cc:1403] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.004s
I20260709 12:22:29.609203 14987 raft_consensus.cc:2804] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.609654 14987 raft_consensus.cc:697] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:29.610231 14981 tablet_bootstrap.cc:492] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.610445 14987 consensus_queue.cc:237] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.613435 14981 ts_tablet_manager.cc:1403] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260709 12:22:29.608551 14980 raft_consensus.cc:359] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.612550 14785 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:29.615828 14980 raft_consensus.cc:385] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.617170 14980 raft_consensus.cc:740] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.618041 14980 consensus_queue.cc:260] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.618245 14981 raft_consensus.cc:359] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.619176 14981 raft_consensus.cc:385] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.619537 14981 raft_consensus.cc:740] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.620383 14981 consensus_queue.cc:260] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.621167 14980 ts_tablet_manager.cc:1434] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:22:29.625125 14981 ts_tablet_manager.cc:1434] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:22:29.625530 14980 tablet_bootstrap.cc:492] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:29.626009 14981 tablet_bootstrap.cc:492] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.635417 14979 tablet_bootstrap.cc:492] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.636040 14979 ts_tablet_manager.cc:1403] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.021s
I20260709 12:22:29.638000 14981 tablet_bootstrap.cc:654] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.639955 14979 raft_consensus.cc:359] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.642136 14979 raft_consensus.cc:385] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.641304 14679 catalog_manager.cc:5697] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.643157 14979 raft_consensus.cc:740] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.644138 14979 consensus_queue.cc:260] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.646562 14980 tablet_bootstrap.cc:654] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.649026 14979 ts_tablet_manager.cc:1434] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:22:29.650063 14979 tablet_bootstrap.cc:492] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.656638 14981 tablet_bootstrap.cc:492] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.657106 14981 ts_tablet_manager.cc:1403] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.006s
I20260709 12:22:29.658576 14985 raft_consensus.cc:493] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.659062 14985 raft_consensus.cc:515] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.659902 14981 raft_consensus.cc:359] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.660882 14981 raft_consensus.cc:385] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.661269 14981 raft_consensus.cc:740] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.663553 14985 leader_election.cc:290] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:29.665541 14981 consensus_queue.cc:260] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.668841 14981 ts_tablet_manager.cc:1434] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:22:29.687147 14981 tablet_bootstrap.cc:492] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.699313 14980 tablet_bootstrap.cc:492] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:29.711406 14979 tablet_bootstrap.cc:654] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.708948 14980 ts_tablet_manager.cc:1403] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.013s
I20260709 12:22:29.719429 14980 raft_consensus.cc:359] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.720655 14980 raft_consensus.cc:385] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.721879 14980 raft_consensus.cc:740] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.724735 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d2938371b5433ea76a69c82457b8b1" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:29.724759 14980 consensus_queue.cc:260] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
W20260709 12:22:29.729893 14750 leader_election.cc:343] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00875a721cc546609dae20df0b678ece (127.14.78.66:36299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.743021 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d2938371b5433ea76a69c82457b8b1" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:29.743538 14980 ts_tablet_manager.cc:1434] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
W20260709 12:22:29.745499 14748 leader_election.cc:343] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.746078 14980 tablet_bootstrap.cc:492] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:29.746006 14748 leader_election.cc:304] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:29.746991 14985 raft_consensus.cc:2749] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.750743 14981 tablet_bootstrap.cc:654] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.754688 14980 tablet_bootstrap.cc:654] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.755568 14979 tablet_bootstrap.cc:492] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.756009 14979 ts_tablet_manager.cc:1403] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.020s
I20260709 12:22:29.758769 14979 raft_consensus.cc:359] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.759443 14979 raft_consensus.cc:385] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.759711 14979 raft_consensus.cc:740] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.760452 14979 consensus_queue.cc:260] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.763592 14979 ts_tablet_manager.cc:1434] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:22:29.764493 14979 tablet_bootstrap.cc:492] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.770586 14979 tablet_bootstrap.cc:654] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.777525 14981 tablet_bootstrap.cc:492] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.778148 14981 ts_tablet_manager.cc:1403] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.002s
I20260709 12:22:29.779438 14987 raft_consensus.cc:493] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.779911 14987 raft_consensus.cc:515] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.782037 14987 leader_election.cc:290] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:29.783120 14979 tablet_bootstrap.cc:492] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.783051 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:29.783623 14979 ts_tablet_manager.cc:1403] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 12:22:29.783732 14860 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:29.784752 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:29.779923 14980 tablet_bootstrap.cc:492] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:29.785367 14785 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:29.785557 14980 ts_tablet_manager.cc:1403] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.003s
I20260709 12:22:29.786123 14979 raft_consensus.cc:359] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.786648 14898 leader_election.cc:304] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:29.786831 14979 raft_consensus.cc:385] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.787231 14979 raft_consensus.cc:740] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.786868 14981 raft_consensus.cc:359] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.787688 14981 raft_consensus.cc:385] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.788000 14981 raft_consensus.cc:740] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.788029 14979 consensus_queue.cc:260] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.789275 14981 consensus_queue.cc:260] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.790146 14987 raft_consensus.cc:2804] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.790494 14987 raft_consensus.cc:493] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.790829 14987 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.792364 14984 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.792824 14984 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.794389 14981 ts_tablet_manager.cc:1434] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:22:29.795588 14981 tablet_bootstrap.cc:492] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:29.796921 14984 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:29.801232 14979 ts_tablet_manager.cc:1434] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.005s
I20260709 12:22:29.807876 14979 tablet_bootstrap.cc:492] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.810628 14980 raft_consensus.cc:359] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.811372 14980 raft_consensus.cc:385] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.813342 14980 raft_consensus.cc:740] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.815732 14987 raft_consensus.cc:515] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.814280 14980 consensus_queue.cc:260] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.817260 14979 tablet_bootstrap.cc:654] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.819089 14980 ts_tablet_manager.cc:1434] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:22:29.822476 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:29.823030 14785 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.829675 14984 raft_consensus.cc:493] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.829829 14785 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:29.830132 14984 raft_consensus.cc:515] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.831027 14898 leader_election.cc:304] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:29.832144 14988 raft_consensus.cc:2804] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.843598 14981 tablet_bootstrap.cc:654] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.837177 14984 leader_election.cc:290] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:29.845024 14984 raft_consensus.cc:493] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.845255 14987 leader_election.cc:290] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:29.845734 14980 tablet_bootstrap.cc:492] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:29.845531 14984 raft_consensus.cc:515] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.847975 14984 leader_election.cc:290] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:29.850616 14988 raft_consensus.cc:697] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:29.854192 14988 consensus_queue.cc:237] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.865388 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:29.866338 14860 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.881726 14980 tablet_bootstrap.cc:654] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.888616 14979 tablet_bootstrap.cc:492] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:29.889330 14979 ts_tablet_manager.cc:1403] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.008s
I20260709 12:22:29.893913 14860 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:29.896723 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:29.895254 14988 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.899366 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:29.894363 14681 catalog_manager.cc:5697] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.899597 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:29.899400 14988 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.899734 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b52ba25ab544b0a502162a99ca566b" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:29.901554 14934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b52ba25ab544b0a502162a99ca566b" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:29.901158 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:29.909533 14784 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 0.
I20260709 12:22:29.911789 14936 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 0.
W20260709 12:22:29.911981 14823 leader_election.cc:343] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.914309 14988 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:29.929177 14979 raft_consensus.cc:359] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.942929 14979 raft_consensus.cc:385] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.943287 14979 raft_consensus.cc:740] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.944054 14979 consensus_queue.cc:260] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.944775 14980 tablet_bootstrap.cc:492] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:29.945605 14980 ts_tablet_manager.cc:1403] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.005s
I20260709 12:22:29.945904 14979 ts_tablet_manager.cc:1434] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.056s	user 0.014s	sys 0.008s
I20260709 12:22:29.947036 14979 tablet_bootstrap.cc:492] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: Bootstrap starting.
I20260709 12:22:29.948351 14980 raft_consensus.cc:359] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.948933 14980 raft_consensus.cc:385] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.949290 14980 raft_consensus.cc:740] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.949990 14980 consensus_queue.cc:260] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.951756 14980 ts_tablet_manager.cc:1434] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:22:29.952737 14980 tablet_bootstrap.cc:492] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:29.953812 14979 tablet_bootstrap.cc:654] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:29.928401 14824 leader_election.cc:343] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.935535 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
W20260709 12:22:29.955693 14898 leader_election.cc:343] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.936682 14981 tablet_bootstrap.cc:492] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:29.956532 14981 ts_tablet_manager.cc:1403] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.161s	user 0.009s	sys 0.019s
I20260709 12:22:29.959556 14981 raft_consensus.cc:359] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.940117 15016 raft_consensus.cc:493] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.960716 15016 raft_consensus.cc:515] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.963227 15016 leader_election.cc:290] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:29.941226 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:29.964027 14860 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
W20260709 12:22:29.941681 14823 leader_election.cc:343] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.960335 14981 raft_consensus.cc:385] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.965654 14985 raft_consensus.cc:493] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.965955 14981 raft_consensus.cc:740] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.966150 14985 raft_consensus.cc:515] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.966910 14981 consensus_queue.cc:260] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.968251 14985 leader_election.cc:290] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:29.969362 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
W20260709 12:22:29.970701 14748 leader_election.cc:343] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.970449 14823 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 5c9d836f07f74a29aa9b5f76bfeb874c
W20260709 12:22:29.973366 14824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:33043, user_credentials={real_user=slave}} blocked reactor thread for 72406us
I20260709 12:22:29.974200 14899 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:29.974637 14824 leader_election.cc:304] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:29.976110 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:29.976656 14988 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.977663 14988 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.978148 14988 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.973502 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d2938371b5433ea76a69c82457b8b1" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:29.982547 14984 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.982970 14984 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:29.983206 14823 leader_election.cc:343] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.983341 14984 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:30.035929 14823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:37031, user_credentials={real_user=slave}} blocked reactor thread for 52760.3us
I20260709 12:22:30.045670 14984 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.999166 14981 ts_tablet_manager.cc:1434] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260709 12:22:30.036724 14979 tablet_bootstrap.cc:492] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: No bootstrap required, opened a new log
I20260709 12:22:30.047164 14979 ts_tablet_manager.cc:1403] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.008s
I20260709 12:22:30.047829 14981 tablet_bootstrap.cc:492] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
W20260709 12:22:30.039767 14824 leader_election.cc:343] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.049566 14824 leader_election.cc:304] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00875a721cc546609dae20df0b678ece; no voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:30.049607 14979 raft_consensus.cc:359] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.040397 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d2938371b5433ea76a69c82457b8b1" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:30.050395 14979 raft_consensus.cc:385] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.050688 14979 raft_consensus.cc:740] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.035204 14988 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:29.983726 15016 raft_consensus.cc:2804] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.047971 14984 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.051360 15016 raft_consensus.cc:493] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.021193 14985 raft_consensus.cc:493] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.050572 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:30.051419 14979 consensus_queue.cc:260] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.051909 15016 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.050809 14784 raft_consensus.cc:2468] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 0.
W20260709 12:22:30.048658 14750 leader_election.cc:343] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00875a721cc546609dae20df0b678ece (127.14.78.66:36299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.052901 14985 raft_consensus.cc:515] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.053373 14750 leader_election.cc:304] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3
W20260709 12:22:30.034721 14899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:36299, user_credentials={real_user=slave}} blocked reactor thread for 60597.1us
I20260709 12:22:30.054792 15022 raft_consensus.cc:2749] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.055212 14936 raft_consensus.cc:2393] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 00875a721cc546609dae20df0b678ece in current term 1: Already voted for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in this term.
I20260709 12:22:30.060403 14979 ts_tablet_manager.cc:1434] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:22:30.065891 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.051673 14984 raft_consensus.cc:2749] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.071385 15015 raft_consensus.cc:493] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.071554 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.071543 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:30.069774 14988 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.071911 15015 raft_consensus.cc:515] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.075361 15015 leader_election.cc:290] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.073431 14824 leader_election.cc:304] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:30.073618 14860 raft_consensus.cc:2393] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 46fc3aa1a9424e709b44b3b998aa33c3 in current term 1: Already voted for candidate 00875a721cc546609dae20df0b678ece in this term.
W20260709 12:22:30.077250 14824 leader_election.cc:343] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:30.073832 14898 leader_election.cc:343] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.077096 15016 raft_consensus.cc:515] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.079035 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b52ba25ab544b0a502162a99ca566b" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:30.079736 14784 raft_consensus.cc:2468] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:30.080350 15016 leader_election.cc:290] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.080950 15023 raft_consensus.cc:2804] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.081343 15023 raft_consensus.cc:493] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.081393 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:30.081724 15023 raft_consensus.cc:3060] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.081691 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:30.082113 14860 raft_consensus.cc:2468] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 0.
I20260709 12:22:30.083046 14898 leader_election.cc:304] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:30.083565 14899 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:30.084003 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
W20260709 12:22:30.084846 14748 leader_election.cc:343] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.085306 14988 raft_consensus.cc:2804] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.085578 15015 raft_consensus.cc:2749] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.085709 14988 raft_consensus.cc:493] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.075297 14980 tablet_bootstrap.cc:654] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.086122 14988 raft_consensus.cc:3060] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.077754 14824 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00875a721cc546609dae20df0b678ece; no voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:30.078809 14985 leader_election.cc:290] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.089490 14750 leader_election.cc:304] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:30.089890 15016 raft_consensus.cc:2749] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.090637 14985 raft_consensus.cc:2804] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.089656 15023 raft_consensus.cc:515] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.091056 14985 raft_consensus.cc:493] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.091462 14985 raft_consensus.cc:3060] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.091693 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.092346 15023 leader_election.cc:290] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.092417 14784 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.098101 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b52ba25ab544b0a502162a99ca566b" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:30.098790 14860 raft_consensus.cc:2468] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:30.099529 15023 raft_consensus.cc:493] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.097381 14985 raft_consensus.cc:515] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.100093 14980 tablet_bootstrap.cc:492] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:30.100047 15023 raft_consensus.cc:515] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.101009 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d2938371b5433ea76a69c82457b8b1" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.101629 14783 raft_consensus.cc:3060] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.102308 14985 leader_election.cc:290] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.101861 14784 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 1.
I20260709 12:22:30.100589 14980 ts_tablet_manager.cc:1403] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.000s
I20260709 12:22:30.106132 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:30.107268 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d2938371b5433ea76a69c82457b8b1" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:30.102623 15023 leader_election.cc:290] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
W20260709 12:22:30.107995 14748 leader_election.cc:343] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.106709 14980 raft_consensus.cc:359] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.108942 14980 raft_consensus.cc:385] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.109300 14980 raft_consensus.cc:740] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.110311 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:30.113392 14935 raft_consensus.cc:2468] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 0.
I20260709 12:22:30.110405 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:30.113721 14980 consensus_queue.cc:260] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.111095 14783 raft_consensus.cc:2468] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 1.
I20260709 12:22:30.111172 14824 leader_election.cc:304] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
W20260709 12:22:30.115620 14824 leader_election.cc:343] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.116508 14980 ts_tablet_manager.cc:1434] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:30.112486 14981 tablet_bootstrap.cc:654] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.116605 15023 raft_consensus.cc:2804] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.117417 15023 raft_consensus.cc:697] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:30.111845 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:30.118005 14860 raft_consensus.cc:3060] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.118355 15023 consensus_queue.cc:237] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.120096 14980 tablet_bootstrap.cc:492] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:30.119766 14824 leader_election.cc:304] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:30.120776 15016 raft_consensus.cc:2804] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.121230 15016 raft_consensus.cc:697] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:30.121979 15016 consensus_queue.cc:237] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.130759 14980 tablet_bootstrap.cc:654] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.136248 14981 tablet_bootstrap.cc:492] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:30.137239 14981 ts_tablet_manager.cc:1403] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.004s
W20260709 12:22:30.137444 14823 leader_election.cc:343] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:30.138849 14823 leader_election.cc:343] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:30.139797 14823 leader_election.cc:304] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:30.140167 14981 raft_consensus.cc:359] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.140877 14981 raft_consensus.cc:385] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.141207 14981 raft_consensus.cc:740] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.136817 14860 raft_consensus.cc:2468] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 1.
I20260709 12:22:30.141999 14981 consensus_queue.cc:260] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.145350 14981 ts_tablet_manager.cc:1434] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:22:30.146332 14981 tablet_bootstrap.cc:492] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: Bootstrap starting.
I20260709 12:22:30.156160 14984 raft_consensus.cc:2804] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.157994 14981 tablet_bootstrap.cc:654] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.157336 14984 raft_consensus.cc:493] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.159168 14984 raft_consensus.cc:3060] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.163852 14750 leader_election.cc:304] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:30.165086 14985 raft_consensus.cc:2804] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.165601 14985 raft_consensus.cc:697] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:30.166458 14985 consensus_queue.cc:237] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.168263 15015 raft_consensus.cc:493] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.168738 15015 raft_consensus.cc:515] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.171659 15015 leader_election.cc:290] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.173672 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:30.174079 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:30.174744 14783 raft_consensus.cc:2393] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46fc3aa1a9424e709b44b3b998aa33c3 in current term 1: Already voted for candidate 00875a721cc546609dae20df0b678ece in this term.
I20260709 12:22:30.176044 14899 leader_election.cc:304] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:30.176098 15015 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.176916 14987 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.177289 14984 raft_consensus.cc:515] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.172742 14988 raft_consensus.cc:515] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.180133 14988 leader_election.cc:290] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.180699 14980 tablet_bootstrap.cc:492] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:30.181162 14980 ts_tablet_manager.cc:1403] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.003s
I20260709 12:22:30.182951 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b52ba25ab544b0a502162a99ca566b" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.183586 14783 raft_consensus.cc:3060] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:30.188818 14730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:30.192417 14988 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.198091 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b52ba25ab544b0a502162a99ca566b" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:30.198741 14859 raft_consensus.cc:3060] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.201668 14987 raft_consensus.cc:2749] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.215330 14980 raft_consensus.cc:359] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.216500 14980 raft_consensus.cc:385] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.216813 14980 raft_consensus.cc:740] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.217585 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.217635 14980 consensus_queue.cc:260] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.218286 14785 raft_consensus.cc:3060] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.213397 14783 raft_consensus.cc:2468] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:30.219144 14679 catalog_manager.cc:5697] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 0 to 1, leader changed from <none> to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 1 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.234863 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:30.235628 14935 raft_consensus.cc:3060] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.224025 14681 catalog_manager.cc:5697] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 1 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.225147 14859 raft_consensus.cc:2468] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:30.247798 14935 raft_consensus.cc:2468] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 1.
I20260709 12:22:30.236315 14679 catalog_manager.cc:5697] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 0 to 1, leader changed from <none> to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 1 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.246263 14984 leader_election.cc:290] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.265151 14898 leader_election.cc:304] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:30.267428 14987 raft_consensus.cc:2804] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.267958 14987 raft_consensus.cc:697] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:30.268311 14785 raft_consensus.cc:2468] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 1.
I20260709 12:22:30.269026 14987 consensus_queue.cc:237] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.270438 14980 ts_tablet_manager.cc:1434] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.089s	user 0.011s	sys 0.004s
I20260709 12:22:30.264998 14823 leader_election.cc:304] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:30.275877 14980 tablet_bootstrap.cc:492] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:30.277195 14984 raft_consensus.cc:2804] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.284147 14984 raft_consensus.cc:697] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:30.284934 14984 consensus_queue.cc:237] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.289273 15015 raft_consensus.cc:493] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.289719 15015 raft_consensus.cc:515] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.289403 14679 catalog_manager.cc:5697] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.291608 15015 leader_election.cc:290] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.302028 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:30.305338 14981 tablet_bootstrap.cc:492] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: No bootstrap required, opened a new log
I20260709 12:22:30.305899 14981 ts_tablet_manager.cc:1403] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.000s
I20260709 12:22:30.308738 14981 raft_consensus.cc:359] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.309419 14981 raft_consensus.cc:385] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.309690 14981 raft_consensus.cc:740] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.310307 14981 consensus_queue.cc:260] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.311730 14981 ts_tablet_manager.cc:1434] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:30.313968 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:30.315026 14859 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:30.311565 14985 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.306509 14785 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 0.
I20260709 12:22:30.316475 14899 leader_election.cc:304] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:30.317323 14985 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.320688 14985 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:30.317981 15015 raft_consensus.cc:2804] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.322660 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:30.322770 15015 raft_consensus.cc:493] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.322777 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" is_pre_election: true
I20260709 12:22:30.323422 15015 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.326581 14935 raft_consensus.cc:2393] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c9d836f07f74a29aa9b5f76bfeb874c in current term 1: Already voted for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in this term.
I20260709 12:22:30.325471 14859 raft_consensus.cc:2393] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c9d836f07f74a29aa9b5f76bfeb874c in current term 1: Already voted for candidate 00875a721cc546609dae20df0b678ece in this term.
I20260709 12:22:30.330543 14748 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:30.332854 14985 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.336524 14980 tablet_bootstrap.cc:654] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.336339 15015 raft_consensus.cc:515] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.329980 14679 catalog_manager.cc:5697] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 0 to 1, leader changed from <none> to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 1 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.337368 14985 raft_consensus.cc:2749] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.339617 15015 leader_election.cc:290] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.340401 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:30.340993 14785 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.341432 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:30.342537 14860 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.352205 14860 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:30.353327 14785 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:30.354132 14899 leader_election.cc:304] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:30.355053 15015 raft_consensus.cc:2804] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.355634 15015 raft_consensus.cc:697] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:30.356837 15015 consensus_queue.cc:237] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.357990 14980 tablet_bootstrap.cc:492] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:30.358417 14980 ts_tablet_manager.cc:1403] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.000s
I20260709 12:22:30.359630 14987 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.362552 14980 raft_consensus.cc:359] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.363396 14980 raft_consensus.cc:385] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.363739 14980 raft_consensus.cc:740] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.364583 14980 consensus_queue.cc:260] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.367343 14980 ts_tablet_manager.cc:1434] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:30.368422 14980 tablet_bootstrap.cc:492] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3: Bootstrap starting.
I20260709 12:22:30.378890 14681 catalog_manager.cc:5697] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.380767 14980 tablet_bootstrap.cc:654] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:30.387193 15015 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.396838 14980 tablet_bootstrap.cc:492] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3: No bootstrap required, opened a new log
I20260709 12:22:30.397419 14980 ts_tablet_manager.cc:1403] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.002s
I20260709 12:22:30.400569 14980 raft_consensus.cc:359] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.401340 14980 raft_consensus.cc:385] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.401719 14980 raft_consensus.cc:740] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.402716 14980 consensus_queue.cc:260] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.404975 14980 ts_tablet_manager.cc:1434] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:30.448223 15015 raft_consensus.cc:493] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.448740 15015 raft_consensus.cc:515] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:30.450881 15015 leader_election.cc:290] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:30.451678 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:30.452104 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:30.452872 14860 raft_consensus.cc:2393] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46fc3aa1a9424e709b44b3b998aa33c3 in current term 1: Already voted for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in this term.
I20260709 12:22:30.453747 14899 leader_election.cc:304] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:30.454389 15015 raft_consensus.cc:3060] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.460945 15015 raft_consensus.cc:2749] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.532922 14984 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.545010 15016 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.578778 14935 raft_consensus.cc:3060] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.582448 15016 consensus_queue.cc:1048] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.585645 15016 consensus_queue.cc:1048] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.649267 14985 consensus_queue.cc:1048] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.660081 14985 consensus_queue.cc:1048] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.692672 15023 consensus_queue.cc:1048] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.704273 15016 consensus_queue.cc:1048] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.715452 15015 consensus_queue.cc:1048] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.733582 14988 consensus_queue.cc:1048] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.841105 14988 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.851166 15015 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:31.192746 14730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:32.064556 15058 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.065049 15058 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.067099 15058 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:32.067857 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" is_pre_election: true
I20260709 12:22:32.068136 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece" is_pre_election: true
I20260709 12:22:32.068539 14784 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:32.068722 14860 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 1.
I20260709 12:22:32.069655 14898 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.070333 15058 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:32.070674 15058 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.070945 15058 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.075454 15058 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.077033 15058 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 2 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:32.077713 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:32.077996 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:32.078150 14784 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.078511 14860 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.082283 14784 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 2.
I20260709 12:22:32.082612 14860 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 2.
I20260709 12:22:32.083178 14898 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.083963 15058 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.084343 15058 raft_consensus.cc:697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:32.085150 15058 consensus_queue.cc:237] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.091563 14679 catalog_manager.cc:5697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.471120 14936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:48650
I20260709 12:22:32.471684 14936 raft_consensus.cc:606] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:32.476085 14936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:48650
I20260709 12:22:32.476514 14936 raft_consensus.cc:606] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:32.489365 14860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:34414
I20260709 12:22:32.489964 14860 raft_consensus.cc:606] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:32.494920 14936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:48650
I20260709 12:22:32.495396 14936 raft_consensus.cc:606] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:32.509699 14784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d20c707d10e648a18b079af473dc3276"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:38128
I20260709 12:22:32.510113 14784 raft_consensus.cc:606] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:32.514442 14936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceccd12495244015832e1d08bae3663e"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:48650
I20260709 12:22:32.515012 14936 raft_consensus.cc:606] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:32.523353 14860 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:32.524494 14987 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.534303 14784 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:32.535825 14987 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.543957 15073 raft_consensus.cc:993] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:32.544612 15049 raft_consensus.cc:1081] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:32.546482 14859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d20c707d10e648a18b079af473dc3276"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:34406
I20260709 12:22:32.547012 14859 raft_consensus.cc:493] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.547363 14859 raft_consensus.cc:3060] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.549978 15070 raft_consensus.cc:993] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.550400 15058 raft_consensus.cc:1081] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.553583 14784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:40106
I20260709 12:22:32.553658 14859 raft_consensus.cc:515] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.554136 14784 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.554546 14784 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.558259 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:32.559047 14785 raft_consensus.cc:3055] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.559367 14785 raft_consensus.cc:740] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:32.560026 14785 consensus_queue.cc:260] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.560436 14784 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.561224 14785 raft_consensus.cc:3060] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.562155 14784 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 3 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:32.562996 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:32.563488 14860 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.563289 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:32.563908 14935 raft_consensus.cc:3055] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:32.564224 14935 raft_consensus.cc:740] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:32.558259 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20c707d10e648a18b079af473dc3276" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:32.565299 14936 raft_consensus.cc:3060] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.564992 14935 consensus_queue.cc:260] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.566262 14935 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.569796 14936 raft_consensus.cc:2468] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 2.
I20260709 12:22:32.569957 14860 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 3.
I20260709 12:22:32.570962 14823 leader_election.cc:304] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:32.571738 15016 raft_consensus.cc:2804] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.572191 14750 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.572585 14935 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 3.
I20260709 12:22:32.573050 15049 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:32.573514 15049 raft_consensus.cc:697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:32.574309 15049 consensus_queue.cc:237] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.575014 15016 raft_consensus.cc:697] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:32.576166 14785 raft_consensus.cc:2468] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 2.
I20260709 12:22:32.575872 15016 consensus_queue.cc:237] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.576959 14859 leader_election.cc:290] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 2 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:32.581902 14681 catalog_manager.cc:5697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 2 to 3, leader changed from 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 3 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.583678 14679 catalog_manager.cc:5697] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 1 to 2, leader changed from 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 2 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.790467 15070 raft_consensus.cc:993] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:32.790859 15058 raft_consensus.cc:1081] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:32.792227 14859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceccd12495244015832e1d08bae3663e"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:40736
I20260709 12:22:32.792626 14859 raft_consensus.cc:493] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.792866 14859 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.797314 14859 raft_consensus.cc:515] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.798866 14859 leader_election.cc:290] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 2 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:32.799626 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:32.799754 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:32.800202 14785 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.800283 15070 raft_consensus.cc:993] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.800350 14936 raft_consensus.cc:3055] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.800813 14936 raft_consensus.cc:740] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:32.800825 15058 raft_consensus.cc:1081] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.801659 14936 consensus_queue.cc:260] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.802475 14784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:40106
I20260709 12:22:32.802897 14936 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.803082 14784 raft_consensus.cc:493] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.803450 14784 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.804695 15058 raft_consensus.cc:993] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.805125 15070 raft_consensus.cc:1081] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.806578 14783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:40106
I20260709 12:22:32.807087 14783 raft_consensus.cc:493] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.807418 14783 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.809204 14785 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 2.
I20260709 12:22:32.809445 14936 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 2.
I20260709 12:22:32.810316 14824 leader_election.cc:304] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.810422 14784 raft_consensus.cc:515] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.811400 15016 raft_consensus.cc:2804] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.811873 15016 raft_consensus.cc:697] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:32.812885 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:32.813143 14784 leader_election.cc:290] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:32.813570 14859 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.812665 15016 consensus_queue.cc:237] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.814304 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:32.814865 14936 raft_consensus.cc:3055] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.814546 14783 raft_consensus.cc:515] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.815200 14936 raft_consensus.cc:740] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:32.816005 14936 consensus_queue.cc:260] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.817181 14936 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.817345 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:32.818086 14860 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.820329 14859 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:32.823298 14936 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:32.824272 14750 leader_election.cc:304] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.824842 14783 leader_election.cc:290] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:32.825124 15049 raft_consensus.cc:2804] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.825596 15049 raft_consensus.cc:697] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:32.826407 15049 consensus_queue.cc:237] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.826671 14679 catalog_manager.cc:5697] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 1 to 2, leader changed from 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 2 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.828779 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:32.829372 14936 raft_consensus.cc:3055] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.829717 14936 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:32.829998 14860 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:32.830704 14936 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.831017 14750 leader_election.cc:304] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.831905 15073 raft_consensus.cc:2804] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.832007 14936 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.833360 15073 raft_consensus.cc:697] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:32.834196 15073 consensus_queue.cc:237] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.838126 14681 catalog_manager.cc:5697] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 1 to 2, leader changed from 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 2 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.838907 14936 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:32.849105 14681 catalog_manager.cc:5697] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 1 to 2, leader changed from 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 2 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.869647 15075 raft_consensus.cc:993] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.870031 15016 raft_consensus.cc:1081] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:32.871441 14783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:38116
I20260709 12:22:32.872007 14783 raft_consensus.cc:493] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.872362 14783 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.876713 14783 raft_consensus.cc:515] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.878113 14783 leader_election.cc:290] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:32.878924 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:32.879179 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:32.879462 14860 raft_consensus.cc:3055] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.879673 14936 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.879829 14860 raft_consensus.cc:740] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:32.880568 14860 consensus_queue.cc:260] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.881528 14860 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.884049 14936 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:32.885087 14748 leader_election.cc:304] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:32.885763 15073 raft_consensus.cc:2804] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.886271 15073 raft_consensus.cc:697] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:32.887326 14860 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:32.887128 15073 consensus_queue.cc:237] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:32.895004 14681 catalog_manager.cc:5697] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 1 to 2, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 2 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.004124 14936 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.005475 15073 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.013192 14860 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:33.014747 15073 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.055616 14783 raft_consensus.cc:1275] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.056663 15016 consensus_queue.cc:1048] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.064517 14936 raft_consensus.cc:1275] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.066005 15016 consensus_queue.cc:1048] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.282938 14860 raft_consensus.cc:1275] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.284147 15073 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.292079 14936 raft_consensus.cc:1275] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.293716 15082 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.298029 14935 raft_consensus.cc:1275] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.299721 15016 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.308851 14783 raft_consensus.cc:1275] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.309597 14935 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.311645 15082 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.313374 15090 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.324191 14860 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.328090 15073 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.409297 14860 raft_consensus.cc:1275] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.410490 15073 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.418349 14935 raft_consensus.cc:1275] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.419664 15082 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:35.547187 14649 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:22:35.547926 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.567241 14784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
mode: GRACEFUL
new_leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:38138
I20260709 12:22:35.567737 14784 raft_consensus.cc:606] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Received request to transfer leadership to TS 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:35.577643 14860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceccd12495244015832e1d08bae3663e"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 12:22:35.578140 14860 raft_consensus.cc:606] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Received request to transfer leadership to TS 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:35.579142 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:35.579586 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.667150 15079 raft_consensus.cc:993] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: : Instructing follower 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:35.667577 15079 raft_consensus.cc:1081] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Signalling peer 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:35.668871 14935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:48644
I20260709 12:22:35.669351 14935 raft_consensus.cc:493] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.669665 14935 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.674995 14935 raft_consensus.cc:515] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:35.676465 14935 leader_election.cc:290] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 3 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043)
I20260709 12:22:35.677217 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:35.677574 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:35.677776 14860 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.678143 14784 raft_consensus.cc:3055] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.678458 14784 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:35.679204 14784 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:35.680370 14784 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.683590 14860 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 3.
I20260709 12:22:35.684595 14899 leader_election.cc:304] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:35.685248 15070 raft_consensus.cc:2804] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:35.686044 14784 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 3.
I20260709 12:22:35.686355 15070 raft_consensus.cc:697] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:35.687099 15070 consensus_queue.cc:237] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:35.693310 14681 catalog_manager.cc:5697] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 2 to 3, leader changed from 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65) to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.842021 15107 raft_consensus.cc:993] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: : Instructing follower 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:35.842478 15107 raft_consensus.cc:1081] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Signalling peer 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:35.843825 14935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceccd12495244015832e1d08bae3663e"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:48646
I20260709 12:22:35.844331 14935 raft_consensus.cc:493] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.844583 14935 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.849121 14935 raft_consensus.cc:515] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:35.850984 14935 leader_election.cc:290] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 3 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:35.851750 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:35.852100 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:35.852330 14784 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.852641 14860 raft_consensus.cc:3055] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.852947 14860 raft_consensus.cc:740] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:35.853646 14860 consensus_queue.cc:260] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:35.854717 14860 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.858840 14784 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 3.
I20260709 12:22:35.859834 14898 leader_election.cc:304] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:35.860589 15070 raft_consensus.cc:2804] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:35.861073 14860 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 3.
I20260709 12:22:35.861106 15070 raft_consensus.cc:697] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:35.862066 15070 consensus_queue.cc:237] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:35.868218 14681 catalog_manager.cc:5697] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 2 to 3, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.205287 14784 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:36.206478 15070 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.215186 14860 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:36.216884 15111 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.249939 14860 raft_consensus.cc:1275] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:36.250907 15111 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.258618 14784 raft_consensus.cc:1275] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:36.260129 15070 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.580449 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.585295 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:36.585666 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:37.586845 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.591763 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:37.592114 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:38.593230 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.600589 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:38.600968 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:39.601979 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.607144 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:39.607605 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:40.608596 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:40.613876 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.614228 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.615027 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.619765 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:41.620098 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:42.620934 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.625757 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.626077 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.627017 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.632360 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:43.632717 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.633554 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.638276 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:44.638682 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.665743 14649 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:45.669955 14936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:48650
I20260709 12:22:45.670564 14936 raft_consensus.cc:606] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:45.675107 14783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:38128
I20260709 12:22:45.675633 14783 raft_consensus.cc:606] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:45.679956 14783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:38128
I20260709 12:22:45.680325 14783 raft_consensus.cc:606] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:45.684530 14783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:38128
I20260709 12:22:45.684887 14783 raft_consensus.cc:606] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:45.693768 14936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceccd12495244015832e1d08bae3663e"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
mode: GRACEFUL
new_leader_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:48650
I20260709 12:22:45.694157 14936 raft_consensus.cc:606] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Received request to transfer leadership to TS 00875a721cc546609dae20df0b678ece
I20260709 12:22:45.772042 15121 raft_consensus.cc:993] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:45.772544 15125 raft_consensus.cc:1081] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:45.774000 14860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:34406
I20260709 12:22:45.774477 14860 raft_consensus.cc:493] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.774760 14860 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.780110 14860 raft_consensus.cc:515] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:45.782238 14860 leader_election.cc:290] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 3 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:45.783128 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:45.782882 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:45.783710 14936 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.783769 14783 raft_consensus.cc:3055] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:45.784163 14783 raft_consensus.cc:740] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:45.784965 14783 consensus_queue.cc:260] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:45.786302 14783 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.790102 14936 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 3.
I20260709 12:22:45.791218 14823 leader_election.cc:304] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:45.791975 15123 raft_consensus.cc:2804] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:45.792317 14783 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 3.
I20260709 12:22:45.792971 15123 raft_consensus.cc:697] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:45.793987 15123 consensus_queue.cc:237] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:45.800451 14681 catalog_manager.cc:5697] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 2 to 3, leader changed from 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 3 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.848572 15119 raft_consensus.cc:993] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:45.849123 15132 raft_consensus.cc:1081] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:45.850361 14860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:40736
I20260709 12:22:45.850728 14860 raft_consensus.cc:493] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.850940 14860 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.854823 14860 raft_consensus.cc:515] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:45.856227 14860 leader_election.cc:290] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 4 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:45.856864 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:45.857121 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:45.857389 14783 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.857579 14936 raft_consensus.cc:3055] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:45.857868 14936 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:45.858579 14936 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:45.859710 14936 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.863304 14783 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 4.
I20260709 12:22:45.864499 14824 leader_election.cc:304] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:45.865209 15123 raft_consensus.cc:2804] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:45.865676 14936 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 4.
I20260709 12:22:45.865671 15123 raft_consensus.cc:697] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:45.866775 15123 consensus_queue.cc:237] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:45.872427 14681 catalog_manager.cc:5697] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 3 to 4, leader changed from 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 4 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.044773 15121 raft_consensus.cc:993] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:46.045228 15125 raft_consensus.cc:1081] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:46.046532 14860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:34406
I20260709 12:22:46.046891 14860 raft_consensus.cc:493] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.047123 14860 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.050832 14860 raft_consensus.cc:515] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.052150 14860 leader_election.cc:290] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 3 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:46.052848 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:46.053092 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:46.053382 14783 raft_consensus.cc:3055] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:46.053565 14936 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.053701 14783 raft_consensus.cc:740] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:46.054380 14783 consensus_queue.cc:260] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.055420 14783 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.059145 14936 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 3.
I20260709 12:22:46.060063 14823 leader_election.cc:304] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:46.060657 15123 raft_consensus.cc:2804] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:46.060961 14783 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 3.
I20260709 12:22:46.061167 15123 raft_consensus.cc:697] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:46.062067 15123 consensus_queue.cc:237] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.068301 14681 catalog_manager.cc:5697] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 2 to 3, leader changed from 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 3 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.090047 15119 raft_consensus.cc:993] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:46.090425 15132 raft_consensus.cc:1081] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:46.091678 14860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceccd12495244015832e1d08bae3663e"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:40736
I20260709 12:22:46.092100 14860 raft_consensus.cc:493] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.092396 14860 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.095587 15121 raft_consensus.cc:993] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: : Instructing follower 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:46.095979 15125 raft_consensus.cc:1081] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 LEADER]: Signalling peer 00875a721cc546609dae20df0b678ece to start an election
I20260709 12:22:46.097427 14859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8"
dest_uuid: "00875a721cc546609dae20df0b678ece"
 from {username='slave'} at 127.0.0.1:34406
I20260709 12:22:46.097851 14859 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.098160 14859 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.097860 14860 raft_consensus.cc:515] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.099349 14860 leader_election.cc:290] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 4 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:46.100179 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:46.100608 14936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceccd12495244015832e1d08bae3663e" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:46.100723 14783 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.101137 14936 raft_consensus.cc:3055] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:46.101408 14936 raft_consensus.cc:740] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:46.102034 14936 consensus_queue.cc:260] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.102829 14936 raft_consensus.cc:3060] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.104420 14859 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.106695 14936 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 4.
I20260709 12:22:46.107064 14783 raft_consensus.cc:2468] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 4.
I20260709 12:22:46.107353 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:46.107803 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "00875a721cc546609dae20df0b678ece" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:46.107926 14784 raft_consensus.cc:3055] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:46.108050 14823 leader_election.cc:304] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:46.108345 14935 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.108322 14784 raft_consensus.cc:740] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:46.108994 15123 raft_consensus.cc:2804] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:46.109155 14859 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 4 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:46.109540 15123 raft_consensus.cc:697] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:46.109443 14784 consensus_queue.cc:260] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.110656 14784 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.110420 15123 consensus_queue.cc:237] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.115465 14784 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 4.
I20260709 12:22:46.115489 14935 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00875a721cc546609dae20df0b678ece in term 4.
I20260709 12:22:46.116571 14823 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:46.117256 15123 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:46.117687 15123 raft_consensus.cc:697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Becoming Leader. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:46.118191 14681 catalog_manager.cc:5697] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 3 to 4, leader changed from 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 4 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.118335 15123 consensus_queue.cc:237] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:46.128614 14681 catalog_manager.cc:5697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece reported cstate change: term changed from 3 to 4, leader changed from 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65) to 00875a721cc546609dae20df0b678ece (127.14.78.66). New cstate: current_term: 4 leader_uuid: "00875a721cc546609dae20df0b678ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.246335 14935 raft_consensus.cc:1275] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.247648 15126 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.258183 14784 raft_consensus.cc:1275] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.260035 15123 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.312714 14935 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:46.313972 15123 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:46.322261 14784 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:46.323789 15126 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:46.503641 14784 raft_consensus.cc:1275] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.504958 15143 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.507994 14935 raft_consensus.cc:1275] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.509462 15143 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.539774 14935 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:46.540966 15143 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.549569 14784 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:46.551023 15123 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.703327 14935 raft_consensus.cc:1275] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:46.704465 15123 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:46.711741 14784 raft_consensus.cc:1275] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Refusing update from remote peer 00875a721cc546609dae20df0b678ece: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:46.713426 15123 consensus_queue.cc:1048] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:48.726141 14649 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:48.727173 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.734999 14859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 12:22:48.735607 14859 raft_consensus.cc:606] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Received request to transfer leadership to TS 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:48.737816 14859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:34420
I20260709 12:22:48.738193 14859 raft_consensus.cc:606] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:48.740182 14859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:34420
I20260709 12:22:48.740561 14859 raft_consensus.cc:606] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Received request to transfer leadership to TS 46fc3aa1a9424e709b44b3b998aa33c3
I20260709 12:22:48.742551 14859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:34420
I20260709 12:22:48.742918 14859 raft_consensus.cc:606] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:48.744897 14859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556"
dest_uuid: "00875a721cc546609dae20df0b678ece"
mode: GRACEFUL
new_leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:34420
I20260709 12:22:48.745288 14859 raft_consensus.cc:606] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Received request to transfer leadership to TS 5c9d836f07f74a29aa9b5f76bfeb874c
I20260709 12:22:48.746114 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:48.746457 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:48.759012 15153 raft_consensus.cc:993] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:48.759454 15154 raft_consensus.cc:1081] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:48.760830 14783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:38116
I20260709 12:22:48.761309 14783 raft_consensus.cc:493] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.761626 14783 raft_consensus.cc:3060] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.767715 14783 raft_consensus.cc:515] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.769589 14783 leader_election.cc:290] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:48.770275 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:48.770725 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1efe1b9c0a436cb6a8a1e099e67556" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:48.770955 14859 raft_consensus.cc:3055] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:48.771217 14935 raft_consensus.cc:3060] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.771265 14859 raft_consensus.cc:740] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:48.772056 14859 consensus_queue.cc:260] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.773307 14859 raft_consensus.cc:3060] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.775714 14935 raft_consensus.cc:2468] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:48.776760 14748 leader_election.cc:304] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:48.778131 14859 raft_consensus.cc:2468] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 2.
I20260709 12:22:48.778301 15155 raft_consensus.cc:2804] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:48.779246 15155 raft_consensus.cc:697] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:48.780042 15155 consensus_queue.cc:237] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.786706 14678 catalog_manager.cc:5697] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 1 to 2, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 2 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.815986 15153 raft_consensus.cc:993] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:48.816386 15154 raft_consensus.cc:1081] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:48.817703 14783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:38116
I20260709 12:22:48.818213 14783 raft_consensus.cc:493] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.818490 14783 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.822610 14783 raft_consensus.cc:515] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.823926 14783 leader_election.cc:290] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 5 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:48.824587 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:48.824800 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b488cf45f049b69116a31274d8bf6e" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:48.825179 14859 raft_consensus.cc:3055] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.825297 14935 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.825536 14859 raft_consensus.cc:740] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:48.826306 14859 consensus_queue.cc:260] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.827455 14859 raft_consensus.cc:3060] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.831239 14935 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 5.
I20260709 12:22:48.832198 14748 leader_election.cc:304] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:48.832868 15155 raft_consensus.cc:2804] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:48.833369 15155 raft_consensus.cc:697] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:48.833477 14859 raft_consensus.cc:2468] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 5.
I20260709 12:22:48.834273 15155 consensus_queue.cc:237] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.841156 14678 catalog_manager.cc:5697] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 4 to 5, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 5 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.931524 15153 raft_consensus.cc:993] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: : Instructing follower 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:48.931954 15154 raft_consensus.cc:1081] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Signalling peer 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:48.933241 14935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:48646
I20260709 12:22:48.933604 14935 raft_consensus.cc:493] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.933812 14935 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.937790 15153 raft_consensus.cc:993] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: : Instructing follower 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:48.938213 15154 raft_consensus.cc:1081] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Signalling peer 5c9d836f07f74a29aa9b5f76bfeb874c to start an election
I20260709 12:22:48.938273 14935 raft_consensus.cc:515] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.939630 14783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8"
dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
 from {username='slave'} at 127.0.0.1:38116
I20260709 12:22:48.940070 14783 raft_consensus.cc:493] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:48.940565 14935 leader_election.cc:290] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 4 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:48.940371 14783 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.941252 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:48.941779 14784 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.941718 14859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ea5de9db4e44ea92ba2be675dd0613" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:48.942314 14859 raft_consensus.cc:3055] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:48.942641 14859 raft_consensus.cc:740] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:48.943362 14859 consensus_queue.cc:260] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.944550 14859 raft_consensus.cc:3060] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.945317 14783 raft_consensus.cc:515] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.947729 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:48.948006 14935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f6f1556f9694b5cb528a926abcc6ad8" candidate_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
I20260709 12:22:48.948275 14860 raft_consensus.cc:3055] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.948472 14935 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.947727 14783 leader_election.cc:290] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 5 election: Requested vote from peers 00875a721cc546609dae20df0b678ece (127.14.78.66:36299), 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67:37031)
I20260709 12:22:48.948683 14860 raft_consensus.cc:740] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:48.949613 14860 consensus_queue.cc:260] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.950589 14860 raft_consensus.cc:3060] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.951599 14859 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 4.
I20260709 12:22:48.952778 14899 leader_election.cc:304] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00875a721cc546609dae20df0b678ece, 46fc3aa1a9424e709b44b3b998aa33c3; no voters: 
I20260709 12:22:48.948280 14784 raft_consensus.cc:2468] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 4.
I20260709 12:22:48.952312 14935 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 5.
I20260709 12:22:48.953661 15132 raft_consensus.cc:2804] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:48.954335 14748 leader_election.cc:304] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:48.955080 15155 raft_consensus.cc:2804] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:48.955518 15155 raft_consensus.cc:697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 LEADER]: Becoming Leader. State: Replica: 5c9d836f07f74a29aa9b5f76bfeb874c, State: Running, Role: LEADER
I20260709 12:22:48.956310 14860 raft_consensus.cc:2468] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9d836f07f74a29aa9b5f76bfeb874c in term 5.
I20260709 12:22:48.956398 15155 consensus_queue.cc:237] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.957268 15132 raft_consensus.cc:697] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:48.958134 15132 consensus_queue.cc:237] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:48.966413 14678 catalog_manager.cc:5697] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c reported cstate change: term changed from 4 to 5, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65). New cstate: current_term: 5 leader_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.966586 14679 catalog_manager.cc:5697] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 3 to 4, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 4 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.056509 15153 raft_consensus.cc:993] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: : Instructing follower 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:49.056934 15154 raft_consensus.cc:1081] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Signalling peer 46fc3aa1a9424e709b44b3b998aa33c3 to start an election
I20260709 12:22:49.058212 14935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc"
dest_uuid: "46fc3aa1a9424e709b44b3b998aa33c3"
 from {username='slave'} at 127.0.0.1:48646
I20260709 12:22:49.058651 14935 raft_consensus.cc:493] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.058943 14935 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.062847 14935 raft_consensus.cc:515] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:49.064111 14935 leader_election.cc:290] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 4 election: Requested vote from peers 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043), 00875a721cc546609dae20df0b678ece (127.14.78.66:36299)
I20260709 12:22:49.064924 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c"
I20260709 12:22:49.065173 14860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fb9ff806884c07a0662e5c64ad5cbc" candidate_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00875a721cc546609dae20df0b678ece"
I20260709 12:22:49.065496 14783 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.065657 14860 raft_consensus.cc:3055] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:49.065979 14860 raft_consensus.cc:740] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00875a721cc546609dae20df0b678ece, State: Running, Role: LEADER
I20260709 12:22:49.066694 14860 consensus_queue.cc:260] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:49.067778 14860 raft_consensus.cc:3060] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.071148 14783 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 4.
I20260709 12:22:49.072299 14898 leader_election.cc:304] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46fc3aa1a9424e709b44b3b998aa33c3, 5c9d836f07f74a29aa9b5f76bfeb874c; no voters: 
I20260709 12:22:49.073123 15132 raft_consensus.cc:2804] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:49.073566 15132 raft_consensus.cc:697] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 LEADER]: Becoming Leader. State: Replica: 46fc3aa1a9424e709b44b3b998aa33c3, State: Running, Role: LEADER
I20260709 12:22:49.073696 14860 raft_consensus.cc:2468] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46fc3aa1a9424e709b44b3b998aa33c3 in term 4.
I20260709 12:22:49.074457 15132 consensus_queue.cc:237] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } }
I20260709 12:22:49.081316 14679 catalog_manager.cc:5697] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 reported cstate change: term changed from 3 to 4, leader changed from 00875a721cc546609dae20df0b678ece (127.14.78.66) to 46fc3aa1a9424e709b44b3b998aa33c3 (127.14.78.67). New cstate: current_term: 4 leader_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.279856 14935 raft_consensus.cc:1275] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:49.281152 15155 consensus_queue.cc:1048] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:49.291921 14860 raft_consensus.cc:1275] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:49.293591 15169 consensus_queue.cc:1048] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:49.406131 14860 raft_consensus.cc:1275] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:49.407356 15132 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:49.415759 14783 raft_consensus.cc:1275] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:49.417140 15132 consensus_queue.cc:1048] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:49.429028 14935 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:49.430317 15155 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:49.435393 14860 raft_consensus.cc:1275] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:49.436769 15169 consensus_queue.cc:1048] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:49.458235 14860 raft_consensus.cc:1275] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:49.459266 15174 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:49.467255 14783 raft_consensus.cc:1275] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Refusing update from remote peer 46fc3aa1a9424e709b44b3b998aa33c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:49.468549 15163 consensus_queue.cc:1048] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9d836f07f74a29aa9b5f76bfeb874c" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:49.568521 14859 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:49.569659 15169 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "00875a721cc546609dae20df0b678ece" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:49.577564 14935 raft_consensus.cc:1275] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Refusing update from remote peer 5c9d836f07f74a29aa9b5f76bfeb874c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:49.579089 15181 consensus_queue.cc:1048] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [LEADER]: Connected to new peer: Peer: permanent_uuid: "46fc3aa1a9424e709b44b3b998aa33c3" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:49.747408 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.752221 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:49.752601 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.753595 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.759073 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.759451 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.760497 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.765185 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:51.765553 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.766438 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.771075 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:52.771445 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:53.772439 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.777835 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:53.778205 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:54.779176 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.784696 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.785092 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.786154 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.790897 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:55.791286 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:56.799077 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.809669 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:56.810242 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:57.811690 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.816272 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:57.816608 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.843158 14649 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:58.843741 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
I20260709 12:22:58.869555 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:58.870275 14649 tablet_replica.cc:333] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.871371 14649 raft_consensus.cc:2243] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:22:58.872648 14649 raft_consensus.cc:2272] T 4f6f1556f9694b5cb528a926abcc6ad8 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:58.873487 14824 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:58.875548 14649 tablet_replica.cc:333] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.876190 14649 raft_consensus.cc:2243] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:22:58.876876 14824 consensus_peers.cc:597] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece -> Peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Couldn't send request to peer 5c9d836f07f74a29aa9b5f76bfeb874c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.877262 14649 raft_consensus.cc:2272] T af1efe1b9c0a436cb6a8a1e099e67556 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.879477 14649 tablet_replica.cc:333] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.880137 14649 raft_consensus.cc:2243] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.880661 14649 raft_consensus.cc:2272] T 14b52ba25ab544b0a502162a99ca566b P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:58.882064 14824 consensus_peers.cc:597] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece -> Peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Couldn't send request to peer 5c9d836f07f74a29aa9b5f76bfeb874c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.882711 14649 tablet_replica.cc:333] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.883212 14649 raft_consensus.cc:2243] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.883611 14649 raft_consensus.cc:2272] T 79ea5de9db4e44ea92ba2be675dd0613 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.885218 14649 tablet_replica.cc:333] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.885685 14649 raft_consensus.cc:2243] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.886133 14649 raft_consensus.cc:2272] T ceccd12495244015832e1d08bae3663e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.887723 14649 tablet_replica.cc:333] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.888186 14649 raft_consensus.cc:2243] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.888604 14649 raft_consensus.cc:2272] T 09fb9ff806884c07a0662e5c64ad5cbc P 5c9d836f07f74a29aa9b5f76bfeb874c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.890156 14649 tablet_replica.cc:333] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.890625 14649 raft_consensus.cc:2243] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.891016 14649 raft_consensus.cc:2272] T d20c707d10e648a18b079af473dc3276 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.892616 14649 tablet_replica.cc:333] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.893097 14649 raft_consensus.cc:2243] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:58.893474 14649 raft_consensus.cc:2272] T 85d2938371b5433ea76a69c82457b8b1 P 5c9d836f07f74a29aa9b5f76bfeb874c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:58.895025 14649 tablet_replica.cc:333] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c: stopping tablet replica
I20260709 12:22:58.895459 14649 raft_consensus.cc:2243] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:22:58.896203 14649 raft_consensus.cc:2272] T a3b488cf45f049b69116a31274d8bf6e P 5c9d836f07f74a29aa9b5f76bfeb874c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:58.898900 14824 consensus_peers.cc:597] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece -> Peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Couldn't send request to peer 5c9d836f07f74a29aa9b5f76bfeb874c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.981210 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
I20260709 12:22:58.998517 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
I20260709 12:22:59.023437 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:59.024032 14649 tablet_replica.cc:333] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.024600 14649 raft_consensus.cc:2243] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.025434 14649 raft_consensus.cc:2272] T ceccd12495244015832e1d08bae3663e P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.027122 14649 tablet_replica.cc:333] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.027558 14649 raft_consensus.cc:2243] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.027896 14649 raft_consensus.cc:2272] T af1efe1b9c0a436cb6a8a1e099e67556 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.029409 14649 tablet_replica.cc:333] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.029850 14649 raft_consensus.cc:2243] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.030488 14649 raft_consensus.cc:2272] T 85d2938371b5433ea76a69c82457b8b1 P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.032130 14649 tablet_replica.cc:333] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.032531 14649 raft_consensus.cc:2243] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.033268 14649 raft_consensus.cc:2272] T d20c707d10e648a18b079af473dc3276 P 00875a721cc546609dae20df0b678ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.035162 14649 tablet_replica.cc:333] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.035771 14649 raft_consensus.cc:2243] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.036278 14649 raft_consensus.cc:2272] T 09fb9ff806884c07a0662e5c64ad5cbc P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.037994 14649 tablet_replica.cc:333] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.038400 14649 raft_consensus.cc:2243] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.038784 14649 raft_consensus.cc:2272] T 14b52ba25ab544b0a502162a99ca566b P 00875a721cc546609dae20df0b678ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.040369 14649 tablet_replica.cc:333] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.040771 14649 raft_consensus.cc:2243] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.041188 14649 raft_consensus.cc:2272] T 79ea5de9db4e44ea92ba2be675dd0613 P 00875a721cc546609dae20df0b678ece [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.042590 14649 tablet_replica.cc:333] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.042964 14649 raft_consensus.cc:2243] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.043285 14649 raft_consensus.cc:2272] T a3b488cf45f049b69116a31274d8bf6e P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.044699 14649 tablet_replica.cc:333] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece: stopping tablet replica
I20260709 12:22:59.045069 14649 raft_consensus.cc:2243] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.045394 14649 raft_consensus.cc:2272] T 4f6f1556f9694b5cb528a926abcc6ad8 P 00875a721cc546609dae20df0b678ece [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:59.063469 14898 consensus_peers.cc:597] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 -> Peer 5c9d836f07f74a29aa9b5f76bfeb874c (127.14.78.65:33043): Couldn't send request to peer 5c9d836f07f74a29aa9b5f76bfeb874c. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:33043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:59.073113 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
I20260709 12:22:59.091039 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
I20260709 12:22:59.113507 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:59.114185 14649 tablet_replica.cc:333] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.114799 14649 raft_consensus.cc:2243] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.115248 14649 raft_consensus.cc:2272] T 85d2938371b5433ea76a69c82457b8b1 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.116951 14649 tablet_replica.cc:333] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.117507 14649 raft_consensus.cc:2243] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.117911 14649 raft_consensus.cc:2272] T ceccd12495244015832e1d08bae3663e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.119479 14649 tablet_replica.cc:333] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.119961 14649 raft_consensus.cc:2243] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.120710 14649 raft_consensus.cc:2272] T 79ea5de9db4e44ea92ba2be675dd0613 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.122269 14649 tablet_replica.cc:333] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.122743 14649 raft_consensus.cc:2243] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.123432 14649 raft_consensus.cc:2272] T 14b52ba25ab544b0a502162a99ca566b P 46fc3aa1a9424e709b44b3b998aa33c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.124899 14649 tablet_replica.cc:333] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.125413 14649 raft_consensus.cc:2243] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.125806 14649 raft_consensus.cc:2272] T d20c707d10e648a18b079af473dc3276 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.127247 14649 tablet_replica.cc:333] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.127697 14649 raft_consensus.cc:2243] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.128441 14649 raft_consensus.cc:2272] T 09fb9ff806884c07a0662e5c64ad5cbc P 46fc3aa1a9424e709b44b3b998aa33c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.129993 14649 tablet_replica.cc:333] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.130435 14649 raft_consensus.cc:2243] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.130824 14649 raft_consensus.cc:2272] T af1efe1b9c0a436cb6a8a1e099e67556 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.132226 14649 tablet_replica.cc:333] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.132671 14649 raft_consensus.cc:2243] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.133142 14649 raft_consensus.cc:2272] T 4f6f1556f9694b5cb528a926abcc6ad8 P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.134624 14649 tablet_replica.cc:333] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3: stopping tablet replica
I20260709 12:22:59.135039 14649 raft_consensus.cc:2243] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:59.135494 14649 raft_consensus.cc:2272] T a3b488cf45f049b69116a31274d8bf6e P 46fc3aa1a9424e709b44b3b998aa33c3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.162061 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
I20260709 12:22:59.178804 14649 master.cc:562] Master@127.14.78.126:39585 shutting down...
I20260709 12:22:59.236266 14737 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:22:59.398988 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:59.399622 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:59.399996 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6db4e3f32baa4c698458d23672deb3b5: stopping tablet replica
I20260709 12:22:59.420013 14649 master.cc:584] Master@127.14.78.126:39585 shutdown complete.
00875a721cc546609dae20df0b678ece  4
46fc3aa1a9424e709b44b3b998aa33c3  1
5c9d836f07f74a29aa9b5f76bfeb874c  4
00875a721cc546609dae20df0b678ece  3
46fc3aa1a9424e709b44b3b998aa33c3  3
5c9d836f07f74a29aa9b5f76bfeb874c  3
00875a721cc546609dae20df0b678ece  8
46fc3aa1a9424e709b44b3b998aa33c3  1
5c9d836f07f74a29aa9b5f76bfeb874c  0
00875a721cc546609dae20df0b678ece  3
46fc3aa1a9424e709b44b3b998aa33c3  3
5c9d836f07f74a29aa9b5f76bfeb874c  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32764 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:59.463342 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:44131
I20260709 12:22:59.464473 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:59.469861 15194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.470079 15195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.471176 15197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:59.471211 14649 server_base.cc:1061] running on GCE node
I20260709 12:22:59.472328 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:59.472510 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:59.472708 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599779472674 us; error 0 us; skew 500 ppm
I20260709 12:22:59.473290 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:59.475534 14649 webserver.cc:533] Webserver started at http://127.14.78.126:45369/ using document root <none> and password file <none>
I20260709 12:22:59.476012 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:59.476197 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:59.476482 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:59.477640 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "c840d42d71fc47ad8501df998234aac4"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.481865 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:22:59.484884 15202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.485613 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:59.485893 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "c840d42d71fc47ad8501df998234aac4"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.486150 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:59.504158 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:59.505427 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:59.544484 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:44131
I20260709 12:22:59.544579 15254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:44131 every 8 connection(s)
I20260709 12:22:59.548296 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:59.557343 15255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4: Bootstrap starting.
I20260709 12:22:59.561731 15255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:59.565493 15255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4: No bootstrap required, opened a new log
I20260709 12:22:59.567438 15255 raft_consensus.cc:359] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c840d42d71fc47ad8501df998234aac4" member_type: VOTER }
I20260709 12:22:59.567816 15255 raft_consensus.cc:385] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:59.567997 15255 raft_consensus.cc:740] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c840d42d71fc47ad8501df998234aac4, State: Initialized, Role: FOLLOWER
I20260709 12:22:59.568544 15255 consensus_queue.cc:260] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c840d42d71fc47ad8501df998234aac4" member_type: VOTER }
I20260709 12:22:59.568959 15255 raft_consensus.cc:399] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:59.569166 15255 raft_consensus.cc:493] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:59.569373 15255 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:59.573889 15255 raft_consensus.cc:515] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c840d42d71fc47ad8501df998234aac4" member_type: VOTER }
I20260709 12:22:59.574560 15255 leader_election.cc:304] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c840d42d71fc47ad8501df998234aac4; no voters: 
I20260709 12:22:59.575616 15255 leader_election.cc:290] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:59.575924 15258 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:59.577209 15258 raft_consensus.cc:697] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 1 LEADER]: Becoming Leader. State: Replica: c840d42d71fc47ad8501df998234aac4, State: Running, Role: LEADER
I20260709 12:22:59.577827 15258 consensus_queue.cc:237] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c840d42d71fc47ad8501df998234aac4" member_type: VOTER }
I20260709 12:22:59.578516 15255 sys_catalog.cc:565] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:59.584282 15260 sys_catalog.cc:455] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c840d42d71fc47ad8501df998234aac4. Latest consensus state: current_term: 1 leader_uuid: "c840d42d71fc47ad8501df998234aac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c840d42d71fc47ad8501df998234aac4" member_type: VOTER } }
I20260709 12:22:59.585012 15260 sys_catalog.cc:458] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:59.587095 15259 sys_catalog.cc:455] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c840d42d71fc47ad8501df998234aac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c840d42d71fc47ad8501df998234aac4" member_type: VOTER } }
I20260709 12:22:59.587800 15259 sys_catalog.cc:458] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:59.591909 15268 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:59.592912 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:59.596711 15268 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:59.604537 15268 catalog_manager.cc:1383] Generated new cluster ID: 20efa1b4e82348dab53e79214748a0f4
I20260709 12:22:59.604769 15268 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:59.618347 15268 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:59.619428 15268 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:59.631481 15268 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4: Generated new TSK 0
I20260709 12:22:59.631984 15268 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:59.658867 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:59.664793 15276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.665711 15277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.667160 15279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:59.667490 14649 server_base.cc:1061] running on GCE node
I20260709 12:22:59.668347 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:59.668531 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:59.668663 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599779668651 us; error 0 us; skew 500 ppm
I20260709 12:22:59.669171 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:59.671239 14649 webserver.cc:533] Webserver started at http://127.14.78.65:41893/ using document root <none> and password file <none>
I20260709 12:22:59.671670 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:59.671818 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:59.672067 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:59.673028 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "cda1d403407e4eadb7ec367da8ff99fc"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.677241 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:59.680281 15284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.681205 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:59.681524 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "cda1d403407e4eadb7ec367da8ff99fc"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.681805 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:59.699980 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:59.701174 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:59.702576 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:59.704718 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:59.704885 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.705240 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:59.705407 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.744683 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:39411
I20260709 12:22:59.744800 15346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:39411 every 8 connection(s)
I20260709 12:22:59.749397 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:59.756333 15351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.757611 15352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.760634 15355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:59.761274 14649 server_base.cc:1061] running on GCE node
I20260709 12:22:59.762342 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:59.762609 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:59.762797 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599779762762 us; error 0 us; skew 500 ppm
I20260709 12:22:59.763324 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:59.763948 15347 heartbeater.cc:344] Connected to a master server at 127.14.78.126:44131
I20260709 12:22:59.764351 15347 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:59.765216 15347 heartbeater.cc:507] Master 127.14.78.126:44131 requested a full tablet report, sending...
I20260709 12:22:59.765843 14649 webserver.cc:533] Webserver started at http://127.14.78.66:43203/ using document root <none> and password file <none>
I20260709 12:22:59.766465 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:59.766696 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:59.766979 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:59.767534 15219 ts_manager.cc:194] Registered new tserver with Master: cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411)
I20260709 12:22:59.768138 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "1e1ce3c9edc84272ba7460df5382734b"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.769436 15219 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52768
I20260709 12:22:59.772538 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:22:59.775816 15359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.776549 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:59.776823 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "1e1ce3c9edc84272ba7460df5382734b"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.777129 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:59.793951 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:59.795035 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:59.796366 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:59.798499 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:59.798714 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.798959 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:59.799134 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.836731 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:36989
I20260709 12:22:59.836841 15422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:36989 every 8 connection(s)
I20260709 12:22:59.841276 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:59.847924 15426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:59.848680 15427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:59.852008 14649 server_base.cc:1061] running on GCE node
W20260709 12:22:59.852900 15429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:59.853941 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:59.854050 15423 heartbeater.cc:344] Connected to a master server at 127.14.78.126:44131
W20260709 12:22:59.854264 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:59.854439 15423 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:59.854467 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599779854450 us; error 0 us; skew 500 ppm
I20260709 12:22:59.855307 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:59.855343 15423 heartbeater.cc:507] Master 127.14.78.126:44131 requested a full tablet report, sending...
I20260709 12:22:59.857631 15219 ts_manager.cc:194] Registered new tserver with Master: 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:22:59.858003 14649 webserver.cc:533] Webserver started at http://127.14.78.67:40333/ using document root <none> and password file <none>
I20260709 12:22:59.858444 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:59.858580 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:59.858762 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:59.858963 15219 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52784
I20260709 12:22:59.860008 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.864418 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:59.867535 15434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.868312 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:59.868619 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
format_stamp: "Formatted at 2026-07-09 12:22:59 on dist-test-slave-vrh7"
I20260709 12:22:59.868882 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:59.882913 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:59.884050 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:59.885512 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:59.887594 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:59.887779 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.888075 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:59.888214 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:59.926224 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:43753
I20260709 12:22:59.926343 15496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:43753 every 8 connection(s)
I20260709 12:22:59.939522 15497 heartbeater.cc:344] Connected to a master server at 127.14.78.126:44131
I20260709 12:22:59.939888 15497 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:59.940620 15497 heartbeater.cc:507] Master 127.14.78.126:44131 requested a full tablet report, sending...
I20260709 12:22:59.942418 15219 ts_manager.cc:194] Registered new tserver with Master: cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:22:59.942590 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013318285s
I20260709 12:22:59.943758 15219 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52788
I20260709 12:22:59.965924 15219 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52802:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:59.968696 15219 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:00.051630 15388 tablet_service.cc:1511] Processing CreateTablet for tablet c7a03bac8ba048488d03d5b6ab45ccfd (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:00.052561 15387 tablet_service.cc:1511] Processing CreateTablet for tablet fc72a67c919b42f298db58367f7a98e0 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:00.053131 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a03bac8ba048488d03d5b6ab45ccfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.053390 15462 tablet_service.cc:1511] Processing CreateTablet for tablet c7a03bac8ba048488d03d5b6ab45ccfd (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:00.053927 15387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc72a67c919b42f298db58367f7a98e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.054589 15462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a03bac8ba048488d03d5b6ab45ccfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.056157 15385 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0ea1018b52415d9e6bbf6ecd4f2ff9 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:00.057487 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0ea1018b52415d9e6bbf6ecd4f2ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.057238 15383 tablet_service.cc:1511] Processing CreateTablet for tablet 4704b4291e4e4f55b52ab9b4f320cdd1 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:00.058696 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4704b4291e4e4f55b52ab9b4f320cdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.060606 15384 tablet_service.cc:1511] Processing CreateTablet for tablet 75b4828ddf2540d09d52132a90f6eab8 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:00.062273 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b4828ddf2540d09d52132a90f6eab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.064204 15386 tablet_service.cc:1511] Processing CreateTablet for tablet fb38871cb7e64014ab35675866da5d00 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:00.065915 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb38871cb7e64014ab35675866da5d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.068677 15382 tablet_service.cc:1511] Processing CreateTablet for tablet ddcebdbec2a040109381c8b202176c16 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:00.069931 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcebdbec2a040109381c8b202176c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.070677 15461 tablet_service.cc:1511] Processing CreateTablet for tablet fc72a67c919b42f298db58367f7a98e0 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:00.071982 15461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc72a67c919b42f298db58367f7a98e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.073225 15381 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5bf10954ca4f95a7cffc37abe76678 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:00.074488 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5bf10954ca4f95a7cffc37abe76678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.081398 15380 tablet_service.cc:1511] Processing CreateTablet for tablet 4a101ab1a44840e79bb351a259f61d50 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:00.082671 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a101ab1a44840e79bb351a259f61d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.084272 15513 tablet_bootstrap.cc:492] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.086201 15460 tablet_service.cc:1511] Processing CreateTablet for tablet fb38871cb7e64014ab35675866da5d00 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:00.090009 15459 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0ea1018b52415d9e6bbf6ecd4f2ff9 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:00.091926 15460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb38871cb7e64014ab35675866da5d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.092541 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0ea1018b52415d9e6bbf6ecd4f2ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.094748 15458 tablet_service.cc:1511] Processing CreateTablet for tablet 75b4828ddf2540d09d52132a90f6eab8 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:00.097146 15457 tablet_service.cc:1511] Processing CreateTablet for tablet 4704b4291e4e4f55b52ab9b4f320cdd1 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:00.097653 15456 tablet_service.cc:1511] Processing CreateTablet for tablet ddcebdbec2a040109381c8b202176c16 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:00.100168 15455 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5bf10954ca4f95a7cffc37abe76678 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:00.102723 15454 tablet_service.cc:1511] Processing CreateTablet for tablet 4a101ab1a44840e79bb351a259f61d50 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:00.104826 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b4828ddf2540d09d52132a90f6eab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.109365 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcebdbec2a040109381c8b202176c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.109434 15312 tablet_service.cc:1511] Processing CreateTablet for tablet c7a03bac8ba048488d03d5b6ab45ccfd (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:00.110064 15457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4704b4291e4e4f55b52ab9b4f320cdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.111223 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a03bac8ba048488d03d5b6ab45ccfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.113461 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5bf10954ca4f95a7cffc37abe76678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.117450 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a101ab1a44840e79bb351a259f61d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.123298 15311 tablet_service.cc:1511] Processing CreateTablet for tablet fc72a67c919b42f298db58367f7a98e0 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:00.125003 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc72a67c919b42f298db58367f7a98e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.128530 15513 tablet_bootstrap.cc:654] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.129281 15388 tablet_service.cc:1511] Processing CreateTablet for tablet a3e596a233bb421cb662379ff758488c (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:00.130467 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e596a233bb421cb662379ff758488c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.135979 15310 tablet_service.cc:1511] Processing CreateTablet for tablet fb38871cb7e64014ab35675866da5d00 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:00.137252 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb38871cb7e64014ab35675866da5d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.141288 15309 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0ea1018b52415d9e6bbf6ecd4f2ff9 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:00.142352 15453 tablet_service.cc:1511] Processing CreateTablet for tablet a3e596a233bb421cb662379ff758488c (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:00.142926 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0ea1018b52415d9e6bbf6ecd4f2ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.143538 15453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e596a233bb421cb662379ff758488c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.146570 15308 tablet_service.cc:1511] Processing CreateTablet for tablet 75b4828ddf2540d09d52132a90f6eab8 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:00.150333 15307 tablet_service.cc:1511] Processing CreateTablet for tablet 4704b4291e4e4f55b52ab9b4f320cdd1 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:00.154690 15305 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5bf10954ca4f95a7cffc37abe76678 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:00.158051 15303 tablet_service.cc:1511] Processing CreateTablet for tablet a3e596a233bb421cb662379ff758488c (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:00.160391 15304 tablet_service.cc:1511] Processing CreateTablet for tablet 4a101ab1a44840e79bb351a259f61d50 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:00.163440 15306 tablet_service.cc:1511] Processing CreateTablet for tablet ddcebdbec2a040109381c8b202176c16 (DEFAULT_TABLE table=test-workload [id=ab03c8034e9a453d8c9acc18bcd02a3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:00.165011 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b4828ddf2540d09d52132a90f6eab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.165670 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcebdbec2a040109381c8b202176c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.166785 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e596a233bb421cb662379ff758488c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.185626 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5bf10954ca4f95a7cffc37abe76678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.189463 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4704b4291e4e4f55b52ab9b4f320cdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.193533 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a101ab1a44840e79bb351a259f61d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:00.253166 15514 tablet_bootstrap.cc:492] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.255738 15513 tablet_bootstrap.cc:492] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.256238 15513 ts_tablet_manager.cc:1403] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.172s	user 0.011s	sys 0.006s
I20260709 12:23:00.258538 15513 raft_consensus.cc:359] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.259264 15513 raft_consensus.cc:385] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.259557 15513 raft_consensus.cc:740] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.259732 15514 tablet_bootstrap.cc:654] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.261540 15513 consensus_queue.cc:260] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.274889 15513 ts_tablet_manager.cc:1434] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:23:00.279706 15423 heartbeater.cc:499] Master 127.14.78.126:44131 was elected leader, sending a full tablet report...
I20260709 12:23:00.279857 15515 tablet_bootstrap.cc:492] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.283042 15513 tablet_bootstrap.cc:492] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.285020 15514 tablet_bootstrap.cc:492] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.286718 15514 ts_tablet_manager.cc:1403] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.006s
I20260709 12:23:00.289467 15514 raft_consensus.cc:359] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.290210 15514 raft_consensus.cc:385] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.290475 15514 raft_consensus.cc:740] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.291159 15514 consensus_queue.cc:260] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.297756 15513 tablet_bootstrap.cc:654] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.312045 15497 heartbeater.cc:499] Master 127.14.78.126:44131 was elected leader, sending a full tablet report...
I20260709 12:23:00.312388 15514 ts_tablet_manager.cc:1434] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:23:00.313340 15514 tablet_bootstrap.cc:492] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.313745 15513 tablet_bootstrap.cc:492] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.314203 15513 ts_tablet_manager.cc:1403] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.012s
I20260709 12:23:00.314308 15515 tablet_bootstrap.cc:654] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.317106 15513 raft_consensus.cc:359] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.317857 15513 raft_consensus.cc:385] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.318159 15513 raft_consensus.cc:740] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.318849 15513 consensus_queue.cc:260] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.319453 15514 tablet_bootstrap.cc:654] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.320948 15513 ts_tablet_manager.cc:1434] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:00.321941 15513 tablet_bootstrap.cc:492] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.328779 15513 tablet_bootstrap.cc:654] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.329089 15514 tablet_bootstrap.cc:492] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.329556 15514 ts_tablet_manager.cc:1403] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:23:00.332669 15514 raft_consensus.cc:359] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.333616 15514 raft_consensus.cc:385] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.333978 15514 raft_consensus.cc:740] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.335064 15514 consensus_queue.cc:260] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.332767 15515 tablet_bootstrap.cc:492] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.336483 15515 ts_tablet_manager.cc:1403] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.004s
I20260709 12:23:00.337360 15514 ts_tablet_manager.cc:1434] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:00.338191 15513 tablet_bootstrap.cc:492] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.338240 15514 tablet_bootstrap.cc:492] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.338708 15513 ts_tablet_manager.cc:1403] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
W20260709 12:23:00.341159 15424 tablet.cc:2406] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:00.341420 15513 raft_consensus.cc:359] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.342058 15513 raft_consensus.cc:385] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.341996 15515 raft_consensus.cc:359] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.342448 15513 raft_consensus.cc:740] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.342808 15515 raft_consensus.cc:385] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.343647 15515 raft_consensus.cc:740] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.343255 15513 consensus_queue.cc:260] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.345781 15513 ts_tablet_manager.cc:1434] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:23:00.346199 15514 tablet_bootstrap.cc:654] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.346702 15513 tablet_bootstrap.cc:492] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.350327 15515 consensus_queue.cc:260] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.351323 15514 tablet_bootstrap.cc:492] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.351748 15514 ts_tablet_manager.cc:1403] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:23:00.353073 15513 tablet_bootstrap.cc:654] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.354442 15514 raft_consensus.cc:359] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.355135 15514 raft_consensus.cc:385] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.355683 15514 raft_consensus.cc:740] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.356640 15514 consensus_queue.cc:260] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.358124 15347 heartbeater.cc:499] Master 127.14.78.126:44131 was elected leader, sending a full tablet report...
I20260709 12:23:00.358610 15515 ts_tablet_manager.cc:1434] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:23:00.359449 15515 tablet_bootstrap.cc:492] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.362775 15514 ts_tablet_manager.cc:1434] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:00.363960 15514 tablet_bootstrap.cc:492] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.372129 15514 tablet_bootstrap.cc:654] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.375082 15515 tablet_bootstrap.cc:654] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.378232 15513 tablet_bootstrap.cc:492] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.378814 15513 ts_tablet_manager.cc:1403] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.012s
I20260709 12:23:00.382186 15513 raft_consensus.cc:359] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.382879 15513 raft_consensus.cc:385] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.383172 15513 raft_consensus.cc:740] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.383816 15514 tablet_bootstrap.cc:492] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.384253 15514 ts_tablet_manager.cc:1403] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 12:23:00.383960 15513 consensus_queue.cc:260] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.387090 15514 raft_consensus.cc:359] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.387771 15514 raft_consensus.cc:385] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.388077 15514 raft_consensus.cc:740] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.388350 15513 ts_tablet_manager.cc:1434] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:00.389247 15513 tablet_bootstrap.cc:492] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.388926 15514 consensus_queue.cc:260] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.394284 15514 ts_tablet_manager.cc:1434] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:23:00.395259 15514 tablet_bootstrap.cc:492] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.397209 15513 tablet_bootstrap.cc:654] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.402396 15514 tablet_bootstrap.cc:654] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.410936 15513 tablet_bootstrap.cc:492] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.411580 15513 ts_tablet_manager.cc:1403] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.013s
I20260709 12:23:00.415457 15513 raft_consensus.cc:359] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.416473 15513 raft_consensus.cc:385] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.416877 15513 raft_consensus.cc:740] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.419064 15513 consensus_queue.cc:260] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.419735 15515 tablet_bootstrap.cc:492] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.420204 15515 ts_tablet_manager.cc:1403] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.013s
I20260709 12:23:00.420261 15517 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.421186 15513 ts_tablet_manager.cc:1434] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:00.420825 15517 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.423605 15517 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.423728 15514 tablet_bootstrap.cc:492] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.424242 15514 ts_tablet_manager.cc:1403] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.015s
I20260709 12:23:00.423805 15515 raft_consensus.cc:359] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.426862 15514 raft_consensus.cc:359] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.427477 15514 raft_consensus.cc:385] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.427739 15514 raft_consensus.cc:740] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.424788 15515 raft_consensus.cc:385] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.429000 15515 raft_consensus.cc:740] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.429170 15513 tablet_bootstrap.cc:492] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.429781 15515 consensus_queue.cc:260] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.434211 15515 ts_tablet_manager.cc:1434] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:23:00.435111 15515 tablet_bootstrap.cc:492] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.436661 15513 tablet_bootstrap.cc:654] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.428414 15514 consensus_queue.cc:260] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.443794 15514 ts_tablet_manager.cc:1434] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:23:00.447557 15514 tablet_bootstrap.cc:492] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.447659 15515 tablet_bootstrap.cc:654] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.450685 15513 tablet_bootstrap.cc:492] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.451241 15513 ts_tablet_manager.cc:1403] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 12:23:00.454236 15513 raft_consensus.cc:359] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.455004 15513 raft_consensus.cc:385] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.455299 15513 raft_consensus.cc:740] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.456163 15513 consensus_queue.cc:260] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.458297 15513 ts_tablet_manager.cc:1434] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:00.459291 15513 tablet_bootstrap.cc:492] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.466576 15513 tablet_bootstrap.cc:654] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.470947 15517 raft_consensus.cc:493] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.471567 15517 raft_consensus.cc:515] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.492940 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
W20260709 12:23:00.496115 15362 leader_election.cc:343] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.497103 15531 raft_consensus.cc:493] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.499491 15531 raft_consensus.cc:515] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.498775 15517 leader_election.cc:290] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.499118 15515 tablet_bootstrap.cc:492] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.500382 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:00.500656 15515 ts_tablet_manager.cc:1403] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.019s
I20260709 12:23:00.502297 15525 raft_consensus.cc:493] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.503096 15513 tablet_bootstrap.cc:492] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.502743 15525 raft_consensus.cc:515] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.503567 15513 ts_tablet_manager.cc:1403] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.023s
I20260709 12:23:00.504887 15531 leader_election.cc:290] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.503587 15515 raft_consensus.cc:359] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.506039 15515 raft_consensus.cc:385] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.506328 15515 raft_consensus.cc:740] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.506573 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:00.507210 15322 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
I20260709 12:23:00.507028 15515 consensus_queue.cc:260] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
W20260709 12:23:00.508705 15362 leader_election.cc:343] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.509429 15362 leader_election.cc:304] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.510114 15515 ts_tablet_manager.cc:1434] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:23:00.511018 15515 tablet_bootstrap.cc:492] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.511075 15531 raft_consensus.cc:2804] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.511469 15531 raft_consensus.cc:493] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.511792 15531 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.512802 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.515589 15513 raft_consensus.cc:359] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.516314 15513 raft_consensus.cc:385] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.516604 15513 raft_consensus.cc:740] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.517935 15515 tablet_bootstrap.cc:654] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.517969 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.519042 15531 raft_consensus.cc:515] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.520437 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.521217 15531 leader_election.cc:290] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.521181 15472 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
I20260709 12:23:00.523198 15513 consensus_queue.cc:260] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.523572 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:00.524296 15322 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.524438 15515 tablet_bootstrap.cc:492] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.524979 15515 ts_tablet_manager.cc:1403] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:23:00.525926 15513 ts_tablet_manager.cc:1434] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:23:00.526846 15513 tablet_bootstrap.cc:492] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.527707 15515 raft_consensus.cc:359] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.528388 15515 raft_consensus.cc:385] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.528654 15515 raft_consensus.cc:740] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.529310 15515 consensus_queue.cc:260] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.531036 15322 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
I20260709 12:23:00.531720 15515 ts_tablet_manager.cc:1434] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:00.532653 15515 tablet_bootstrap.cc:492] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.532931 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:00.533607 15472 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.533941 15525 leader_election.cc:290] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.533205 15513 tablet_bootstrap.cc:654] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.540016 15515 tablet_bootstrap.cc:654] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.540336 15472 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
W20260709 12:23:00.541204 15362 leader_election.cc:343] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.541639 15362 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b; no voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.542344 15531 raft_consensus.cc:2749] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:00.543399 15362 leader_election.cc:343] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.543816 15362 leader_election.cc:304] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b; no voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.544507 15531 raft_consensus.cc:2749] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:00.546046 15362 leader_election.cc:304] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:00.546736 15531 raft_consensus.cc:2804] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.547199 15531 raft_consensus.cc:697] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:00.547991 15531 consensus_queue.cc:237] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.554093 15514 tablet_bootstrap.cc:654] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.555053 15513 tablet_bootstrap.cc:492] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.555557 15513 ts_tablet_manager.cc:1403] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.004s
I20260709 12:23:00.557190 15515 tablet_bootstrap.cc:492] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.556488 15218 catalog_manager.cc:5697] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.557744 15515 ts_tablet_manager.cc:1403] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 12:23:00.558377 15513 raft_consensus.cc:359] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.559080 15513 raft_consensus.cc:385] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.559386 15513 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.560089 15513 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.561269 15515 raft_consensus.cc:359] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.562142 15515 raft_consensus.cc:385] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.562484 15515 raft_consensus.cc:740] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.562793 15513 ts_tablet_manager.cc:1434] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:00.564083 15513 tablet_bootstrap.cc:492] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.565318 15515 consensus_queue.cc:260] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.571468 15513 tablet_bootstrap.cc:654] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.572333 15515 ts_tablet_manager.cc:1434] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:00.573318 15515 tablet_bootstrap.cc:492] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.573717 15514 tablet_bootstrap.cc:492] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.574165 15514 ts_tablet_manager.cc:1403] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.127s	user 0.006s	sys 0.005s
I20260709 12:23:00.576484 15531 raft_consensus.cc:493] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.576934 15531 raft_consensus.cc:515] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.578948 15531 leader_election.cc:290] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753), cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411)
I20260709 12:23:00.586027 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:00.586810 15322 raft_consensus.cc:2468] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
W20260709 12:23:00.587306 15267 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:00.584730 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.588244 15472 raft_consensus.cc:2468] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
I20260709 12:23:00.585542 15514 raft_consensus.cc:359] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.589895 15514 raft_consensus.cc:385] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.590278 15514 raft_consensus.cc:740] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.590456 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:00.593401 15362 leader_election.cc:304] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.593995 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.594723 15472 raft_consensus.cc:2393] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cda1d403407e4eadb7ec367da8ff99fc in current term 1: Already voted for candidate 1e1ce3c9edc84272ba7460df5382734b in this term.
I20260709 12:23:00.594977 15514 consensus_queue.cc:260] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.594724 15515 tablet_bootstrap.cc:654] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.595415 15531 raft_consensus.cc:2804] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.596662 15531 raft_consensus.cc:493] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.597059 15531 raft_consensus.cc:3060] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.600477 15514 ts_tablet_manager.cc:1434] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 12:23:00.596097 15287 leader_election.cc:304] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cda1d403407e4eadb7ec367da8ff99fc; no voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:00.601457 15514 tablet_bootstrap.cc:492] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.601423 15525 raft_consensus.cc:2749] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:00.605269 15531 raft_consensus.cc:515] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.607837 15514 tablet_bootstrap.cc:654] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.607924 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:00.608461 15472 raft_consensus.cc:3060] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.611910 15513 tablet_bootstrap.cc:492] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.612546 15513 ts_tablet_manager.cc:1403] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.009s
I20260709 12:23:00.615928 15513 raft_consensus.cc:359] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.616519 15472 raft_consensus.cc:2468] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
I20260709 12:23:00.616830 15513 raft_consensus.cc:385] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.618980 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:00.620409 15322 raft_consensus.cc:3060] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.620894 15362 leader_election.cc:304] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:00.621968 15517 raft_consensus.cc:2804] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.619513 15531 leader_election.cc:290] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Requested vote from peers cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753), cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411)
I20260709 12:23:00.629637 15531 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.630262 15531 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.633481 15322 raft_consensus.cc:2468] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
I20260709 12:23:00.634038 15513 raft_consensus.cc:740] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.633942 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:00.637133 15531 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.636713 15513 consensus_queue.cc:260] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
W20260709 12:23:00.637748 15362 leader_election.cc:343] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.638371 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
W20260709 12:23:00.639611 15362 leader_election.cc:343] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.640051 15362 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b; no voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.640882 15513 ts_tablet_manager.cc:1434] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:23:00.642549 15513 tablet_bootstrap.cc:492] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: Bootstrap starting.
I20260709 12:23:00.641335 15531 raft_consensus.cc:2749] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:00.643705 15517 raft_consensus.cc:697] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:00.647714 15517 consensus_queue.cc:237] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:00.648631 15514 tablet_bootstrap.cc:492] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.649106 15514 ts_tablet_manager.cc:1403] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 12:23:00.649726 15513 tablet_bootstrap.cc:654] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.651476 15515 tablet_bootstrap.cc:492] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.651937 15514 raft_consensus.cc:359] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.652830 15514 raft_consensus.cc:385] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.653267 15514 raft_consensus.cc:740] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.651954 15515 ts_tablet_manager.cc:1403] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.035s
I20260709 12:23:00.654474 15513 tablet_bootstrap.cc:492] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: No bootstrap required, opened a new log
I20260709 12:23:00.654186 15514 consensus_queue.cc:260] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.655007 15513 ts_tablet_manager.cc:1403] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:23:00.656860 15514 ts_tablet_manager.cc:1434] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:00.656564 15515 raft_consensus.cc:359] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.657274 15515 raft_consensus.cc:385] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.657536 15515 raft_consensus.cc:740] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.657949 15553 raft_consensus.cc:493] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.657642 15513 raft_consensus.cc:359] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.658360 15513 raft_consensus.cc:385] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.658258 15515 consensus_queue.cc:260] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.658812 15513 raft_consensus.cc:740] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.658380 15553 raft_consensus.cc:515] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.660774 15553 leader_election.cc:290] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.661535 15513 consensus_queue.cc:260] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.662611 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:00.663499 15513 ts_tablet_manager.cc:1434] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
W20260709 12:23:00.663928 15362 leader_election.cc:343] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.665674 15514 tablet_bootstrap.cc:492] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.665515 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.666249 15472 raft_consensus.cc:2468] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
I20260709 12:23:00.665675 15515 ts_tablet_manager.cc:1434] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:00.667500 15515 tablet_bootstrap.cc:492] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.667502 15362 leader_election.cc:304] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.668856 15531 raft_consensus.cc:2804] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.669231 15531 raft_consensus.cc:493] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.669565 15531 raft_consensus.cc:3060] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.671638 15514 tablet_bootstrap.cc:654] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.677270 15515 tablet_bootstrap.cc:654] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.678931 15553 raft_consensus.cc:493] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.679427 15553 raft_consensus.cc:515] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.682919 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a101ab1a44840e79bb351a259f61d50" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
W20260709 12:23:00.684267 15362 leader_election.cc:343] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.686774 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a101ab1a44840e79bb351a259f61d50" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.687511 15472 raft_consensus.cc:2468] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
I20260709 12:23:00.689128 15362 leader_election.cc:304] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.690197 15517 raft_consensus.cc:2804] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.690651 15517 raft_consensus.cc:493] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.691075 15517 raft_consensus.cc:3060] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.693089 15519 raft_consensus.cc:493] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.693688 15519 raft_consensus.cc:515] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.697192 15525 raft_consensus.cc:493] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.697832 15525 raft_consensus.cc:515] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.697331 15553 leader_election.cc:290] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.702329 15525 leader_election.cc:290] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.702855 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:00.703464 15398 raft_consensus.cc:2468] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 0.
I20260709 12:23:00.704751 15288 leader_election.cc:304] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.705616 15525 raft_consensus.cc:2804] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.704924 15519 leader_election.cc:290] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:00.706069 15525 raft_consensus.cc:493] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.706575 15525 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.689743 15218 catalog_manager.cc:5697] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.712213 15531 raft_consensus.cc:515] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.705476 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.714871 15525 raft_consensus.cc:515] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.713984 15517 raft_consensus.cc:515] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.717984 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:00.718542 15398 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.719892 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
W20260709 12:23:00.720568 15287 leader_election.cc:343] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:00.721309 15362 leader_election.cc:343] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.724237 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a101ab1a44840e79bb351a259f61d50" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:00.725256 15398 raft_consensus.cc:2468] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 1.
W20260709 12:23:00.725672 15362 leader_election.cc:343] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.726356 15288 leader_election.cc:304] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.727325 15539 raft_consensus.cc:2804] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.728091 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:00.728865 15472 raft_consensus.cc:3060] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.731782 15525 leader_election.cc:290] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.731873 15471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
W20260709 12:23:00.733575 15287 leader_election.cc:343] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.737141 15531 leader_election.cc:290] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.739696 15471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a101ab1a44840e79bb351a259f61d50" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:00.740398 15471 raft_consensus.cc:3060] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.743273 15539 raft_consensus.cc:697] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:00.744480 15539 consensus_queue.cc:237] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.761636 15471 raft_consensus.cc:2468] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
I20260709 12:23:00.764051 15362 leader_election.cc:304] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.765259 15531 raft_consensus.cc:2804] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.765592 15217 catalog_manager.cc:5697] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 0 to 1, leader changed from <none> to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 1 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.768493 15517 leader_election.cc:290] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.774878 15531 raft_consensus.cc:697] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:00.776079 15531 consensus_queue.cc:237] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.736990 15472 raft_consensus.cc:2468] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
I20260709 12:23:00.781395 15362 leader_election.cc:304] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.782891 15517 raft_consensus.cc:2804] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.784351 15517 raft_consensus.cc:697] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:00.784932 15539 raft_consensus.cc:493] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.785578 15539 raft_consensus.cc:515] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.785583 15517 consensus_queue.cc:237] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.789007 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:00.789636 15398 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 0.
I20260709 12:23:00.789595 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.790289 15472 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 0.
I20260709 12:23:00.789014 15539 leader_election.cc:290] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.790812 15288 leader_election.cc:304] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.791651 15539 raft_consensus.cc:2804] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.792027 15539 raft_consensus.cc:493] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.792347 15539 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.798909 15514 tablet_bootstrap.cc:492] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.799456 15514 ts_tablet_manager.cc:1403] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.087s
I20260709 12:23:00.799381 15539 raft_consensus.cc:515] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.799682 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:00.800283 15321 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 0.
I20260709 12:23:00.801447 15437 leader_election.cc:304] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.802012 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:00.802484 15519 raft_consensus.cc:2804] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.802525 15398 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.802946 15519 raft_consensus.cc:493] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.802814 15514 raft_consensus.cc:359] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.803387 15519 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.803751 15514 raft_consensus.cc:385] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.804144 15514 raft_consensus.cc:740] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.804991 15514 consensus_queue.cc:260] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.809357 15398 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 1.
I20260709 12:23:00.810420 15288 leader_election.cc:304] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.810609 15519 raft_consensus.cc:515] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.811353 15560 raft_consensus.cc:2804] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.811826 15560 raft_consensus.cc:697] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:00.812688 15560 consensus_queue.cc:237] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.813254 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:00.813796 15321 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.819829 15539 leader_election.cc:290] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.820369 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:00.821108 15472 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.823812 15519 leader_election.cc:290] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:00.820976 15321 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 1.
I20260709 12:23:00.828404 15437 leader_election.cc:304] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.829828 15472 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 1.
I20260709 12:23:00.830279 15563 raft_consensus.cc:2804] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.830783 15563 raft_consensus.cc:697] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:00.831866 15514 ts_tablet_manager.cc:1434] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.032s	user 0.017s	sys 0.005s
I20260709 12:23:00.831036 15217 catalog_manager.cc:5697] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 0 to 1, leader changed from <none> to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 1 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.831624 15563 consensus_queue.cc:237] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.834609 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:00.835202 15398 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 0.
I20260709 12:23:00.836627 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:00.837291 15397 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.841171 15514 tablet_bootstrap.cc:492] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.847078 15514 tablet_bootstrap.cc:654] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.850215 15397 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 1.
I20260709 12:23:00.850875 15215 catalog_manager.cc:5697] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 0 to 1, leader changed from <none> to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.854676 15531 raft_consensus.cc:493] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.855186 15531 raft_consensus.cc:515] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.856105 15515 tablet_bootstrap.cc:492] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.856588 15515 ts_tablet_manager.cc:1403] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.189s	user 0.044s	sys 0.075s
I20260709 12:23:00.858461 15531 leader_election.cc:290] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.858673 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.859300 15472 raft_consensus.cc:2468] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 0.
I20260709 12:23:00.852593 15218 catalog_manager.cc:5697] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.859579 15515 raft_consensus.cc:359] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.860319 15515 raft_consensus.cc:385] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.860472 15362 leader_election.cc:304] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:00.860680 15515 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.861348 15531 raft_consensus.cc:2804] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.861790 15531 raft_consensus.cc:493] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.861429 15515 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.862188 15531 raft_consensus.cc:3060] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.863619 15515 ts_tablet_manager.cc:1434] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:00.864506 15515 tablet_bootstrap.cc:492] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.869305 15531 raft_consensus.cc:515] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.871381 15515 tablet_bootstrap.cc:654] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.872903 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:00.873528 15472 raft_consensus.cc:3060] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.876766 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
W20260709 12:23:00.877969 15362 leader_election.cc:343] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.882329 15472 raft_consensus.cc:2468] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 1.
I20260709 12:23:00.883481 15362 leader_election.cc:304] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:00.884358 15517 raft_consensus.cc:2804] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.884801 15517 raft_consensus.cc:697] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:00.885613 15517 consensus_queue.cc:237] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.886490 15215 catalog_manager.cc:5697] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.890947 15531 leader_election.cc:290] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.892529 15560 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.892963 15560 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.894927 15560 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.896425 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:00.896996 15397 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 0.
I20260709 12:23:00.898980 15288 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.899793 15560 raft_consensus.cc:2804] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:00.900190 15560 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.900563 15560 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.902279 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:00.894825 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
W20260709 12:23:00.903549 15287 leader_election.cc:343] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.903702 15514 tablet_bootstrap.cc:492] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.904320 15514 ts_tablet_manager.cc:1403] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.022s
W20260709 12:23:00.904755 15362 leader_election.cc:343] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.907830 15514 raft_consensus.cc:359] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.908757 15514 raft_consensus.cc:385] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.909173 15514 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.910218 15514 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.910820 15560 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.913695 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:00.914222 15397 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:00.913566 15215 catalog_manager.cc:5697] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.920583 15397 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 1.
I20260709 12:23:00.921757 15288 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:00.922713 15539 raft_consensus.cc:2804] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:00.923158 15539 raft_consensus.cc:697] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:00.923767 15514 ts_tablet_manager.cc:1434] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:00.923897 15539 consensus_queue.cc:237] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.928192 15514 tablet_bootstrap.cc:492] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: Bootstrap starting.
I20260709 12:23:00.928764 15515 tablet_bootstrap.cc:492] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.929188 15515 ts_tablet_manager.cc:1403] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.065s	user 0.036s	sys 0.026s
I20260709 12:23:00.930985 15560 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:00.931738 15515 raft_consensus.cc:359] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.932160 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
W20260709 12:23:00.933841 15287 leader_election.cc:343] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:00.932472 15515 raft_consensus.cc:385] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.934743 15515 raft_consensus.cc:740] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.935807 15514 tablet_bootstrap.cc:654] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.935624 15515 consensus_queue.cc:260] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.937538 15515 ts_tablet_manager.cc:1434] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:23:00.938347 15515 tablet_bootstrap.cc:492] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.938319 15215 catalog_manager.cc:5697] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 0 to 1, leader changed from <none> to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 1 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.940380 15514 tablet_bootstrap.cc:492] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: No bootstrap required, opened a new log
I20260709 12:23:00.940770 15514 ts_tablet_manager.cc:1403] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 12:23:00.943179 15514 raft_consensus.cc:359] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.943717 15515 tablet_bootstrap.cc:654] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.943766 15514 raft_consensus.cc:385] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.944199 15514 raft_consensus.cc:740] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.944909 15514 consensus_queue.cc:260] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.947172 15514 ts_tablet_manager.cc:1434] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:00.950188 15515 tablet_bootstrap.cc:492] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.950551 15515 ts_tablet_manager.cc:1403] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:23:00.952685 15515 raft_consensus.cc:359] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.953331 15515 raft_consensus.cc:385] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.953595 15515 raft_consensus.cc:740] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.954224 15515 consensus_queue.cc:260] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.955906 15515 ts_tablet_manager.cc:1434] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:00.956703 15515 tablet_bootstrap.cc:492] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc: Bootstrap starting.
I20260709 12:23:00.960791 15515 tablet_bootstrap.cc:654] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:00.964723 15515 tablet_bootstrap.cc:492] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc: No bootstrap required, opened a new log
I20260709 12:23:00.965157 15515 ts_tablet_manager.cc:1403] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:00.966854 15515 raft_consensus.cc:359] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.967315 15515 raft_consensus.cc:385] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:00.967533 15515 raft_consensus.cc:740] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Initialized, Role: FOLLOWER
I20260709 12:23:00.968026 15515 consensus_queue.cc:260] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:00.969339 15515 ts_tablet_manager.cc:1434] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:01.002709 15517 consensus_queue.cc:1048] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.013510 15553 consensus_queue.cc:1048] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.020481 15539 raft_consensus.cc:493] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.020869 15539 raft_consensus.cc:515] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.022969 15539 leader_election.cc:290] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.023556 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:01.023950 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:01.024698 15472 raft_consensus.cc:2393] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cda1d403407e4eadb7ec367da8ff99fc in current term 1: Already voted for candidate 1e1ce3c9edc84272ba7460df5382734b in this term.
I20260709 12:23:01.025823 15287 leader_election.cc:304] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cda1d403407e4eadb7ec367da8ff99fc; no voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:01.026542 15539 raft_consensus.cc:3060] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.032569 15539 raft_consensus.cc:2749] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.033174 15560 raft_consensus.cc:493] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.033526 15560 raft_consensus.cc:515] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.035111 15560 leader_election.cc:290] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.035750 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a101ab1a44840e79bb351a259f61d50" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:01.036013 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a101ab1a44840e79bb351a259f61d50" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:01.036731 15472 raft_consensus.cc:2393] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cda1d403407e4eadb7ec367da8ff99fc in current term 1: Already voted for candidate 1e1ce3c9edc84272ba7460df5382734b in this term.
I20260709 12:23:01.037672 15287 leader_election.cc:304] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cda1d403407e4eadb7ec367da8ff99fc; no voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:01.038293 15560 raft_consensus.cc:3060] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.041213 15563 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.041658 15563 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.043265 15560 raft_consensus.cc:2749] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.043710 15563 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:01.045086 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:01.045137 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:01.045686 15321 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 0.
I20260709 12:23:01.045735 15397 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 0.
I20260709 12:23:01.046581 15437 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:01.047250 15563 raft_consensus.cc:2804] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:01.047529 15563 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.047802 15563 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.052014 15563 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.053550 15563 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:01.054275 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:01.054549 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:01.054858 15321 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.055104 15397 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.061233 15397 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 1.
I20260709 12:23:01.061233 15321 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 1.
I20260709 12:23:01.062410 15437 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:01.063066 15563 raft_consensus.cc:2804] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:01.063469 15563 raft_consensus.cc:697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:01.064049 15563 consensus_queue.cc:237] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.071262 15217 catalog_manager.cc:5697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 0 to 1, leader changed from <none> to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.107230 15397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:57002
I20260709 12:23:01.107784 15397 raft_consensus.cc:606] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:01.112524 15397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:57002
I20260709 12:23:01.112982 15397 raft_consensus.cc:606] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:01.126783 15472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:36282
I20260709 12:23:01.127266 15472 raft_consensus.cc:606] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:01.131669 15472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:36282
I20260709 12:23:01.132121 15472 raft_consensus.cc:606] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:01.143404 15321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:60270
I20260709 12:23:01.143817 15321 raft_consensus.cc:606] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Received request to transfer leadership to TS 1e1ce3c9edc84272ba7460df5382734b
I20260709 12:23:01.146721 15563 raft_consensus.cc:493] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.147214 15563 raft_consensus.cc:515] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.149397 15563 leader_election.cc:290] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:01.149953 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:01.150586 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:01.151736 15397 raft_consensus.cc:2393] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc2c6c5959c84bf99fe2baaca661d73a in current term 1: Already voted for candidate cda1d403407e4eadb7ec367da8ff99fc in this term.
I20260709 12:23:01.152163 15321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:60270
I20260709 12:23:01.152752 15321 raft_consensus.cc:606] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Received request to transfer leadership to TS 1e1ce3c9edc84272ba7460df5382734b
I20260709 12:23:01.152842 15438 leader_election.cc:304] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a; no voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:01.154011 15563 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.159889 15563 raft_consensus.cc:2749] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.160276 15397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3e596a233bb421cb662379ff758488c"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
mode: GRACEFUL
new_leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:57002
I20260709 12:23:01.160840 15397 raft_consensus.cc:606] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Received request to transfer leadership to TS cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:01.205809 15560 raft_consensus.cc:493] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.206295 15560 raft_consensus.cc:515] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.208056 15560 leader_election.cc:290] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.208750 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:01.209306 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" is_pre_election: true
I20260709 12:23:01.210014 15472 raft_consensus.cc:2393] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cda1d403407e4eadb7ec367da8ff99fc in current term 1: Already voted for candidate 1e1ce3c9edc84272ba7460df5382734b in this term.
I20260709 12:23:01.210855 15287 leader_election.cc:304] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cda1d403407e4eadb7ec367da8ff99fc; no voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:01.211452 15560 raft_consensus.cc:3060] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.216842 15560 raft_consensus.cc:2749] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.219749 15553 consensus_queue.cc:1048] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.230301 15531 consensus_queue.cc:1048] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.246384 15560 consensus_queue.cc:1048] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.249476 15539 consensus_queue.cc:1048] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.257077 15560 raft_consensus.cc:993] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:01.257659 15560 raft_consensus.cc:1081] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Signalling peer 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:01.259725 15398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:23:01.259744 15531 consensus_queue.cc:1048] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.263300 15398 raft_consensus.cc:493] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.263725 15398 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.266487 15560 consensus_queue.cc:1048] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.275861 15531 consensus_queue.cc:1048] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.282642 15560 consensus_queue.cc:1048] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.289556 15398 raft_consensus.cc:515] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.296465 15539 raft_consensus.cc:993] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:01.296952 15539 raft_consensus.cc:1081] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Signalling peer 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:01.297119 15398 leader_election.cc:290] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 2 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.299389 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:01.299671 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:01.300037 15472 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.300267 15322 raft_consensus.cc:3055] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.300640 15322 raft_consensus.cc:740] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:01.301059 15398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:23:01.301841 15398 raft_consensus.cc:493] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.301549 15322 consensus_queue.cc:260] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.302275 15398 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.302590 15531 consensus_queue.cc:1048] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.302987 15322 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.308128 15472 raft_consensus.cc:2468] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 2.
I20260709 12:23:01.309370 15362 leader_election.cc:304] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:01.310206 15531 raft_consensus.cc:2804] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.310701 15531 raft_consensus.cc:697] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:01.310645 15398 raft_consensus.cc:515] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.311453 15552 consensus_queue.cc:1048] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.311602 15531 consensus_queue.cc:237] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.312575 15322 raft_consensus.cc:2468] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 2.
I20260709 12:23:01.312906 15398 leader_election.cc:290] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 2 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.315317 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:01.315954 15472 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.321636 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:01.322257 15322 raft_consensus.cc:3055] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.322608 15322 raft_consensus.cc:740] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:01.323583 15322 consensus_queue.cc:260] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.325727 15472 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 2.
I20260709 12:23:01.326732 15362 leader_election.cc:304] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:01.328562 15563 consensus_queue.cc:1048] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:01.327216 15218 catalog_manager.cc:5697] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 1 to 2, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.328068 15531 raft_consensus.cc:2804] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.331591 15531 raft_consensus.cc:697] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:01.324801 15322 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.333508 15531 consensus_queue.cc:237] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.344364 15517 raft_consensus.cc:993] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.344774 15517 raft_consensus.cc:1081] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.351361 15321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:23:01.352100 15321 raft_consensus.cc:493] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.352497 15321 raft_consensus.cc:3060] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.357367 15517 consensus_queue.cc:1048] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:01.366708 15552 consensus_queue.cc:1048] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:01.369606 15322 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 2.
I20260709 12:23:01.378438 15321 raft_consensus.cc:515] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:01.381165 15318 raft_consensus.cc:1240] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Rejecting Update request from peer 1e1ce3c9edc84272ba7460df5382734b for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:01.381335 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:01.382072 15519 raft_consensus.cc:993] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.382025 15398 raft_consensus.cc:3055] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.382778 15398 raft_consensus.cc:740] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:01.383484 15519 raft_consensus.cc:1081] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.384057 15398 consensus_queue.cc:260] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:01.388809 15321 leader_election.cc:290] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.386960 15398 raft_consensus.cc:3060] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.389727 15563 consensus_queue.cc:1048] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:01.393939 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60260
I20260709 12:23:01.397769 15322 raft_consensus.cc:493] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.398147 15322 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.401988 15563 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.403632 15563 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.406128 15398 raft_consensus.cc:2468] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.407346 15563 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:01.408269 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc" is_pre_election: true
I20260709 12:23:01.409996 15288 leader_election.cc:304] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:01.410657 15560 raft_consensus.cc:2804] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.411118 15560 raft_consensus.cc:697] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:01.412334 15560 consensus_queue.cc:237] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } }
I20260709 12:23:01.415735 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1ce3c9edc84272ba7460df5382734b" is_pre_election: true
I20260709 12:23:01.416466 15398 raft_consensus.cc:2393] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc2c6c5959c84bf99fe2baaca661d73a in current term 1: Already voted for candidate cda1d403407e4eadb7ec367da8ff99fc in this term.
I20260709 12:23:01.416116 15322 raft_consensus.cc:515] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.417611 15438 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a; no voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:01.415339 15218 catalog_manager.cc:5697] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 1 to 2, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.419543 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:01.421694 15563 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:01.433529 15471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a03bac8ba048488d03d5b6ab45ccfd" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:01.434000 15471 raft_consensus.cc:3060] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.434238 15563 raft_consensus.cc:2749] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:01.438241 15322 leader_election.cc:290] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.439610 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:01.440331 15470 raft_consensus.cc:3055] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.440732 15470 raft_consensus.cc:740] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:01.439304 15215 catalog_manager.cc:5697] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 1 to 2, leader changed from 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.449245 15471 raft_consensus.cc:2468] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.441586 15470 consensus_queue.cc:260] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.454927 15470 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.460690 15563 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.466593 15470 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.468861 15287 leader_election.cc:304] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 1e1ce3c9edc84272ba7460df5382734b
I20260709 12:23:01.470468 15560 raft_consensus.cc:2804] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.470975 15560 raft_consensus.cc:697] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:01.471356 15596 raft_consensus.cc:993] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: : Instructing follower cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:01.471757 15517 raft_consensus.cc:1081] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Signalling peer cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:01.471771 15560 consensus_queue.cc:237] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.474282 15563 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.475517 15470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3e596a233bb421cb662379ff758488c"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:36264
I20260709 12:23:01.476286 15539 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.477063 15470 raft_consensus.cc:493] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.477425 15470 raft_consensus.cc:3060] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.484275 15218 catalog_manager.cc:5697] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 1 to 2, leader changed from cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.486907 15470 raft_consensus.cc:515] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.490832 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:01.491473 15317 raft_consensus.cc:3060] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.491474 15539 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:01.502964 15563 raft_consensus.cc:993] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.503419 15563 raft_consensus.cc:1081] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.505060 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60260
I20260709 12:23:01.505604 15322 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.505971 15322 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.503901 15317 raft_consensus.cc:2468] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 2.
I20260709 12:23:01.514856 15470 leader_election.cc:290] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 2 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:01.512634 15322 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.516742 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e596a233bb421cb662379ff758488c" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:01.517280 15322 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.517352 15396 raft_consensus.cc:3055] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.517797 15396 raft_consensus.cc:740] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:01.518586 15396 consensus_queue.cc:260] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.520035 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:01.520207 15437 leader_election.cc:304] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:01.520573 15398 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.521390 15601 raft_consensus.cc:2804] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.521723 15601 raft_consensus.cc:697] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:01.522267 15601 consensus_queue.cc:237] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.525346 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:01.525918 15472 raft_consensus.cc:3055] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.526214 15472 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:01.528558 15396 raft_consensus.cc:3060] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.530009 15552 raft_consensus.cc:993] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.530500 15552 raft_consensus.cc:1081] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:01.530046 15472 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.531826 15472 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.533339 15215 catalog_manager.cc:5697] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 1 to 2, leader changed from 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66) to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 2 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.535810 15396 raft_consensus.cc:2468] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 2.
I20260709 12:23:01.537884 15398 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.537959 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:23:01.539005 15322 raft_consensus.cc:493] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.538964 15288 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:01.539500 15322 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.539991 15539 raft_consensus.cc:2804] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.540482 15539 raft_consensus.cc:697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:01.541169 15539 consensus_queue.cc:237] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.545243 15472 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.545630 15322 raft_consensus.cc:515] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.547492 15322 leader_election.cc:290] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:01.548266 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:01.548491 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:01.548813 15398 raft_consensus.cc:3055] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.549036 15472 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.549225 15398 raft_consensus.cc:740] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:01.550051 15398 consensus_queue.cc:260] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.550912 15398 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.551473 15217 catalog_manager.cc:5697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 1 to 2, leader changed from cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.555102 15398 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.555243 15472 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:01.556062 15288 leader_election.cc:304] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:01.557004 15539 raft_consensus.cc:2804] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.557482 15539 raft_consensus.cc:697] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:01.558116 15539 consensus_queue.cc:237] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:01.563426 15217 catalog_manager.cc:5697] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 1 to 2, leader changed from 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.705338 15322 raft_consensus.cc:1275] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.706483 15552 consensus_queue.cc:1048] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.713698 15472 raft_consensus.cc:1275] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.714973 15596 consensus_queue.cc:1048] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.780033 15472 raft_consensus.cc:1275] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.781340 15552 consensus_queue.cc:1048] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.784354 15322 raft_consensus.cc:1275] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.785580 15552 consensus_queue.cc:1048] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.812266 15472 raft_consensus.cc:1275] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.813438 15539 consensus_queue.cc:1048] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:01.820322 15398 raft_consensus.cc:1275] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.821851 15590 consensus_queue.cc:1048] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.909457 15322 raft_consensus.cc:1275] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.910727 15398 raft_consensus.cc:1275] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.910732 15601 consensus_queue.cc:1048] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:01.912144 15601 consensus_queue.cc:1048] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.926088 15472 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.927456 15590 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.935046 15398 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.936506 15590 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:02.006814 15472 raft_consensus.cc:1275] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:02.007970 15590 consensus_queue.cc:1048] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:02.016677 15398 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:02.020694 15396 raft_consensus.cc:1275] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:02.022030 15539 consensus_queue.cc:1048] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:02.023705 15398 raft_consensus.cc:1275] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:02.024986 15539 consensus_queue.cc:1048] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:02.031040 15472 raft_consensus.cc:1275] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:02.032433 15539 consensus_queue.cc:1048] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.189419 14649 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:23:04.190066 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.211218 15322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:23:04.211727 15322 raft_consensus.cc:606] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Received request to transfer leadership to TS cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:04.213997 15322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:23:04.214455 15322 raft_consensus.cc:606] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Received request to transfer leadership to TS cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:04.215396 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:04.215829 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.561453 15613 raft_consensus.cc:993] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:04.561949 15560 raft_consensus.cc:1081] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Signalling peer cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:04.563241 15470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:36274
I20260709 12:23:04.563707 15470 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.563989 15470 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:04.568632 15470 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:04.570398 15470 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 3 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:04.571203 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:04.571528 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:04.571798 15322 raft_consensus.cc:3055] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:04.572176 15398 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:04.572158 15322 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:04.573119 15322 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:04.574270 15322 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:04.578866 15398 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 3.
I20260709 12:23:04.579999 15438 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:04.580636 15322 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 3.
I20260709 12:23:04.580737 15606 raft_consensus.cc:2804] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:04.581930 15606 raft_consensus.cc:697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:04.582645 15606 consensus_queue.cc:237] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:04.589762 15215 catalog_manager.cc:5697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 2 to 3, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:04.604219 15613 raft_consensus.cc:993] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:04.604691 15560 raft_consensus.cc:1081] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Signalling peer cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:04.606096 15470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:36274
I20260709 12:23:04.606547 15470 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:04.606846 15470 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.611248 15470 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:04.612687 15470 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 2 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:04.613533 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:04.613700 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:04.614123 15322 raft_consensus.cc:3055] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.614207 15398 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.614423 15322 raft_consensus.cc:740] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:04.615155 15322 consensus_queue.cc:260] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:04.616008 15322 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.618511 15398 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 2.
I20260709 12:23:04.619333 15438 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:04.620052 15606 raft_consensus.cc:2804] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:04.620433 15606 raft_consensus.cc:697] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:04.620918 15322 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 2.
I20260709 12:23:04.621150 15606 consensus_queue.cc:237] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:04.628312 15215 catalog_manager.cc:5697] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 1 to 2, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 2 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.017066 15322 raft_consensus.cc:1275] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.018119 15606 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.026850 15398 raft_consensus.cc:1275] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:05.028911 15623 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.041709 15398 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:05.042745 15623 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:05.050437 15322 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:05.052474 15606 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:05.216684 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.223011 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.223398 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.224238 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.229519 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:06.229928 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.231022 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.237159 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:07.237591 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:08.238641 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:08.243952 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:08.244364 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:09.330245 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.341132 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:09.341773 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:10.342761 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.348134 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:10.348541 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:10.357131 15419 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe6a0 after lost signal to thread 14652
W20260709 12:23:10.357872 15419 debug-util.cc:398] Leaking SignalData structure 0x7b08000fed80 after lost signal to thread 15254
W20260709 12:23:10.358613 15419 debug-util.cc:398] Leaking SignalData structure 0x7b0800172d80 after lost signal to thread 15346
W20260709 12:23:10.359334 15419 debug-util.cc:398] Leaking SignalData structure 0x7b080010f040 after lost signal to thread 15422
W20260709 12:23:10.359985 15419 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0ac0 after lost signal to thread 15496
I20260709 12:23:11.349589 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:11.358276 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:11.358860 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:12.359961 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:12.368427 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:12.368949 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:13.369913 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.376979 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:13.377430 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.407632 14649 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:23:14.416560 15470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:36282
I20260709 12:23:14.417222 15470 raft_consensus.cc:606] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:14.421474 15470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:36282
I20260709 12:23:14.421900 15470 raft_consensus.cc:606] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:14.428406 15398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:57002
I20260709 12:23:14.428836 15398 raft_consensus.cc:606] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:14.432899 15398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:57002
I20260709 12:23:14.433314 15398 raft_consensus.cc:606] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:14.437230 15398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
mode: GRACEFUL
new_leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:57002
I20260709 12:23:14.437644 15398 raft_consensus.cc:606] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Received request to transfer leadership to TS cda1d403407e4eadb7ec367da8ff99fc
I20260709 12:23:14.452286 15636 raft_consensus.cc:993] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.452754 15637 raft_consensus.cc:1081] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.454222 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:23:14.454631 15322 raft_consensus.cc:493] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.454921 15322 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.459998 15322 raft_consensus.cc:515] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.461604 15322 leader_election.cc:290] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 3 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:14.462361 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:14.462790 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5bf10954ca4f95a7cffc37abe76678" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:14.463173 15398 raft_consensus.cc:3055] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:14.463313 15470 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.463477 15398 raft_consensus.cc:740] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:14.464377 15398 consensus_queue.cc:260] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.465330 15398 raft_consensus.cc:3060] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.469103 15470 raft_consensus.cc:2468] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 3.
I20260709 12:23:14.470386 15287 leader_election.cc:304] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:14.471870 15634 raft_consensus.cc:2804] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:14.472077 15635 raft_consensus.cc:993] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.472533 15635 raft_consensus.cc:1081] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.473083 15636 raft_consensus.cc:993] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.473594 15637 raft_consensus.cc:1081] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.474042 15634 raft_consensus.cc:697] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:14.474828 15317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60260
I20260709 12:23:14.475093 15398 raft_consensus.cc:2468] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 3.
I20260709 12:23:14.475414 15317 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.474910 15634 consensus_queue.cc:237] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.475805 15317 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:14.476662 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:23:14.477185 15322 raft_consensus.cc:493] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.477504 15322 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.483767 15317 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.486088 15322 raft_consensus.cc:515] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.486855 15317 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 4 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:14.487021 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:14.487620 15470 raft_consensus.cc:3055] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:14.488209 15470 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:14.488873 15322 leader_election.cc:290] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 3 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:14.489110 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:14.488189 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:14.489488 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4704b4291e4e4f55b52ab9b4f320cdd1" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:14.489171 15470 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.489737 15396 raft_consensus.cc:3055] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:14.489902 15398 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:14.489979 15472 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.490114 15396 raft_consensus.cc:740] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:14.490271 15470 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:14.491061 15396 consensus_queue.cc:260] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.492096 15396 raft_consensus.cc:3060] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.496039 15470 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 4.
I20260709 12:23:14.496201 15398 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 4.
I20260709 12:23:14.496094 15472 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 3.
I20260709 12:23:14.497179 15287 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:14.498095 15287 leader_election.cc:304] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:14.498936 15396 raft_consensus.cc:2468] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 3.
I20260709 12:23:14.499251 15639 raft_consensus.cc:2804] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:14.499567 15634 raft_consensus.cc:2804] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:14.503742 15634 raft_consensus.cc:697] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:14.504423 15639 raft_consensus.cc:697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:14.503515 15215 catalog_manager.cc:5697] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 2 to 3, leader changed from 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 3 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.505546 15634 consensus_queue.cc:237] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.505663 15639 consensus_queue.cc:237] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.523043 15215 catalog_manager.cc:5697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 3 to 4, leader changed from cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 4 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.524045 15215 catalog_manager.cc:5697] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 2 to 3, leader changed from 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 3 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.575857 15636 raft_consensus.cc:993] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.576269 15637 raft_consensus.cc:1081] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.577515 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60250
I20260709 12:23:14.577960 15322 raft_consensus.cc:493] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.578275 15322 raft_consensus.cc:3060] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.582512 15322 raft_consensus.cc:515] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.583914 15322 leader_election.cc:290] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:14.584661 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:14.584877 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcebdbec2a040109381c8b202176c16" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:14.585239 15396 raft_consensus.cc:3055] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:14.585446 15470 raft_consensus.cc:3060] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.585642 15396 raft_consensus.cc:740] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:14.586544 15396 consensus_queue.cc:260] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.587563 15396 raft_consensus.cc:3060] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.590090 15470 raft_consensus.cc:2468] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:14.590921 15287 leader_election.cc:304] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc2c6c5959c84bf99fe2baaca661d73a, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:14.591580 15639 raft_consensus.cc:2804] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:14.592047 15639 raft_consensus.cc:697] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:14.592868 15396 raft_consensus.cc:2468] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 2.
I20260709 12:23:14.592953 15639 consensus_queue.cc:237] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.600014 15218 catalog_manager.cc:5697] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 1 to 2, leader changed from 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.788432 15635 raft_consensus.cc:993] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: : Instructing follower cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.789060 15638 raft_consensus.cc:1081] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Signalling peer cda1d403407e4eadb7ec367da8ff99fc to start an election
I20260709 12:23:14.790375 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
 from {username='slave'} at 127.0.0.1:60260
I20260709 12:23:14.790845 15322 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.791139 15322 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.795603 15322 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.797199 15322 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 3 election: Requested vote from peers 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:14.797923 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:14.798241 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cda1d403407e4eadb7ec367da8ff99fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:14.798452 15396 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.798792 15470 raft_consensus.cc:3055] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:14.799068 15470 raft_consensus.cc:740] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:14.799688 15470 consensus_queue.cc:260] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.800526 15470 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.803185 15396 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 3.
I20260709 12:23:14.804205 15288 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cda1d403407e4eadb7ec367da8ff99fc; no voters: 
I20260709 12:23:14.804834 15639 raft_consensus.cc:2804] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:14.804924 15470 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cda1d403407e4eadb7ec367da8ff99fc in term 3.
I20260709 12:23:14.805296 15639 raft_consensus.cc:697] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Becoming Leader. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:14.806109 15639 consensus_queue.cc:237] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:14.812896 15218 catalog_manager.cc:5697] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc reported cstate change: term changed from 2 to 3, leader changed from cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67) to cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65). New cstate: current_term: 3 leader_uuid: "cda1d403407e4eadb7ec367da8ff99fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.885135 15470 raft_consensus.cc:1275] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:14.885399 15396 raft_consensus.cc:1275] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:14.886273 15634 consensus_queue.cc:1048] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:14.886914 15639 consensus_queue.cc:1048] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:14.924633 15470 raft_consensus.cc:1275] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:14.925792 15642 consensus_queue.cc:1048] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:14.930392 15472 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:14.931648 15642 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:14.935199 15396 raft_consensus.cc:1275] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:14.937633 15634 consensus_queue.cc:1048] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:14.944854 15398 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:14.946489 15658 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:15.105080 15472 raft_consensus.cc:1275] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:15.106077 15658 consensus_queue.cc:1048] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.113947 15396 raft_consensus.cc:1275] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:15.115275 15641 consensus_queue.cc:1048] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.377203 15396 raft_consensus.cc:1275] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:15.378443 15641 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.387233 15472 raft_consensus.cc:1275] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Refusing update from remote peer cda1d403407e4eadb7ec367da8ff99fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:15.389178 15641 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.472258 14649 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:23:17.473017 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.480297 15322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:23:17.480947 15322 raft_consensus.cc:606] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Received request to transfer leadership to TS cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:17.483337 15322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:23:17.483860 15322 raft_consensus.cc:606] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 LEADER]: Received request to transfer leadership to TS 1e1ce3c9edc84272ba7460df5382734b
I20260709 12:23:17.485821 15322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:23:17.486196 15322 raft_consensus.cc:606] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Received request to transfer leadership to TS cc2c6c5959c84bf99fe2baaca661d73a
I20260709 12:23:17.488332 15322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0"
dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
mode: GRACEFUL
new_leader_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:60280
I20260709 12:23:17.488793 15322 raft_consensus.cc:606] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Received request to transfer leadership to TS 1e1ce3c9edc84272ba7460df5382734b
I20260709 12:23:17.489869 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:17.490384 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.593601 15634 raft_consensus.cc:993] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:17.594110 15667 raft_consensus.cc:1081] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Signalling peer cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:17.595707 15470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:36274
I20260709 12:23:17.596172 15470 raft_consensus.cc:493] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.596452 15470 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.601828 15470 raft_consensus.cc:515] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.603595 15470 leader_election.cc:290] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 4 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:17.604554 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:17.604804 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb38871cb7e64014ab35675866da5d00" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:17.605319 15322 raft_consensus.cc:3055] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:17.605369 15398 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.605625 15322 raft_consensus.cc:740] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:17.606359 15322 consensus_queue.cc:260] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.607384 15322 raft_consensus.cc:3060] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.610603 15398 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 4.
I20260709 12:23:17.611627 15438 leader_election.cc:304] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:17.612349 15638 raft_consensus.cc:2804] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:17.612744 15322 raft_consensus.cc:2468] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 4.
I20260709 12:23:17.613405 15638 raft_consensus.cc:697] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:17.614480 15638 consensus_queue.cc:237] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.622066 15218 catalog_manager.cc:5697] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 3 to 4, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 4 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.685489 15675 raft_consensus.cc:993] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:17.686038 15634 raft_consensus.cc:1081] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Signalling peer 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:17.686863 15676 raft_consensus.cc:993] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:17.687389 15634 raft_consensus.cc:1081] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 LEADER]: Signalling peer 1e1ce3c9edc84272ba7460df5382734b to start an election
I20260709 12:23:17.687600 15398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:23:17.688134 15398 raft_consensus.cc:493] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.688511 15398 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:17.688984 15396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9"
dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:23:17.689488 15396 raft_consensus.cc:493] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.689752 15396 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:17.693146 15398 raft_consensus.cc:515] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.694710 15396 raft_consensus.cc:515] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.695254 15398 leader_election.cc:290] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 3 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:17.695873 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:17.696385 15322 raft_consensus.cc:3055] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:17.696664 15322 raft_consensus.cc:740] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:17.696748 15470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc72a67c919b42f298db58367f7a98e0" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:17.697347 15470 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:17.697395 15396 leader_election.cc:290] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 5 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67:43753)
I20260709 12:23:17.697451 15322 consensus_queue.cc:260] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.697980 15472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
I20260709 12:23:17.698472 15472 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:17.698803 15322 raft_consensus.cc:3060] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:17.699436 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0ea1018b52415d9e6bbf6ecd4f2ff9" candidate_uuid: "1e1ce3c9edc84272ba7460df5382734b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:17.700055 15317 raft_consensus.cc:3055] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:17.700357 15317 raft_consensus.cc:740] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:17.701368 15317 consensus_queue.cc:260] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.702703 15317 raft_consensus.cc:3060] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:17.704356 15470 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 3.
I20260709 12:23:17.705855 15362 leader_election.cc:304] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:17.706754 15637 raft_consensus.cc:2804] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:17.707653 15472 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 5.
I20260709 12:23:17.708889 15362 leader_election.cc:304] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:17.709692 15634 raft_consensus.cc:993] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: : Instructing follower cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:17.710156 15322 raft_consensus.cc:2468] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 3.
I20260709 12:23:17.710968 15317 raft_consensus.cc:2468] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1ce3c9edc84272ba7460df5382734b in term 5.
I20260709 12:23:17.710157 15634 raft_consensus.cc:1081] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Signalling peer cc2c6c5959c84bf99fe2baaca661d73a to start an election
I20260709 12:23:17.713531 15637 raft_consensus.cc:697] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 3 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:17.713788 15678 raft_consensus.cc:2804] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:17.714325 15678 raft_consensus.cc:697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 5 LEADER]: Becoming Leader. State: Replica: 1e1ce3c9edc84272ba7460df5382734b, State: Running, Role: LEADER
I20260709 12:23:17.714910 15472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8"
dest_uuid: "cc2c6c5959c84bf99fe2baaca661d73a"
 from {username='slave'} at 127.0.0.1:36274
I20260709 12:23:17.714561 15637 consensus_queue.cc:237] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.715444 15472 raft_consensus.cc:493] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.715101 15678 consensus_queue.cc:237] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.715842 15472 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:17.724988 15472 raft_consensus.cc:515] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.724419 15218 catalog_manager.cc:5697] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 2 to 3, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 3 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.726715 15472 leader_election.cc:290] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 3 election: Requested vote from peers cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411), 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989)
I20260709 12:23:17.727536 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cda1d403407e4eadb7ec367da8ff99fc"
I20260709 12:23:17.727805 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b4828ddf2540d09d52132a90f6eab8" candidate_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e1ce3c9edc84272ba7460df5382734b"
I20260709 12:23:17.728123 15317 raft_consensus.cc:3055] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:17.728349 15396 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:17.728487 15317 raft_consensus.cc:740] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cda1d403407e4eadb7ec367da8ff99fc, State: Running, Role: LEADER
I20260709 12:23:17.729354 15317 consensus_queue.cc:260] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.730572 15317 raft_consensus.cc:3060] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:17.735028 15396 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 3.
I20260709 12:23:17.736161 15438 leader_election.cc:304] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1ce3c9edc84272ba7460df5382734b, cc2c6c5959c84bf99fe2baaca661d73a; no voters: 
I20260709 12:23:17.737003 15638 raft_consensus.cc:2804] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:17.737525 15638 raft_consensus.cc:697] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Becoming Leader. State: Replica: cc2c6c5959c84bf99fe2baaca661d73a, State: Running, Role: LEADER
I20260709 12:23:17.737998 15218 catalog_manager.cc:5697] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b reported cstate change: term changed from 4 to 5, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66). New cstate: current_term: 5 leader_uuid: "1e1ce3c9edc84272ba7460df5382734b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.738740 15317 raft_consensus.cc:2468] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc2c6c5959c84bf99fe2baaca661d73a in term 3.
I20260709 12:23:17.738371 15638 consensus_queue.cc:237] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } }
I20260709 12:23:17.746925 15217 catalog_manager.cc:5697] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a reported cstate change: term changed from 2 to 3, leader changed from cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65) to cc2c6c5959c84bf99fe2baaca661d73a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.121124 15472 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 5 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:18.122275 15637 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:18.131858 15317 raft_consensus.cc:1275] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 5 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:18.133771 15317 raft_consensus.cc:1275] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:18.134256 15637 consensus_queue.cc:1048] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:18.135499 15638 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:18.148406 15396 raft_consensus.cc:1275] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:18.149614 15638 consensus_queue.cc:1048] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:18.218673 15396 raft_consensus.cc:1275] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:18.219897 15638 consensus_queue.cc:1048] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1ce3c9edc84272ba7460df5382734b" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.229681 15322 raft_consensus.cc:1275] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Refusing update from remote peer cc2c6c5959c84bf99fe2baaca661d73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:18.231204 15638 consensus_queue.cc:1048] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.293593 15322 raft_consensus.cc:1275] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:18.294689 15637 consensus_queue.cc:1048] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda1d403407e4eadb7ec367da8ff99fc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 39411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.303644 15470 raft_consensus.cc:1275] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Refusing update from remote peer 1e1ce3c9edc84272ba7460df5382734b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:18.305529 15678 consensus_queue.cc:1048] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2c6c5959c84bf99fe2baaca661d73a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.491508 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.497350 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.497833 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.498744 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.504307 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:19.504701 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.505573 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:20.510922 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:20.511327 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.512413 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.519141 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:21.519586 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.520458 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.525615 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:22.526015 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.526961 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.532162 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:23.532510 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:24.533401 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.539155 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:24.539517 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.540292 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.545675 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:25.546032 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.546890 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.552055 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:26.552388 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:27.585629 14649 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:23:27.586405 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
I20260709 12:23:27.612875 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:27.613585 14649 tablet_replica.cc:333] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.614197 14649 raft_consensus.cc:2243] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.614768 14649 raft_consensus.cc:2272] T a3e596a233bb421cb662379ff758488c P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.616847 14649 tablet_replica.cc:333] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.617393 14649 raft_consensus.cc:2243] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.617798 14649 raft_consensus.cc:2272] T 4a101ab1a44840e79bb351a259f61d50 P cda1d403407e4eadb7ec367da8ff99fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.619670 14649 tablet_replica.cc:333] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.620110 14649 raft_consensus.cc:2243] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.620850 14649 raft_consensus.cc:2272] T ddcebdbec2a040109381c8b202176c16 P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.622576 14649 tablet_replica.cc:333] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.623005 14649 raft_consensus.cc:2243] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.623364 14649 raft_consensus.cc:2272] T 75b4828ddf2540d09d52132a90f6eab8 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.625248 14649 tablet_replica.cc:333] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.625674 14649 raft_consensus.cc:2243] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.626394 14649 raft_consensus.cc:2272] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.627967 14649 tablet_replica.cc:333] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.628387 14649 raft_consensus.cc:2243] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.628768 14649 raft_consensus.cc:2272] T fb38871cb7e64014ab35675866da5d00 P cda1d403407e4eadb7ec367da8ff99fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.630352 14649 tablet_replica.cc:333] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.630767 14649 raft_consensus.cc:2243] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.631142 14649 raft_consensus.cc:2272] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cda1d403407e4eadb7ec367da8ff99fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.632694 14649 tablet_replica.cc:333] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.633183 14649 raft_consensus.cc:2243] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.633911 14649 raft_consensus.cc:2272] T c7a03bac8ba048488d03d5b6ab45ccfd P cda1d403407e4eadb7ec367da8ff99fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.635591 14649 tablet_replica.cc:333] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.636015 14649 raft_consensus.cc:2243] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.636716 14649 raft_consensus.cc:2272] T 9f5bf10954ca4f95a7cffc37abe76678 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.638445 14649 tablet_replica.cc:333] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc: stopping tablet replica
I20260709 12:23:27.638854 14649 raft_consensus.cc:2243] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.639216 14649 raft_consensus.cc:2272] T fc72a67c919b42f298db58367f7a98e0 P cda1d403407e4eadb7ec367da8ff99fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.668951 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
I20260709 12:23:27.693996 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
I20260709 12:23:27.723199 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:27.723850 14649 tablet_replica.cc:333] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.724485 14649 raft_consensus.cc:2243] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.725006 14649 raft_consensus.cc:2272] T 4704b4291e4e4f55b52ab9b4f320cdd1 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.726951 14649 tablet_replica.cc:333] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.727440 14649 raft_consensus.cc:2243] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.727905 14649 raft_consensus.cc:2272] T 75b4828ddf2540d09d52132a90f6eab8 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.729564 14649 tablet_replica.cc:333] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.730078 14649 raft_consensus.cc:2243] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.730471 14649 raft_consensus.cc:2272] T a3e596a233bb421cb662379ff758488c P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.732228 14649 tablet_replica.cc:333] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.733016 14649 raft_consensus.cc:2243] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.733515 14649 raft_consensus.cc:2272] T ddcebdbec2a040109381c8b202176c16 P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.735119 14649 tablet_replica.cc:333] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.735599 14649 raft_consensus.cc:2243] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.736017 14649 raft_consensus.cc:2272] T 9f5bf10954ca4f95a7cffc37abe76678 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.737749 14649 tablet_replica.cc:333] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.738291 14649 raft_consensus.cc:2243] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.739272 14649 raft_consensus.cc:2272] T fc72a67c919b42f298db58367f7a98e0 P 1e1ce3c9edc84272ba7460df5382734b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.741266 14649 tablet_replica.cc:333] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
W20260709 12:23:27.741659 15437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.78.65:39411: connect: Connection refused (error 111) [suppressed 3 similar messages]
I20260709 12:23:27.741742 14649 raft_consensus.cc:2243] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.742628 14649 raft_consensus.cc:2272] T 4a101ab1a44840e79bb351a259f61d50 P 1e1ce3c9edc84272ba7460df5382734b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.744565 14649 tablet_replica.cc:333] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.745071 14649 raft_consensus.cc:2243] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:27.745407 15437 consensus_peers.cc:597] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a -> Peer cda1d403407e4eadb7ec367da8ff99fc (127.14.78.65:39411): Couldn't send request to peer cda1d403407e4eadb7ec367da8ff99fc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:39411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.745548 14649 raft_consensus.cc:2272] T fb38871cb7e64014ab35675866da5d00 P 1e1ce3c9edc84272ba7460df5382734b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.747241 14649 tablet_replica.cc:333] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.747692 14649 raft_consensus.cc:2243] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.748415 14649 raft_consensus.cc:2272] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P 1e1ce3c9edc84272ba7460df5382734b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.750020 14649 tablet_replica.cc:333] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b: stopping tablet replica
I20260709 12:23:27.750458 14649 raft_consensus.cc:2243] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.750947 14649 raft_consensus.cc:2272] T c7a03bac8ba048488d03d5b6ab45ccfd P 1e1ce3c9edc84272ba7460df5382734b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:27.794893 15438 consensus_peers.cc:597] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a -> Peer 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989): Couldn't send request to peer 1e1ce3c9edc84272ba7460df5382734b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:36989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.797463 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
W20260709 12:23:27.810335 15438 consensus_peers.cc:597] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a -> Peer 1e1ce3c9edc84272ba7460df5382734b (127.14.78.66:36989): Couldn't send request to peer 1e1ce3c9edc84272ba7460df5382734b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:36989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.819288 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
I20260709 12:23:27.846719 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:27.847316 14649 tablet_replica.cc:333] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.848011 14649 raft_consensus.cc:2243] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.848897 14649 raft_consensus.cc:2272] T fb38871cb7e64014ab35675866da5d00 P cc2c6c5959c84bf99fe2baaca661d73a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.850766 14649 tablet_replica.cc:333] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.851263 14649 raft_consensus.cc:2243] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.851792 14649 raft_consensus.cc:2272] T 9f5bf10954ca4f95a7cffc37abe76678 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.853505 14649 tablet_replica.cc:333] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.853996 14649 raft_consensus.cc:2243] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.854398 14649 raft_consensus.cc:2272] T ddcebdbec2a040109381c8b202176c16 P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.855983 14649 tablet_replica.cc:333] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.856487 14649 raft_consensus.cc:2243] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.856935 14649 raft_consensus.cc:2272] T 4704b4291e4e4f55b52ab9b4f320cdd1 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.858527 14649 tablet_replica.cc:333] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.859047 14649 raft_consensus.cc:2243] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.859443 14649 raft_consensus.cc:2272] T 4a101ab1a44840e79bb351a259f61d50 P cc2c6c5959c84bf99fe2baaca661d73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.861188 14649 tablet_replica.cc:333] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.861660 14649 raft_consensus.cc:2243] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.862404 14649 raft_consensus.cc:2272] T a3e596a233bb421cb662379ff758488c P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.864018 14649 tablet_replica.cc:333] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.864501 14649 raft_consensus.cc:2243] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.864919 14649 raft_consensus.cc:2272] T fc72a67c919b42f298db58367f7a98e0 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.866633 14649 tablet_replica.cc:333] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.867086 14649 raft_consensus.cc:2243] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.867926 14649 raft_consensus.cc:2272] T 75b4828ddf2540d09d52132a90f6eab8 P cc2c6c5959c84bf99fe2baaca661d73a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.869801 14649 tablet_replica.cc:333] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.870404 14649 raft_consensus.cc:2243] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.870874 14649 raft_consensus.cc:2272] T 9e0ea1018b52415d9e6bbf6ecd4f2ff9 P cc2c6c5959c84bf99fe2baaca661d73a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.872481 14649 tablet_replica.cc:333] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a: stopping tablet replica
I20260709 12:23:27.872934 14649 raft_consensus.cc:2243] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:27.873370 14649 raft_consensus.cc:2272] T c7a03bac8ba048488d03d5b6ab45ccfd P cc2c6c5959c84bf99fe2baaca661d73a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.901803 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
I20260709 12:23:27.921612 14649 master.cc:562] Master@127.14.78.126:44131 shutting down...
I20260709 12:23:27.948585 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:27.949218 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:27.949566 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P c840d42d71fc47ad8501df998234aac4: stopping tablet replica
I20260709 12:23:27.968408 14649 master.cc:584] Master@127.14.78.126:44131 shutdown complete.
1e1ce3c9edc84272ba7460df5382734b  4
cc2c6c5959c84bf99fe2baaca661d73a  1
cda1d403407e4eadb7ec367da8ff99fc  5
1e1ce3c9edc84272ba7460df5382734b  4
cc2c6c5959c84bf99fe2baaca661d73a  3
cda1d403407e4eadb7ec367da8ff99fc  3
1e1ce3c9edc84272ba7460df5382734b  1
cc2c6c5959c84bf99fe2baaca661d73a  1
cda1d403407e4eadb7ec367da8ff99fc  8
1e1ce3c9edc84272ba7460df5382734b  3
cc2c6c5959c84bf99fe2baaca661d73a  3
cda1d403407e4eadb7ec367da8ff99fc  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28550 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:23:28.013950 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:37123
I20260709 12:23:28.015036 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:28.020169 15709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.020260 15710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.022339 15712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:28.022954 14649 server_base.cc:1061] running on GCE node
I20260709 12:23:28.023802 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:28.024034 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:28.024186 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599808024167 us; error 0 us; skew 500 ppm
I20260709 12:23:28.024682 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:28.027133 14649 webserver.cc:533] Webserver started at http://127.14.78.126:45153/ using document root <none> and password file <none>
I20260709 12:23:28.027597 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:28.027793 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:28.028075 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:28.029253 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "7d3391ee630646ccabf92830e1028bc1"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.033481 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:23:28.036537 15717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.037302 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:23:28.037585 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "7d3391ee630646ccabf92830e1028bc1"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.037824 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:28.055371 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:28.056552 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:28.093741 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:37123
I20260709 12:23:28.093835 15769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:37123 every 8 connection(s)
I20260709 12:23:28.097858 15770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.108269 15770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Bootstrap starting.
I20260709 12:23:28.113459 15770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.117499 15770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: No bootstrap required, opened a new log
I20260709 12:23:28.119649 15770 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d3391ee630646ccabf92830e1028bc1" member_type: VOTER }
I20260709 12:23:28.120051 15770 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.120312 15770 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3391ee630646ccabf92830e1028bc1, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.120949 15770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d3391ee630646ccabf92830e1028bc1" member_type: VOTER }
I20260709 12:23:28.121464 15770 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:28.121697 15770 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:28.121985 15770 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.125896 15770 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d3391ee630646ccabf92830e1028bc1" member_type: VOTER }
I20260709 12:23:28.126394 15770 leader_election.cc:304] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d3391ee630646ccabf92830e1028bc1; no voters: 
I20260709 12:23:28.127427 15770 leader_election.cc:290] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:28.127811 15773 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.129057 15773 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d3391ee630646ccabf92830e1028bc1, State: Running, Role: LEADER
I20260709 12:23:28.129721 15773 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d3391ee630646ccabf92830e1028bc1" member_type: VOTER }
I20260709 12:23:28.130366 15770 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:28.134824 15775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d3391ee630646ccabf92830e1028bc1. Latest consensus state: current_term: 1 leader_uuid: "7d3391ee630646ccabf92830e1028bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d3391ee630646ccabf92830e1028bc1" member_type: VOTER } }
I20260709 12:23:28.135463 15775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:28.136376 15774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d3391ee630646ccabf92830e1028bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d3391ee630646ccabf92830e1028bc1" member_type: VOTER } }
I20260709 12:23:28.136900 15774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:28.137507 15781 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:28.142463 15781 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:28.146423 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:28.151196 15781 catalog_manager.cc:1383] Generated new cluster ID: 6fd25943828a458d813bff8f0f760612
I20260709 12:23:28.151417 15781 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:28.167368 15781 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:28.168483 15781 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:28.182085 15781 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Generated new TSK 0
I20260709 12:23:28.182574 15781 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:28.212410 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:28.218081 15791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.219529 15792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.220453 15794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:28.220875 14649 server_base.cc:1061] running on GCE node
I20260709 12:23:28.221797 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:28.222000 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:28.222185 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599808222161 us; error 0 us; skew 500 ppm
I20260709 12:23:28.222702 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:28.224802 14649 webserver.cc:533] Webserver started at http://127.14.78.65:43465/ using document root <none> and password file <none>
I20260709 12:23:28.225304 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:28.225502 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:28.225764 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:28.226783 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "9fd62f0fa06a4561a0a7101b85942f86"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.231163 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:28.234184 15799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.234858 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:28.235129 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "9fd62f0fa06a4561a0a7101b85942f86"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.235411 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:28.254453 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:28.255615 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:28.256958 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:28.259156 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:28.259367 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.259603 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:28.259804 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.297257 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:38945
I20260709 12:23:28.297343 15862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:38945 every 8 connection(s)
I20260709 12:23:28.302179 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:28.308755 15867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.310050 15868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.311853 15870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:28.312816 14649 server_base.cc:1061] running on GCE node
I20260709 12:23:28.313803 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:28.313997 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:28.314220 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599808314199 us; error 0 us; skew 500 ppm
I20260709 12:23:28.314790 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:28.317119 14649 webserver.cc:533] Webserver started at http://127.14.78.66:34193/ using document root <none> and password file <none>
I20260709 12:23:28.317658 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:28.317917 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:28.318224 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:28.319541 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "761f08e40cdf4af396105d67949c0afc"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.319916 15863 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37123
I20260709 12:23:28.320281 15863 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:28.320951 15863 heartbeater.cc:507] Master 127.14.78.126:37123 requested a full tablet report, sending...
I20260709 12:23:28.323107 15734 ts_manager.cc:194] Registered new tserver with Master: 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:23:28.324744 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:23:28.325456 15734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54792
I20260709 12:23:28.328594 15875 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.329344 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:28.329692 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "761f08e40cdf4af396105d67949c0afc"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.330103 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:28.344957 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:28.346130 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:28.347497 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:28.349577 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:28.349798 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.350032 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:28.350204 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.387869 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:41469
I20260709 12:23:28.387990 15937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:41469 every 8 connection(s)
I20260709 12:23:28.392380 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:28.398983 15941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:28.399930 15942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:28.403280 14649 server_base.cc:1061] running on GCE node
W20260709 12:23:28.403399 15944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:28.404650 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:28.404929 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:28.405095 15938 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37123
I20260709 12:23:28.405164 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599808405142 us; error 0 us; skew 500 ppm
I20260709 12:23:28.405514 15938 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:28.405988 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:28.406409 15938 heartbeater.cc:507] Master 127.14.78.126:37123 requested a full tablet report, sending...
I20260709 12:23:28.408558 14649 webserver.cc:533] Webserver started at http://127.14.78.67:35527/ using document root <none> and password file <none>
I20260709 12:23:28.408685 15734 ts_manager.cc:194] Registered new tserver with Master: 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:28.409134 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:28.409368 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:28.409649 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:28.410188 15734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54804
I20260709 12:23:28.410769 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.415531 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:28.418426 15949 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.419130 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:28.419447 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
format_stamp: "Formatted at 2026-07-09 12:23:28 on dist-test-slave-vrh7"
I20260709 12:23:28.419750 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:28.432988 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:28.434128 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:28.435643 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:28.438038 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:28.438212 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.438503 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:28.438670 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:28.477605 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:39871
I20260709 12:23:28.477705 16012 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:39871 every 8 connection(s)
I20260709 12:23:28.490948 16013 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37123
I20260709 12:23:28.491291 16013 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:28.492161 16013 heartbeater.cc:507] Master 127.14.78.126:37123 requested a full tablet report, sending...
I20260709 12:23:28.494014 15734 ts_manager.cc:194] Registered new tserver with Master: b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:28.494089 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013483719s
I20260709 12:23:28.495352 15734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54806
I20260709 12:23:28.527432 15734 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54808:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:28.539175 15734 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:28.735409 15978 tablet_service.cc:1511] Processing CreateTablet for tablet 12b10f85daf040e1af9735597b9af404 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:28.736788 15978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b10f85daf040e1af9735597b9af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.738046 15976 tablet_service.cc:1511] Processing CreateTablet for tablet b792e6a0c581428bae7ae0020c5c6edc (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:28.739415 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b792e6a0c581428bae7ae0020c5c6edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.739548 15903 tablet_service.cc:1511] Processing CreateTablet for tablet 12b10f85daf040e1af9735597b9af404 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:28.740509 15975 tablet_service.cc:1511] Processing CreateTablet for tablet 4db6493294254313a1e9687fd4ba9b08 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:28.741818 15975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db6493294254313a1e9687fd4ba9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.742166 15902 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb7213c7f6d42bc818fcdd60101ee30 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:28.744264 15901 tablet_service.cc:1511] Processing CreateTablet for tablet b792e6a0c581428bae7ae0020c5c6edc (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:28.746199 15977 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb7213c7f6d42bc818fcdd60101ee30 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:28.746423 15900 tablet_service.cc:1511] Processing CreateTablet for tablet 4db6493294254313a1e9687fd4ba9b08 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:28.747460 15977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb7213c7f6d42bc818fcdd60101ee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.740869 15903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b10f85daf040e1af9735597b9af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.749402 15900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db6493294254313a1e9687fd4ba9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.752480 15973 tablet_service.cc:1511] Processing CreateTablet for tablet 1db7600d8ee247d0abddcf104708f152 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:28.753423 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b792e6a0c581428bae7ae0020c5c6edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.753782 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db7600d8ee247d0abddcf104708f152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.757339 15902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb7213c7f6d42bc818fcdd60101ee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.757663 15974 tablet_service.cc:1511] Processing CreateTablet for tablet fee2b4c1781842208f03c61ac44ad821 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:28.758890 15974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee2b4c1781842208f03c61ac44ad821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.763489 15898 tablet_service.cc:1511] Processing CreateTablet for tablet 1db7600d8ee247d0abddcf104708f152 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:28.764318 15899 tablet_service.cc:1511] Processing CreateTablet for tablet fee2b4c1781842208f03c61ac44ad821 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:28.766088 15897 tablet_service.cc:1511] Processing CreateTablet for tablet 21c971bd20d548a8a1dd8f98022a1f7e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:28.768222 15896 tablet_service.cc:1511] Processing CreateTablet for tablet 8772e3a5c1494ac0a3cda60be3150573 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:28.770385 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 021499433bf04873a1ec6376aba69864 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:28.772909 15894 tablet_service.cc:1511] Processing CreateTablet for tablet afc80a856f5e400285f41a5b49b603d9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:28.764776 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db7600d8ee247d0abddcf104708f152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.776090 15899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee2b4c1781842208f03c61ac44ad821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.781505 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c971bd20d548a8a1dd8f98022a1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.785529 15896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8772e3a5c1494ac0a3cda60be3150573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.789517 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021499433bf04873a1ec6376aba69864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.793496 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc80a856f5e400285f41a5b49b603d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.799151 15976 tablet_service.cc:1511] Processing CreateTablet for tablet 21c971bd20d548a8a1dd8f98022a1f7e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:28.800773 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c971bd20d548a8a1dd8f98022a1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.803090 15972 tablet_service.cc:1511] Processing CreateTablet for tablet 8772e3a5c1494ac0a3cda60be3150573 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:28.809459 15972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8772e3a5c1494ac0a3cda60be3150573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.822510 15971 tablet_service.cc:1511] Processing CreateTablet for tablet 021499433bf04873a1ec6376aba69864 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:28.823330 15970 tablet_service.cc:1511] Processing CreateTablet for tablet afc80a856f5e400285f41a5b49b603d9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:28.823822 15971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021499433bf04873a1ec6376aba69864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.824618 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc80a856f5e400285f41a5b49b603d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.833001 15969 tablet_service.cc:1511] Processing CreateTablet for tablet 3e12395965994c48bc79f9b642be60ef (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:28.834308 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12395965994c48bc79f9b642be60ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.841903 15970 tablet_service.cc:1511] Processing CreateTablet for tablet 7571c77d7cc54b31955653214a4cee6c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:28.843139 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7571c77d7cc54b31955653214a4cee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.874147 15969 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9763772dd94e749d16fd361de18016 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:28.879458 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9763772dd94e749d16fd361de18016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.910015 15977 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7327c39306430dbeb82a9c27813987 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:28.910931 16028 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:28.911629 15977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7327c39306430dbeb82a9c27813987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.916643 16028 tablet_bootstrap.cc:654] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.922138 16029 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:28.927282 15901 tablet_service.cc:1511] Processing CreateTablet for tablet 3e12395965994c48bc79f9b642be60ef (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:28.928102 15903 tablet_service.cc:1511] Processing CreateTablet for tablet 7571c77d7cc54b31955653214a4cee6c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:28.928550 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12395965994c48bc79f9b642be60ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.936065 15971 tablet_service.cc:1511] Processing CreateTablet for tablet 95a62357a0c84b929b49daf3efbf1e27 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:28.937770 15971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a62357a0c84b929b49daf3efbf1e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.942102 15975 tablet_service.cc:1511] Processing CreateTablet for tablet 56d26e9d10514d43b1dc78bb348fede9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:28.943307 15975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d26e9d10514d43b1dc78bb348fede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.943780 15977 tablet_service.cc:1511] Processing CreateTablet for tablet 43b58d74f13f487eaa63ac4992bca77b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:28.939774 15903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7571c77d7cc54b31955653214a4cee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.956507 15894 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7327c39306430dbeb82a9c27813987 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:28.957508 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7327c39306430dbeb82a9c27813987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.945881 15898 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9763772dd94e749d16fd361de18016 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:28.961732 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9763772dd94e749d16fd361de18016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.964129 15971 tablet_service.cc:1511] Processing CreateTablet for tablet 21e8af32d711469181861fb4a98feec9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:28.949155 15978 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3c37964b604d879b4e5a45e6154d8e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:28.965477 15971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e8af32d711469181861fb4a98feec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.965236 15970 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa3e193f2f64a16b07bd7462017199d (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:28.966168 15978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c37964b604d879b4e5a45e6154d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.967072 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa3e193f2f64a16b07bd7462017199d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.966856 15969 tablet_service.cc:1511] Processing CreateTablet for tablet 879e5f4abbab45deb735e1ae9ae2d204 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:28.968073 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879e5f4abbab45deb735e1ae9ae2d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.970733 15972 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed21b81727749c4aa09fa4278bc8398 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:28.971941 15972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed21b81727749c4aa09fa4278bc8398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.973376 15973 tablet_service.cc:1511] Processing CreateTablet for tablet 98db7b6a993347c8a1e39b15956132ce (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:28.951308 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 95a62357a0c84b929b49daf3efbf1e27 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:28.952478 16029 tablet_bootstrap.cc:654] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.985560 15970 tablet_service.cc:1511] Processing CreateTablet for tablet 5de0236e5de04f55852a74f344fb872b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:28.985082 15902 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3c37964b604d879b4e5a45e6154d8e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:28.980587 15900 tablet_service.cc:1511] Processing CreateTablet for tablet 43b58d74f13f487eaa63ac4992bca77b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:28.994498 15899 tablet_service.cc:1511] Processing CreateTablet for tablet 56d26e9d10514d43b1dc78bb348fede9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:28.998068 15894 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa3e193f2f64a16b07bd7462017199d (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:28.995236 15900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b58d74f13f487eaa63ac4992bca77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.004132 15897 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed21b81727749c4aa09fa4278bc8398 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:29.005177 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0236e5de04f55852a74f344fb872b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.005228 15899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d26e9d10514d43b1dc78bb348fede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.006237 15974 tablet_service.cc:1511] Processing CreateTablet for tablet 350f530ddf734358bef3d1a96410b5f3 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:29.007927 15974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350f530ddf734358bef3d1a96410b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.997350 15976 tablet_service.cc:1511] Processing CreateTablet for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:29.017128 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa3e193f2f64a16b07bd7462017199d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.017249 15977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b58d74f13f487eaa63ac4992bca77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.023622 16028 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:29.024093 16028 ts_tablet_manager.cc:1403] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.007s
I20260709 12:23:29.026813 16028 raft_consensus.cc:359] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.027575 16028 raft_consensus.cc:385] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.027923 16028 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.028578 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98db7b6a993347c8a1e39b15956132ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.031488 15971 tablet_service.cc:1511] Processing CreateTablet for tablet 114faa3c35e5416eaf96295ba51a61af (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:29.028916 16028 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.032758 15971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114faa3c35e5416eaf96295ba51a61af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.033366 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.038884 15898 tablet_service.cc:1511] Processing CreateTablet for tablet 879e5f4abbab45deb735e1ae9ae2d204 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:29.030805 15903 tablet_service.cc:1511] Processing CreateTablet for tablet 21e8af32d711469181861fb4a98feec9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:29.029572 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a62357a0c84b929b49daf3efbf1e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.031055 16029 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:29.041307 16029 ts_tablet_manager.cc:1403] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.027s
I20260709 12:23:29.043998 16029 raft_consensus.cc:359] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:29.044673 16029 raft_consensus.cc:385] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.048862 15976 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbb40ff3a44403a8705489ecc556e3b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:29.050155 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbb40ff3a44403a8705489ecc556e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.054152 15896 tablet_service.cc:1511] Processing CreateTablet for tablet 5de0236e5de04f55852a74f344fb872b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:29.044982 16029 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.049317 15903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e8af32d711469181861fb4a98feec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.056576 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879e5f4abbab45deb735e1ae9ae2d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.061297 16029 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:29.061302 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed21b81727749c4aa09fa4278bc8398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.070958 15902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c37964b604d879b4e5a45e6154d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.072623 15896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0236e5de04f55852a74f344fb872b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.074514 15901 tablet_service.cc:1511] Processing CreateTablet for tablet 98db7b6a993347c8a1e39b15956132ce (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:29.075821 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98db7b6a993347c8a1e39b15956132ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.079572 15899 tablet_service.cc:1511] Processing CreateTablet for tablet 350f530ddf734358bef3d1a96410b5f3 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:29.080804 15899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350f530ddf734358bef3d1a96410b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.083760 15970 tablet_service.cc:1511] Processing CreateTablet for tablet 5521db1dbeb94ad8ae63681494d5565d (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:29.086107 15828 tablet_service.cc:1511] Processing CreateTablet for tablet 12b10f85daf040e1af9735597b9af404 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:29.087293 15828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b10f85daf040e1af9735597b9af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.090133 15826 tablet_service.cc:1511] Processing CreateTablet for tablet b792e6a0c581428bae7ae0020c5c6edc (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:29.091343 15826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b792e6a0c581428bae7ae0020c5c6edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.093581 15825 tablet_service.cc:1511] Processing CreateTablet for tablet 4db6493294254313a1e9687fd4ba9b08 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:29.085000 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5521db1dbeb94ad8ae63681494d5565d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.095657 15827 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb7213c7f6d42bc818fcdd60101ee30 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:29.098747 15976 tablet_service.cc:1511] Processing CreateTablet for tablet 9e271b9d1bc8403ba1c9d3e80c36917c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:29.108332 15898 tablet_service.cc:1511] Processing CreateTablet for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:29.102181 15823 tablet_service.cc:1511] Processing CreateTablet for tablet 1db7600d8ee247d0abddcf104708f152 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:29.103441 15975 tablet_service.cc:1511] Processing CreateTablet for tablet b727a5c8856c46cba501e397d6c1fc7b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:29.103809 15822 tablet_service.cc:1511] Processing CreateTablet for tablet 21c971bd20d548a8a1dd8f98022a1f7e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:29.105549 15820 tablet_service.cc:1511] Processing CreateTablet for tablet 8772e3a5c1494ac0a3cda60be3150573 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:29.107221 15819 tablet_service.cc:1511] Processing CreateTablet for tablet 021499433bf04873a1ec6376aba69864 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:29.107369 15977 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf6eca653c94d5bba2406c3006ac72e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:29.114759 15969 tablet_service.cc:1511] Processing CreateTablet for tablet 8b51295f13874e3492f0541da8a1f625 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:29.119201 15825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db6493294254313a1e9687fd4ba9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.109714 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e271b9d1bc8403ba1c9d3e80c36917c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.132875 16029 ts_tablet_manager.cc:1434] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.091s	user 0.013s	sys 0.002s
I20260709 12:23:29.109578 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.109581 15818 tablet_service.cc:1511] Processing CreateTablet for tablet afc80a856f5e400285f41a5b49b603d9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:29.112886 15978 tablet_service.cc:1511] Processing CreateTablet for tablet db755710417246db916d8278741aaff0 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:29.138996 15938 heartbeater.cc:499] Master 127.14.78.126:37123 was elected leader, sending a full tablet report...
I20260709 12:23:29.150369 15975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b727a5c8856c46cba501e397d6c1fc7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.152980 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb7213c7f6d42bc818fcdd60101ee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.157342 15822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c971bd20d548a8a1dd8f98022a1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.157950 15903 tablet_service.cc:1511] Processing CreateTablet for tablet 5521db1dbeb94ad8ae63681494d5565d (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:29.159821 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc80a856f5e400285f41a5b49b603d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.161341 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b51295f13874e3492f0541da8a1f625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.161387 15820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8772e3a5c1494ac0a3cda60be3150573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.165316 15978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db755710417246db916d8278741aaff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.169325 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db7600d8ee247d0abddcf104708f152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.176779 15976 tablet_service.cc:1511] Processing CreateTablet for tablet 6b4a53aaee3c41c181784f0c39780d2b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:29.178017 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4a53aaee3c41c181784f0c39780d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.181377 15819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021499433bf04873a1ec6376aba69864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.181701 16013 heartbeater.cc:499] Master 127.14.78.126:37123 was elected leader, sending a full tablet report...
I20260709 12:23:29.123342 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 114faa3c35e5416eaf96295ba51a61af (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:29.120036 15972 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:29.139926 16029 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:29.141788 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:29.142053 16028 ts_tablet_manager.cc:1434] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.118s	user 0.015s	sys 0.024s
I20260709 12:23:29.108987 15973 tablet_service.cc:1511] Processing CreateTablet for tablet 5698e9ff3e90444081e6234a1cd5ce81 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:29.100934 15824 tablet_service.cc:1511] Processing CreateTablet for tablet fee2b4c1781842208f03c61ac44ad821 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:29.194942 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee2b4c1781842208f03c61ac44ad821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.203296 15903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5521db1dbeb94ad8ae63681494d5565d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.205298 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114faa3c35e5416eaf96295ba51a61af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.146389 15901 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbb40ff3a44403a8705489ecc556e3b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:29.209584 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbb40ff3a44403a8705489ecc556e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.213145 16029 tablet_bootstrap.cc:654] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.214599 16028 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:29.215436 15970 tablet_service.cc:1511] Processing CreateTablet for tablet ec82df0e9104447ab3e50c2a6968cf7e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:29.219084 15974 tablet_service.cc:1511] Processing CreateTablet for tablet a79a04e9fda24da8a4ca30980a0ef796 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:29.226816 15899 tablet_service.cc:1511] Processing CreateTablet for tablet 9e271b9d1bc8403ba1c9d3e80c36917c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:29.228003 15899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e271b9d1bc8403ba1c9d3e80c36917c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.223790 15977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf6eca653c94d5bba2406c3006ac72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.240589 16033 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.242789 16033 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:29.246495 16033 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:23:29.258037 15894 tablet_service.cc:1511] Processing CreateTablet for tablet 5698e9ff3e90444081e6234a1cd5ce81 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:29.259302 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5698e9ff3e90444081e6234a1cd5ce81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.270973 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5698e9ff3e90444081e6234a1cd5ce81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.271915 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82df0e9104447ab3e50c2a6968cf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.272941 15974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79a04e9fda24da8a4ca30980a0ef796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.278293 16028 tablet_bootstrap.cc:654] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.279090 16034 tablet_bootstrap.cc:492] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:29.278299 15975 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8f740585214d0fb73ad203c56cbaaf (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:29.285322 15972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.286170 15897 tablet_service.cc:1511] Processing CreateTablet for tablet db755710417246db916d8278741aaff0 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:29.269232 15976 tablet_service.cc:1511] Processing CreateTablet for tablet 6b08a1f9a245453cafe7fbd2ad9f4b17 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:29.294379 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db755710417246db916d8278741aaff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.285009 16034 tablet_bootstrap.cc:654] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.294404 15976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b08a1f9a245453cafe7fbd2ad9f4b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.310405 15820 tablet_service.cc:1511] Processing CreateTablet for tablet 3e12395965994c48bc79f9b642be60ef (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:29.311650 15820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12395965994c48bc79f9b642be60ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.305749 15900 tablet_service.cc:1511] Processing CreateTablet for tablet b727a5c8856c46cba501e397d6c1fc7b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:29.313813 15900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b727a5c8856c46cba501e397d6c1fc7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.314188 15828 tablet_service.cc:1511] Processing CreateTablet for tablet 7571c77d7cc54b31955653214a4cee6c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:29.315434 15828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7571c77d7cc54b31955653214a4cee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.325619 15972 tablet_service.cc:1511] Processing CreateTablet for tablet 6e7dbc561f4f4c5da63c0d84e92b9871 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:29.327939 15863 heartbeater.cc:499] Master 127.14.78.126:37123 was elected leader, sending a full tablet report...
I20260709 12:23:29.330006 15971 tablet_service.cc:1511] Processing CreateTablet for tablet f567175d186f4342b604ea89474a493a (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:29.332589 15973 tablet_service.cc:1511] Processing CreateTablet for tablet 98e0016561fa4f72935bc3bc36cda023 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:29.333153 15975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f740585214d0fb73ad203c56cbaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.333850 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e0016561fa4f72935bc3bc36cda023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.339107 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 6b4a53aaee3c41c181784f0c39780d2b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:29.340508 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4a53aaee3c41c181784f0c39780d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.340348 15823 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7327c39306430dbeb82a9c27813987 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:29.341681 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7327c39306430dbeb82a9c27813987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.349398 15896 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf6eca653c94d5bba2406c3006ac72e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:29.350340 15896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf6eca653c94d5bba2406c3006ac72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.351809 15825 tablet_service.cc:1511] Processing CreateTablet for tablet 95a62357a0c84b929b49daf3efbf1e27 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:29.320747 15902 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:29.354028 15902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.356734 15822 tablet_service.cc:1511] Processing CreateTablet for tablet 56d26e9d10514d43b1dc78bb348fede9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:29.360453 15819 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9763772dd94e749d16fd361de18016 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:29.364254 15826 tablet_service.cc:1511] Processing CreateTablet for tablet 43b58d74f13f487eaa63ac4992bca77b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:29.367516 15896 tablet_service.cc:1511] Processing CreateTablet for tablet ec82df0e9104447ab3e50c2a6968cf7e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:29.371681 15824 tablet_service.cc:1511] Processing CreateTablet for tablet 1b3c37964b604d879b4e5a45e6154d8e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:29.381196 15972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7dbc561f4f4c5da63c0d84e92b9871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.389109 15971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f567175d186f4342b604ea89474a493a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.391995 15973 tablet_service.cc:1511] Processing CreateTablet for tablet baa957d5e1074b30a83ccaa548766896 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:29.389621 15825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a62357a0c84b929b49daf3efbf1e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.400866 15827 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa3e193f2f64a16b07bd7462017199d (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:29.401994 16034 tablet_bootstrap.cc:492] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:29.407117 15822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d26e9d10514d43b1dc78bb348fede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.413208 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa957d5e1074b30a83ccaa548766896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.402464 15818 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed21b81727749c4aa09fa4278bc8398 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:29.415131 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed21b81727749c4aa09fa4278bc8398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.402485 16034 ts_tablet_manager.cc:1403] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.124s	user 0.003s	sys 0.015s
I20260709 12:23:29.419721 15819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9763772dd94e749d16fd361de18016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.420347 15899 tablet_service.cc:1511] Processing CreateTablet for tablet a79a04e9fda24da8a4ca30980a0ef796 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:29.427423 15896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82df0e9104447ab3e50c2a6968cf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.432080 16028 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:29.432556 16028 ts_tablet_manager.cc:1403] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.218s	user 0.028s	sys 0.000s
I20260709 12:23:29.440586 15898 tablet_service.cc:1511] Processing CreateTablet for tablet 6b08a1f9a245453cafe7fbd2ad9f4b17 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:29.421873 15903 tablet_service.cc:1511] Processing CreateTablet for tablet 8b51295f13874e3492f0541da8a1f625 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:29.445822 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b08a1f9a245453cafe7fbd2ad9f4b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.446810 16032 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.444280 15969 tablet_service.cc:1511] Processing CreateTablet for tablet 83a3e78f7a344d43ab144f24c55a1e4b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:29.447270 16032 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.447911 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a3e78f7a344d43ab144f24c55a1e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.449391 15974 tablet_service.cc:1511] Processing CreateTablet for tablet 58dc18a7b4f448bd8d86eec830a0f612 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:29.449862 16032 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:29.450290 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:29.450692 15974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58dc18a7b4f448bd8d86eec830a0f612. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:29.451996 15879 leader_election.cc:343] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.470875 16029 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:29.471385 16029 ts_tablet_manager.cc:1403] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.332s	user 0.014s	sys 0.013s
I20260709 12:23:29.472729 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8f740585214d0fb73ad203c56cbaaf (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:29.474735 16034 raft_consensus.cc:359] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.475291 16034 raft_consensus.cc:385] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.475538 16034 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.431936 15977 tablet_service.cc:1511] Processing CreateTablet for tablet afd0e40a445b47b68759b884aff8da86 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:29.468397 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c37964b604d879b4e5a45e6154d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.478696 15903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b51295f13874e3492f0541da8a1f625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.497195 15826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b58d74f13f487eaa63ac4992bca77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.496869 15970 tablet_service.cc:1511] Processing CreateTablet for tablet a5852b04bfec4fa5b2fee780cfb44ce2 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:29.498137 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa3e193f2f64a16b07bd7462017199d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.426409 15978 tablet_service.cc:1511] Processing CreateTablet for tablet 661598743dad4055844a0b0f97c07156 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:29.503433 15901 tablet_service.cc:1511] Processing CreateTablet for tablet f567175d186f4342b604ea89474a493a (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:29.505467 15828 tablet_service.cc:1511] Processing CreateTablet for tablet 98db7b6a993347c8a1e39b15956132ce (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:29.506649 15828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98db7b6a993347c8a1e39b15956132ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.487387 16034 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.512117 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5852b04bfec4fa5b2fee780cfb44ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.513566 15820 tablet_service.cc:1511] Processing CreateTablet for tablet 21e8af32d711469181861fb4a98feec9 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:29.514724 15820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e8af32d711469181861fb4a98feec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.517500 16028 raft_consensus.cc:359] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.518337 16028 raft_consensus.cc:385] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.518677 16028 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.519496 16028 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.521667 16028 ts_tablet_manager.cc:1434] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.089s	user 0.002s	sys 0.005s
I20260709 12:23:29.524328 15977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd0e40a445b47b68759b884aff8da86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.524655 16029 raft_consensus.cc:359] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.525374 16029 raft_consensus.cc:385] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.525646 16029 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.526361 16029 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.530856 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f567175d186f4342b604ea89474a493a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.538834 15823 tablet_service.cc:1511] Processing CreateTablet for tablet 879e5f4abbab45deb735e1ae9ae2d204 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:29.541235 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879e5f4abbab45deb735e1ae9ae2d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.544363 16029 ts_tablet_manager.cc:1434] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 12:23:29.545317 15822 tablet_service.cc:1511] Processing CreateTablet for tablet 5de0236e5de04f55852a74f344fb872b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:29.546168 16029 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:29.546619 15822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0236e5de04f55852a74f344fb872b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.547291 15978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661598743dad4055844a0b0f97c07156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.550632 15900 tablet_service.cc:1511] Processing CreateTablet for tablet 6e7dbc561f4f4c5da63c0d84e92b9871 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:29.557296 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f740585214d0fb73ad203c56cbaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.557066 15897 tablet_service.cc:1511] Processing CreateTablet for tablet 98e0016561fa4f72935bc3bc36cda023 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:29.558266 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e0016561fa4f72935bc3bc36cda023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.564165 15900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7dbc561f4f4c5da63c0d84e92b9871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.570153 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:29.571682 15950 leader_election.cc:343] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.571683 16028 tablet_bootstrap.cc:492] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:29.583554 15902 tablet_service.cc:1511] Processing CreateTablet for tablet 661598743dad4055844a0b0f97c07156 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:29.584501 16028 tablet_bootstrap.cc:654] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.585230 15899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79a04e9fda24da8a4ca30980a0ef796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.556778 15894 tablet_service.cc:1511] Processing CreateTablet for tablet baa957d5e1074b30a83ccaa548766896 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:29.598534 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa957d5e1074b30a83ccaa548766896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.601341 15902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661598743dad4055844a0b0f97c07156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.608187 15818 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbb40ff3a44403a8705489ecc556e3b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:29.608991 15826 tablet_service.cc:1511] Processing CreateTablet for tablet 350f530ddf734358bef3d1a96410b5f3 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:29.609449 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbb40ff3a44403a8705489ecc556e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.610886 15828 tablet_service.cc:1511] Processing CreateTablet for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:29.611647 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:29.612157 15828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:29.613247 15876 leader_election.cc:343] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.613647 16034 ts_tablet_manager.cc:1434] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.184s	user 0.008s	sys 0.003s
I20260709 12:23:29.613693 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:29.614877 16033 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.615851 15826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350f530ddf734358bef3d1a96410b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.622279 15902 tablet_service.cc:1511] Processing CreateTablet for tablet afd0e40a445b47b68759b884aff8da86 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:29.623483 16034 tablet_bootstrap.cc:492] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:29.623915 15902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd0e40a445b47b68759b884aff8da86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.625962 15975 tablet_service.cc:1511] Processing CreateTablet for tablet 636b8846a0e64d48a3b14ad3af01bb3c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:29.627264 15975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636b8846a0e64d48a3b14ad3af01bb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.629971 16034 tablet_bootstrap.cc:654] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.634305 15819 tablet_service.cc:1511] Processing CreateTablet for tablet 114faa3c35e5416eaf96295ba51a61af (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:29.637506 15819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114faa3c35e5416eaf96295ba51a61af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.654803 16044 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.655292 16044 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.658689 16044 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:29.671023 15896 tablet_service.cc:1511] Processing CreateTablet for tablet 83a3e78f7a344d43ab144f24c55a1e4b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:29.672353 15896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a3e78f7a344d43ab144f24c55a1e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.679740 15971 tablet_service.cc:1511] Processing CreateTablet for tablet 2b991ff9e213435786d19248864c5cfc (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:29.684263 16032 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.686267 15827 tablet_service.cc:1511] Processing CreateTablet for tablet 5698e9ff3e90444081e6234a1cd5ce81 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:29.662037 15973 tablet_service.cc:1511] Processing CreateTablet for tablet 506492d6bd024ce682676a3ecdcf186f (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:29.699779 15971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b991ff9e213435786d19248864c5cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.703302 16034 tablet_bootstrap.cc:492] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:29.709467 16034 ts_tablet_manager.cc:1403] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.012s
I20260709 12:23:29.696331 16032 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.712941 16032 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:29.691103 15972 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:29.710602 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5698e9ff3e90444081e6234a1cd5ce81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.732144 15898 tablet_service.cc:1511] Processing CreateTablet for tablet a5852b04bfec4fa5b2fee780cfb44ce2 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:29.733476 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5852b04bfec4fa5b2fee780cfb44ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.733989 15903 tablet_service.cc:1511] Processing CreateTablet for tablet 636b8846a0e64d48a3b14ad3af01bb3c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:29.735376 15903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636b8846a0e64d48a3b14ad3af01bb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.738462 15824 tablet_service.cc:1511] Processing CreateTablet for tablet 5521db1dbeb94ad8ae63681494d5565d (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:29.739362 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:29.740835 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:29.742120 15912 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:29.742259 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:29.743366 16029 tablet_bootstrap.cc:654] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:29.743609 15952 leader_election.cc:343] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.744020 15952 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:29.744649 16032 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.745070 15952 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:23:29.745431 15803 leader_election.cc:343] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.739645 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5521db1dbeb94ad8ae63681494d5565d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.745798 16032 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.746153 16032 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.746464 16032 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.750322 15825 tablet_service.cc:1511] Processing CreateTablet for tablet b727a5c8856c46cba501e397d6c1fc7b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:29.751591 15825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b727a5c8856c46cba501e397d6c1fc7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.753137 16032 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.755189 16032 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:29.757652 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:29.758061 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:29.758610 15912 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.758888 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.762802 16034 raft_consensus.cc:359] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.763568 16034 raft_consensus.cc:385] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.763913 16034 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.764499 15912 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:29.764680 16034 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.772003 15827 tablet_service.cc:1511] Processing CreateTablet for tablet 9e271b9d1bc8403ba1c9d3e80c36917c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:29.772868 15902 tablet_service.cc:1511] Processing CreateTablet for tablet 58dc18a7b4f448bd8d86eec830a0f612 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:29.774279 15952 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:29.772601 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506492d6bd024ce682676a3ecdcf186f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.787619 15902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58dc18a7b4f448bd8d86eec830a0f612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.788786 15978 tablet_service.cc:1511] Processing CreateTablet for tablet 766b6f7dc34f48babcf3d91d76eecc59 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:29.778568 15894 tablet_service.cc:1511] Processing CreateTablet for tablet 506492d6bd024ce682676a3ecdcf186f (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:29.781004 15898 tablet_service.cc:1511] Processing CreateTablet for tablet 2b991ff9e213435786d19248864c5cfc (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:29.782564 15824 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf6eca653c94d5bba2406c3006ac72e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:29.784368 15828 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:29.784569 15820 tablet_service.cc:1511] Processing CreateTablet for tablet db755710417246db916d8278741aaff0 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:29.797574 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:29.799907 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:23:29.800949 15950 leader_election.cc:343] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.801402 15972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:29.804055 15950 leader_election.cc:343] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.805912 16034 ts_tablet_manager.cc:1434] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.089s	user 0.001s	sys 0.004s
I20260709 12:23:29.810760 15970 tablet_service.cc:1511] Processing CreateTablet for tablet 25191835faf945ef870143a9ce1b2127 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:29.812408 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:29.814879 15969 tablet_service.cc:1511] Processing CreateTablet for tablet 17a5ecf16d3543828d16fe27e061a42e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:29.818578 16028 tablet_bootstrap.cc:492] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:29.819048 16028 ts_tablet_manager.cc:1403] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.248s	user 0.024s	sys 0.019s
I20260709 12:23:29.821987 16034 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:29.821920 16028 raft_consensus.cc:359] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.825021 15826 tablet_service.cc:1511] Processing CreateTablet for tablet 6b4a53aaee3c41c181784f0c39780d2b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:23:29.822685 15802 leader_election.cc:343] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.826053 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:29.824846 15820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db755710417246db916d8278741aaff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.792682 16032 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.827811 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf6eca653c94d5bba2406c3006ac72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.825484 16028 raft_consensus.cc:385] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.828275 16028 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.824090 15822 tablet_service.cc:1511] Processing CreateTablet for tablet 8b51295f13874e3492f0541da8a1f625 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:29.830255 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b991ff9e213435786d19248864c5cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.832522 15901 tablet_service.cc:1511] Processing CreateTablet for tablet 766b6f7dc34f48babcf3d91d76eecc59 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:29.830766 15822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b51295f13874e3492f0541da8a1f625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.833467 16045 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.833778 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a5ecf16d3543828d16fe27e061a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.838946 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e271b9d1bc8403ba1c9d3e80c36917c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.838867 16028 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.842252 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25191835faf945ef870143a9ce1b2127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.846061 15899 tablet_service.cc:1511] Processing CreateTablet for tablet 25191835faf945ef870143a9ce1b2127 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:29.847347 15899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25191835faf945ef870143a9ce1b2127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.849211 15826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4a53aaee3c41c181784f0c39780d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.850853 15900 tablet_service.cc:1511] Processing CreateTablet for tablet 17a5ecf16d3543828d16fe27e061a42e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:29.852061 15900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a5ecf16d3543828d16fe27e061a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.853947 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506492d6bd024ce682676a3ecdcf186f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.854547 15977 tablet_service.cc:1511] Processing CreateTablet for tablet 8b583c4dfb6f45e9bd36c36a3f0dbff8 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:29.855224 15895 tablet_service.cc:1511] Processing CreateTablet for tablet 8b583c4dfb6f45e9bd36c36a3f0dbff8 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:29.855779 15977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b583c4dfb6f45e9bd36c36a3f0dbff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.856411 15895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b583c4dfb6f45e9bd36c36a3f0dbff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.858255 15978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b6f7dc34f48babcf3d91d76eecc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.861770 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b6f7dc34f48babcf3d91d76eecc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.862437 15819 tablet_service.cc:1511] Processing CreateTablet for tablet ec82df0e9104447ab3e50c2a6968cf7e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:29.863708 15819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82df0e9104447ab3e50c2a6968cf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.871265 16029 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:29.874274 16029 ts_tablet_manager.cc:1403] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.329s	user 0.006s	sys 0.009s
I20260709 12:23:29.873787 16034 tablet_bootstrap.cc:654] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.877365 16029 raft_consensus.cc:359] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.878118 16029 raft_consensus.cc:385] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.878466 16029 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.879320 16029 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.885535 16029 ts_tablet_manager.cc:1434] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:23:29.888329 15818 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8f740585214d0fb73ad203c56cbaaf (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:29.895061 15828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.895107 15823 tablet_service.cc:1511] Processing CreateTablet for tablet a79a04e9fda24da8a4ca30980a0ef796 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:29.899889 15970 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca952dcf3d340e9a816b8ba8f2beb8a (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:29.901662 15970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca952dcf3d340e9a816b8ba8f2beb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.905791 16029 tablet_bootstrap.cc:492] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:29.908843 15822 tablet_service.cc:1511] Processing CreateTablet for tablet 6b08a1f9a245453cafe7fbd2ad9f4b17 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:29.924186 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f740585214d0fb73ad203c56cbaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.926491 16029 tablet_bootstrap.cc:654] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.932448 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79a04e9fda24da8a4ca30980a0ef796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.938650 15820 tablet_service.cc:1511] Processing CreateTablet for tablet 98e0016561fa4f72935bc3bc36cda023 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:29.939684 15822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b08a1f9a245453cafe7fbd2ad9f4b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.895725 15897 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca952dcf3d340e9a816b8ba8f2beb8a (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:29.963302 16032 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:29.970233 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca952dcf3d340e9a816b8ba8f2beb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.970503 16032 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.974910 16034 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:29.975384 16034 ts_tablet_manager.cc:1403] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.028s
I20260709 12:23:29.975513 16028 ts_tablet_manager.cc:1434] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.156s	user 0.026s	sys 0.005s
I20260709 12:23:29.979341 16034 raft_consensus.cc:359] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.980003 16034 raft_consensus.cc:385] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.980278 16034 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.981052 16034 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:29.983362 16034 ts_tablet_manager.cc:1434] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:29.940629 15825 tablet_service.cc:1511] Processing CreateTablet for tablet baa957d5e1074b30a83ccaa548766896 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:29.984248 16034 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:29.984637 15820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e0016561fa4f72935bc3bc36cda023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.989338 15825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa957d5e1074b30a83ccaa548766896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.000226 15824 tablet_service.cc:1511] Processing CreateTablet for tablet 661598743dad4055844a0b0f97c07156 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:29.996599 15819 tablet_service.cc:1511] Processing CreateTablet for tablet 6e7dbc561f4f4c5da63c0d84e92b9871 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:30.005808 15826 tablet_service.cc:1511] Processing CreateTablet for tablet f567175d186f4342b604ea89474a493a (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:30.006896 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661598743dad4055844a0b0f97c07156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.010419 16028 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.013324 15826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f567175d186f4342b604ea89474a493a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.009837 16034 tablet_bootstrap.cc:654] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.013804 16029 tablet_bootstrap.cc:492] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.013893 15827 tablet_service.cc:1511] Processing CreateTablet for tablet 83a3e78f7a344d43ab144f24c55a1e4b (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:30.014366 16029 ts_tablet_manager.cc:1403] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.009s
I20260709 12:23:30.015137 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a3e78f7a344d43ab144f24c55a1e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.017329 15819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e7dbc561f4f4c5da63c0d84e92b9871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.017237 16029 raft_consensus.cc:359] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.018042 16029 raft_consensus.cc:385] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.018329 15818 tablet_service.cc:1511] Processing CreateTablet for tablet afd0e40a445b47b68759b884aff8da86 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:30.019501 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd0e40a445b47b68759b884aff8da86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.018357 16029 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.024869 16029 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.027309 16029 ts_tablet_manager.cc:1434] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:30.029878 16029 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.035372 15734 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.039611 15828 tablet_service.cc:1511] Processing CreateTablet for tablet 58dc18a7b4f448bd8d86eec830a0f612 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:30.046224 15828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58dc18a7b4f448bd8d86eec830a0f612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.047781 16034 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.048784 16034 ts_tablet_manager.cc:1403] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.065s	user 0.003s	sys 0.011s
I20260709 12:23:30.049758 15818 tablet_service.cc:1511] Processing CreateTablet for tablet 636b8846a0e64d48a3b14ad3af01bb3c (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:30.050393 16028 tablet_bootstrap.cc:654] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.050961 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636b8846a0e64d48a3b14ad3af01bb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.052917 16034 raft_consensus.cc:359] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.059842 16034 raft_consensus.cc:385] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.060201 16034 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.056746 15827 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:30.048667 15823 tablet_service.cc:1511] Processing CreateTablet for tablet a5852b04bfec4fa5b2fee780cfb44ce2 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:30.061781 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.063122 15824 tablet_service.cc:1511] Processing CreateTablet for tablet 506492d6bd024ce682676a3ecdcf186f (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:30.061554 16034 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.066066 15822 tablet_service.cc:1511] Processing CreateTablet for tablet 2b991ff9e213435786d19248864c5cfc (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:30.069309 16028 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.069761 16028 ts_tablet_manager.cc:1403] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.002s
I20260709 12:23:30.069865 16034 ts_tablet_manager.cc:1434] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:23:30.071487 15820 tablet_service.cc:1511] Processing CreateTablet for tablet 766b6f7dc34f48babcf3d91d76eecc59 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:30.058233 16029 tablet_bootstrap.cc:654] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.072855 16028 raft_consensus.cc:359] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.074345 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506492d6bd024ce682676a3ecdcf186f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.081028 16028 raft_consensus.cc:385] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.082310 16028 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.082369 15819 tablet_service.cc:1511] Processing CreateTablet for tablet 25191835faf945ef870143a9ce1b2127 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:30.083163 15825 tablet_service.cc:1511] Processing CreateTablet for tablet 17a5ecf16d3543828d16fe27e061a42e (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:30.083323 16028 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.084456 15826 tablet_service.cc:1511] Processing CreateTablet for tablet 8b583c4dfb6f45e9bd36c36a3f0dbff8 (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:30.084777 15820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b6f7dc34f48babcf3d91d76eecc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.084888 16034 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.085791 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5852b04bfec4fa5b2fee780cfb44ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.086530 15822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b991ff9e213435786d19248864c5cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.089527 15825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a5ecf16d3543828d16fe27e061a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.090565 16028 ts_tablet_manager.cc:1434] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:30.091921 16028 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.092892 15826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b583c4dfb6f45e9bd36c36a3f0dbff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.096138 16034 tablet_bootstrap.cc:654] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.105712 16028 tablet_bootstrap.cc:654] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.112211 15818 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca952dcf3d340e9a816b8ba8f2beb8a (DEFAULT_TABLE table=test-workload [id=4947ab1c8f1441c29eae400ebca10994]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:30.114450 16032 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.114902 16032 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.119750 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.120584 15838 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.122113 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.122200 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.122830 15912 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.123050 16052 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.123457 16052 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.118238 15819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25191835faf945ef870143a9ce1b2127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.123761 16052 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.116940 16032 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.126705 16045 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.140913 16045 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.143551 16045 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.145193 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.145592 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:30.145978 15912 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:30.147274 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:30.149153 16045 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.163115 15818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca952dcf3d340e9a816b8ba8f2beb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.172307 16052 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.183310 16052 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.186517 16028 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.186889 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:23:30.187844 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:30.188611 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:30.192219 15912 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.192830 15838 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.190791 16045 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.197232 16028 ts_tablet_manager.cc:1403] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.000s
I20260709 12:23:30.198812 15912 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.198508 15838 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.200255 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.198794 16034 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.201545 16052 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.201844 16034 ts_tablet_manager.cc:1403] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.029s
I20260709 12:23:30.202793 16029 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.202941 16052 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:30.203264 16029 ts_tablet_manager.cc:1403] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.174s	user 0.008s	sys 0.010s
I20260709 12:23:30.203773 16052 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.204665 16034 raft_consensus.cc:359] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.205389 16034 raft_consensus.cc:385] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.205677 16034 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.206058 16029 raft_consensus.cc:359] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.206744 16029 raft_consensus.cc:385] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.206394 16034 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.207068 16029 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.206451 16028 raft_consensus.cc:359] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.207798 16028 raft_consensus.cc:385] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.207883 16029 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.208336 16028 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.210171 16029 ts_tablet_manager.cc:1434] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:23:30.209554 16028 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.211404 16029 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.212867 16028 ts_tablet_manager.cc:1434] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:23:30.213968 16028 tablet_bootstrap.cc:492] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.217962 16029 tablet_bootstrap.cc:654] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.208639 16034 ts_tablet_manager.cc:1434] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:23:30.219376 16034 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.225497 16034 tablet_bootstrap.cc:654] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.226686 15734 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.235641 16028 tablet_bootstrap.cc:654] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.237685 16029 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.238312 16029 ts_tablet_manager.cc:1403] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 12:23:30.237675 16034 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.240233 16034 ts_tablet_manager.cc:1403] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:23:30.242985 16034 raft_consensus.cc:359] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.243791 16034 raft_consensus.cc:385] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.242874 16029 raft_consensus.cc:359] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.244102 16034 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.244642 16029 raft_consensus.cc:385] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.245213 16029 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.245095 16034 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.247466 16034 ts_tablet_manager.cc:1434] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:23:30.248523 16034 tablet_bootstrap.cc:492] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.249226 16029 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.254423 16034 tablet_bootstrap.cc:654] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.254951 16029 ts_tablet_manager.cc:1434] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:23:30.256071 16029 tablet_bootstrap.cc:492] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.259665 16033 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.260133 16033 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.262259 16033 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.263283 16052 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.263736 16052 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.265797 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.265930 16029 tablet_bootstrap.cc:654] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.266393 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:30.266774 16028 tablet_bootstrap.cc:492] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.267213 16028 ts_tablet_manager.cc:1403] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.011s
I20260709 12:23:30.268262 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:30.269888 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:30.270025 16028 raft_consensus.cc:359] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.270702 16028 raft_consensus.cc:385] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:30.270800 15879 leader_election.cc:343] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.271021 16028 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.271855 16028 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.274014 16028 ts_tablet_manager.cc:1434] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:23:30.275102 16028 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.275151 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.275792 15912 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.277308 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.278103 16032 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.278470 16032 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.278863 16032 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.281533 16028 tablet_bootstrap.cc:654] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.288314 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.289127 15838 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.292371 16028 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.292821 16028 ts_tablet_manager.cc:1403] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:23:30.272250 16052 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.294730 16033 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.295104 16033 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.295424 16033 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.295502 16028 raft_consensus.cc:359] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.296223 16028 raft_consensus.cc:385] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.296523 16028 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.297403 16028 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.299875 16028 ts_tablet_manager.cc:1434] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:23:30.300815 16028 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.306749 16028 tablet_bootstrap.cc:654] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.326512 16032 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.330224 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:30.330977 15838 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.343443 16033 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.355232 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:30.355983 15912 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.367424 16074 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.368078 16074 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.370023 15912 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.371552 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.372776 16052 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.373410 16052 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:30.374483 16052 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.378942 16032 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.382670 15838 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.388618 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:30.389410 15837 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.397672 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:30.399689 15876 leader_election.cc:343] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.402591 15837 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:30.402935 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:30.404018 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:23:30.404803 15879 leader_election.cc:343] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.405534 16033 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.406224 16033 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.406762 16033 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:30.407892 16033 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.409087 15731 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:30.412564 15939 tablet.cc:2406] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:30.414300 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:30.415750 15879 leader_election.cc:343] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.416312 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:30.417339 16074 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.417497 16076 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.422555 16034 tablet_bootstrap.cc:492] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.423012 16034 ts_tablet_manager.cc:1403] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.175s	user 0.045s	sys 0.101s
I20260709 12:23:30.423655 16028 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.424072 16028 ts_tablet_manager.cc:1403] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.123s	user 0.042s	sys 0.076s
I20260709 12:23:30.424731 16029 tablet_bootstrap.cc:492] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.425259 16029 ts_tablet_manager.cc:1403] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.169s	user 0.050s	sys 0.106s
I20260709 12:23:30.425889 16034 raft_consensus.cc:359] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.426637 16034 raft_consensus.cc:385] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.426465 16028 raft_consensus.cc:359] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.427001 16034 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.427158 16028 raft_consensus.cc:385] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.427495 16028 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.427867 16034 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.428190 16028 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.428541 16029 raft_consensus.cc:359] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.429487 16029 raft_consensus.cc:385] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.430029 16029 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.430400 16028 ts_tablet_manager.cc:1434] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:30.430454 16034 ts_tablet_manager.cc:1434] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:30.431332 16028 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.430940 16029 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.431509 16034 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.433506 16029 ts_tablet_manager.cc:1434] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:30.434638 16029 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.438279 16028 tablet_bootstrap.cc:654] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.438314 16034 tablet_bootstrap.cc:654] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.440804 16029 tablet_bootstrap.cc:654] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.450371 16034 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.450870 16034 ts_tablet_manager.cc:1403] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:23:30.452944 16029 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.453437 16029 ts_tablet_manager.cc:1403] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:23:30.453850 16028 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.453500 16034 raft_consensus.cc:359] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.454227 16034 raft_consensus.cc:385] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.454296 16028 ts_tablet_manager.cc:1403] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:23:30.454615 16034 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.455384 16034 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.456666 16052 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.456507 16029 raft_consensus.cc:359] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.457288 16029 raft_consensus.cc:385] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.457151 16052 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.457163 16028 raft_consensus.cc:359] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.457760 16029 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.458002 16028 raft_consensus.cc:385] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.458353 16028 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.458837 16029 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.459241 16052 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.459414 16028 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.460273 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.460703 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:30.462038 15952 leader_election.cc:343] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.463709 15950 leader_election.cc:343] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.464249 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:30.465380 16052 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.465813 16028 ts_tablet_manager.cc:1434] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:30.463694 16029 ts_tablet_manager.cc:1434] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 12:23:30.466456 16034 ts_tablet_manager.cc:1434] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:30.466665 16028 tablet_bootstrap.cc:492] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.467183 16029 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.470528 16034 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.472302 16028 tablet_bootstrap.cc:654] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.472787 16029 tablet_bootstrap.cc:654] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.476488 16034 tablet_bootstrap.cc:654] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.479701 16052 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.487800 16034 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.488384 16034 ts_tablet_manager.cc:1403] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:23:30.491798 16034 raft_consensus.cc:359] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.492643 16034 raft_consensus.cc:385] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.492919 16034 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.493711 16034 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.502106 15734 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.503155 16034 ts_tablet_manager.cc:1434] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:23:30.506997 16034 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.514426 16034 tablet_bootstrap.cc:654] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.519673 16053 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.520253 16053 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.522505 16053 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.526226 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.527061 15838 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.529255 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.530372 16032 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.532358 16032 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.532794 16032 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.533241 16032 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.535822 16034 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.536293 16034 ts_tablet_manager.cc:1403] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.004s
I20260709 12:23:30.540529 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.538942 16034 raft_consensus.cc:359] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.541390 15913 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.541649 16034 raft_consensus.cc:385] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.541982 16034 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.543951 16045 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.544801 16053 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.544585 16045 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.545290 16053 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.547209 16045 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.548036 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:30.548864 15988 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:30.543967 16034 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.550567 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.551632 16045 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.552095 16045 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.552493 16034 ts_tablet_manager.cc:1434] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 12:23:30.552525 16045 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.553992 16034 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.558569 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.559392 15913 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:30.562309 16034 tablet_bootstrap.cc:654] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.567735 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.568603 15837 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.570132 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.571215 16052 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.571650 16052 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.572026 16052 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.574327 16034 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.574975 16034 ts_tablet_manager.cc:1403] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 12:23:30.578734 16034 raft_consensus.cc:359] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.579669 16034 raft_consensus.cc:385] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.580085 16034 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.581143 16034 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.582852 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.583667 15913 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.580914 16053 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.590708 16034 ts_tablet_manager.cc:1434] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:23:30.594830 16045 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.597493 16034 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.605520 16034 tablet_bootstrap.cc:654] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.607920 16053 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.618443 16034 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.623739 16090 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.625700 16034 ts_tablet_manager.cc:1403] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.005s
I20260709 12:23:30.625610 16090 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.627787 16090 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.628520 16034 raft_consensus.cc:359] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.629220 16034 raft_consensus.cc:385] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.629314 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:30.629565 16034 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
W20260709 12:23:30.630565 15803 leader_election.cc:343] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.632371 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:30.634152 15802 leader_election.cc:343] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.634708 15802 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:30.635609 16090 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.639043 16090 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.639598 16090 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.642309 16090 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.644363 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:30.645744 15803 leader_election.cc:343] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.631296 16034 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.648447 16034 ts_tablet_manager.cc:1434] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:23:30.649686 16034 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.649499 16052 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.652402 16095 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.652689 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:30.653280 15838 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.658999 16034 tablet_bootstrap.cc:654] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.666380 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:30.667639 15802 leader_election.cc:343] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.668074 15802 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:30.672328 16034 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.672976 16034 ts_tablet_manager.cc:1403] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.010s
I20260709 12:23:30.676225 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:30.676925 15988 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.677603 16096 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.685259 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:30.685962 15912 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.692117 15988 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:30.676208 16034 raft_consensus.cc:359] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.699926 16034 raft_consensus.cc:385] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.699865 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.700379 16034 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.700719 16096 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.701223 16096 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:30.702040 16052 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.692869 16045 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.694171 16032 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.702179 16096 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } }
I20260709 12:23:30.704419 16032 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.697134 15838 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.704588 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:30.705221 15913 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.705798 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:30.706368 15911 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.705190 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:30.709328 15837 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.710837 16029 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.711272 16029 ts_tablet_manager.cc:1403] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.244s	user 0.085s	sys 0.097s
I20260709 12:23:30.712996 15911 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.713969 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.714241 15952 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.714862 16052 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.715080 16095 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.715197 15837 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.715649 16095 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:30.715314 16052 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.717010 15913 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.716686 16095 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.718182 16029 raft_consensus.cc:359] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.718607 16053 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.718825 16029 raft_consensus.cc:385] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.719111 16029 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.719166 16052 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.719074 16053 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:30.720175 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.701274 16034 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.720207 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.721064 15912 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:30.721138 16053 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.722982 16034 ts_tablet_manager.cc:1434] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:23:30.723182 16028 tablet_bootstrap.cc:492] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.723630 16028 ts_tablet_manager.cc:1403] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.257s	user 0.060s	sys 0.114s
I20260709 12:23:30.723716 16034 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.721530 15837 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.725530 16029 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.727851 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.728674 16032 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.728626 16028 raft_consensus.cc:359] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.729094 16032 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.729359 16028 raft_consensus.cc:385] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.729444 16032 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.729643 16028 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.730327 16028 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.732206 15913 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.733829 16028 ts_tablet_manager.cc:1434] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:23:30.734651 16028 tablet_bootstrap.cc:492] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.734879 16029 ts_tablet_manager.cc:1434] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:23:30.735800 16029 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.749475 16032 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.751224 15733 catalog_manager.cc:5697] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.752661 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:30.753284 15913 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.753835 16034 tablet_bootstrap.cc:654] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.753062 15733 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.756371 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:30.756937 15837 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.758625 16028 tablet_bootstrap.cc:654] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.758843 16029 tablet_bootstrap.cc:654] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.762310 15734 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.763183 16034 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.763618 16034 ts_tablet_manager.cc:1403] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:23:30.766119 16034 raft_consensus.cc:359] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.766746 16034 raft_consensus.cc:385] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.767022 16034 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.767771 16034 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.769991 16034 ts_tablet_manager.cc:1434] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:30.770814 16034 tablet_bootstrap.cc:492] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.778021 16032 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.782192 16034 tablet_bootstrap.cc:654] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.782888 15837 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.785043 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.786172 16032 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.786763 16032 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:30.788772 16032 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.792434 15913 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:30.803872 16029 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:30.804323 16029 ts_tablet_manager.cc:1403] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.022s
I20260709 12:23:30.804517 16028 tablet_bootstrap.cc:492] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.805071 16028 ts_tablet_manager.cc:1403] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.030s
I20260709 12:23:30.806892 16029 raft_consensus.cc:359] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.807554 16029 raft_consensus.cc:385] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.807830 16029 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.808041 16053 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.808581 16029 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.808370 16028 raft_consensus.cc:359] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.809584 16028 raft_consensus.cc:385] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.809942 16028 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.810601 16029 ts_tablet_manager.cc:1434] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:23:30.810781 16028 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.813750 16028 ts_tablet_manager.cc:1434] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:30.813886 16029 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:30.814851 16028 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.817391 15732 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.821942 16034 tablet_bootstrap.cc:492] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.822225 16028 tablet_bootstrap.cc:654] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.822659 16034 ts_tablet_manager.cc:1403] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.003s
I20260709 12:23:30.824427 16033 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.824883 16033 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.826104 16034 raft_consensus.cc:359] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.826947 16033 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.827036 16034 raft_consensus.cc:385] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.827600 16034 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.828507 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:30.829241 15988 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:30.828522 16034 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.830742 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.831339 15838 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:30.832022 16034 ts_tablet_manager.cc:1434] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:23:30.833326 16034 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.833527 16029 tablet_bootstrap.cc:654] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.838286 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:30.840416 16034 tablet_bootstrap.cc:654] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.848347 16033 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.848842 16033 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.849306 16033 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.852166 16028 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:30.852417 16034 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.852608 16028 ts_tablet_manager.cc:1403] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.012s
I20260709 12:23:30.852897 16034 ts_tablet_manager.cc:1403] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:23:30.855600 16028 raft_consensus.cc:359] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.855779 16034 raft_consensus.cc:359] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.856287 16028 raft_consensus.cc:385] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.856627 16034 raft_consensus.cc:385] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.856611 16028 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.857112 16034 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.857460 16028 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.857851 16034 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:30.858484 15879 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.859637 16028 ts_tablet_manager.cc:1434] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:23:30.860164 16034 ts_tablet_manager.cc:1434] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:30.860481 16028 tablet_bootstrap.cc:492] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:30.861927 16096 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.862519 16096 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.864548 16034 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.866272 16028 tablet_bootstrap.cc:654] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.866369 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.868820 16096 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:30.870224 15802 leader_election.cc:343] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.875824 16052 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.878139 16034 tablet_bootstrap.cc:654] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.882843 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:30.884600 15803 leader_election.cc:343] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.885142 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:30.886416 16090 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.891774 16034 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.892416 16034 ts_tablet_manager.cc:1403] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.000s
I20260709 12:23:30.900312 16034 raft_consensus.cc:359] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.901262 16034 raft_consensus.cc:385] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.901659 16034 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.902638 16034 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.905331 16034 ts_tablet_manager.cc:1434] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:23:30.906514 16034 tablet_bootstrap.cc:492] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.914161 16034 tablet_bootstrap.cc:654] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.930681 16034 tablet_bootstrap.cc:492] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:30.931468 16034 ts_tablet_manager.cc:1403] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.002s
I20260709 12:23:30.933787 16096 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.934134 16053 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.934624 16053 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.938028 16052 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.937672 16034 raft_consensus.cc:359] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.938735 16034 raft_consensus.cc:385] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.938498 16052 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.939191 16034 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.940248 16034 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.941546 16090 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.942116 16090 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.942602 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.943424 15838 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:30.936717 16053 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.945941 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.947113 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.948208 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:23:30.948958 15802 leader_election.cc:343] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.949576 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:30.949829 16090 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:30.950373 15988 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:30.952165 16034 ts_tablet_manager.cc:1434] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:30.951944 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:30.953492 16034 tablet_bootstrap.cc:492] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:30.954437 16090 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.954962 16090 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.955386 16090 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.957472 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:30.958271 15837 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:30.952826 15952 leader_election.cc:343] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.959794 16052 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:30.959887 15950 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:30.960597 16052 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.961174 16095 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.961632 16095 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.962047 16095 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.962733 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.934410 16096 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.966912 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:30.967756 16096 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:30.968683 15802 leader_election.cc:343] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.969046 15952 leader_election.cc:343] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.968715 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:30.971710 15803 leader_election.cc:343] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.972275 15803 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:30.976492 16095 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.977095 16052 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.981362 16052 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.980836 16034 tablet_bootstrap.cc:654] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.977602 16096 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.987298 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:30.988137 15837 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.991910 16033 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:30.994791 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:23:30.996766 15952 leader_election.cc:343] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.997591 16095 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.010113 16052 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.009020 15837 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:31.012971 15950 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:31.013016 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.005213 16076 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.016736 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:31.017299 15988 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.017418 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.018205 15838 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.024487 15988 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:31.025688 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:31.026491 16076 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.027034 16029 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.027580 16029 ts_tablet_manager.cc:1403] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.214s	user 0.050s	sys 0.098s
I20260709 12:23:31.031077 16029 raft_consensus.cc:359] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.014206 16095 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.031738 16033 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.032620 16095 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:31.036988 15838 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:30.997859 16090 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.038127 16096 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.041149 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.041237 16096 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.042385 16034 tablet_bootstrap.cc:492] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
W20260709 12:23:31.042526 15952 leader_election.cc:343] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.042794 16034 ts_tablet_manager.cc:1403] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.000s
I20260709 12:23:31.043648 16096 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.044628 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:31.045748 16052 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.037902 16095 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:31.045948 15803 leader_election.cc:343] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.047220 16076 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:31.037966 16028 tablet_bootstrap.cc:492] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.031840 16029 raft_consensus.cc:385] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.047834 16029 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.047996 16028 ts_tablet_manager.cc:1403] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.188s	user 0.061s	sys 0.105s
I20260709 12:23:31.048092 16076 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.045923 16090 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.050643 16029 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.052757 16029 ts_tablet_manager.cc:1434] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.005s
I20260709 12:23:31.053565 16029 tablet_bootstrap.cc:492] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.054046 16034 raft_consensus.cc:359] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.054683 16034 raft_consensus.cc:385] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.054948 16034 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.056032 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.056401 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.057425 15913 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.056671 16028 raft_consensus.cc:359] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.057894 16028 raft_consensus.cc:385] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.058198 16028 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
W20260709 12:23:31.058431 15802 leader_election.cc:343] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.058815 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.059011 15837 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.059732 16029 tablet_bootstrap.cc:654] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.058816 16028 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.061335 16096 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.061954 16096 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.062386 16028 ts_tablet_manager.cc:1434] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:23:31.062409 16096 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.063345 16028 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.047555 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:31.064970 15988 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.065538 16096 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.066336 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:31.067649 15802 leader_election.cc:343] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.069350 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:31.069876 16028 tablet_bootstrap.cc:654] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.071674 15913 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:31.072803 15802 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:31.073151 15988 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:31.073665 16096 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.074211 16096 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:31.075294 16096 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:31.079670 15803 leader_election.cc:343] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.080147 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.082134 16045 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.081894 16028 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.082927 16028 ts_tablet_manager.cc:1403] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 12:23:31.083369 15734 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.084928 16034 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.085564 16028 raft_consensus.cc:359] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.086395 16028 raft_consensus.cc:385] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.086730 16028 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.087049 16034 ts_tablet_manager.cc:1434] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.001s
I20260709 12:23:31.087690 16028 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.088164 16034 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.089694 16028 ts_tablet_manager.cc:1434] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:31.092965 16028 tablet_bootstrap.cc:492] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.097072 16096 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.100459 16028 tablet_bootstrap.cc:654] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.107424 16034 tablet_bootstrap.cc:654] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.110087 15837 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:31.110193 15734 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.112764 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:31.117264 16029 tablet_bootstrap.cc:492] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.117848 16029 ts_tablet_manager.cc:1403] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.035s
I20260709 12:23:31.118597 16095 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.119433 16095 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:31.120553 16095 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.121932 15732 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.126327 16029 raft_consensus.cc:359] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.126951 16029 raft_consensus.cc:385] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.127120 16029 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.127540 16029 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.128911 16029 ts_tablet_manager.cc:1434] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 12:23:31.129575 16029 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.142745 16052 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.144109 16029 tablet_bootstrap.cc:654] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.144714 16028 tablet_bootstrap.cc:492] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.145219 16028 ts_tablet_manager.cc:1403] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.002s
I20260709 12:23:31.150256 16028 raft_consensus.cc:359] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.150954 16028 raft_consensus.cc:385] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.151243 16028 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.152040 16028 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.154036 16028 ts_tablet_manager.cc:1434] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:31.160204 16076 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.161154 16076 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.161654 16045 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.162956 16076 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.166105 16028 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.184377 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.185081 15837 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:31.186177 15876 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:31.186988 16076 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.187342 16076 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.187664 16076 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.193189 16029 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.193833 16029 ts_tablet_manager.cc:1403] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.012s
I20260709 12:23:31.196128 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:31.197420 15879 leader_election.cc:343] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.197332 16029 raft_consensus.cc:359] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.198391 16029 raft_consensus.cc:385] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.198616 16045 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.198745 16029 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.199126 16045 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.199914 16029 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.201155 16045 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.200934 16076 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.202320 16029 ts_tablet_manager.cc:1434] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:31.203238 16029 tablet_bootstrap.cc:492] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.202864 15734 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.203701 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.204319 15912 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:31.205431 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:23:31.205657 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:23:31.207213 15879 leader_election.cc:343] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.207780 16052 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.208232 16052 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.211061 16034 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.211122 16029 tablet_bootstrap.cc:654] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.211597 16034 ts_tablet_manager.cc:1403] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.006s
I20260709 12:23:31.212016 16052 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.213027 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:31.213294 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:31.213539 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.213671 15987 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:31.214148 15835 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:31.215334 16096 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.215708 16096 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.216038 16096 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.216593 16076 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.217351 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.218124 15912 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:31.219520 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:31.220603 16094 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.221987 16094 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.222286 16094 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.222586 16094 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.214170 16034 raft_consensus.cc:359] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.224752 16034 raft_consensus.cc:385] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.225263 16034 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.226109 16034 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.230556 16034 ts_tablet_manager.cc:1434] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:23:31.232228 16096 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.233515 16034 tablet_bootstrap.cc:492] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.234910 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.235313 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:31.235541 15911 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.236186 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.234838 16094 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.236821 15837 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.237461 15986 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:31.237802 16028 tablet_bootstrap.cc:654] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.241936 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.242678 15838 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:23:31.242558 15911 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:31.245107 16094 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.245256 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.246105 16045 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.246639 16045 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:31.247453 16045 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.252038 16096 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.246105 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.253630 15911 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:23:31.254554 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:31.255285 16052 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.261765 15837 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:31.263520 15876 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.264899 16076 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.265745 16076 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:31.266822 16076 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.269596 16034 tablet_bootstrap.cc:654] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.273788 16028 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.274199 16028 ts_tablet_manager.cc:1403] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.012s
I20260709 12:23:31.276050 15734 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.277105 16028 raft_consensus.cc:359] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.277694 16028 raft_consensus.cc:385] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.277943 16028 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.278535 16028 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.290169 16028 ts_tablet_manager.cc:1434] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:31.292343 16029 tablet_bootstrap.cc:492] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.292999 16029 ts_tablet_manager.cc:1403] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.026s
I20260709 12:23:31.295923 16029 raft_consensus.cc:359] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.296651 16029 raft_consensus.cc:385] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.296945 16029 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.298038 16028 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.297693 16029 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.299908 16029 ts_tablet_manager.cc:1434] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:31.300280 16034 tablet_bootstrap.cc:492] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.300689 16034 ts_tablet_manager.cc:1403] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.017s
I20260709 12:23:31.300738 16029 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.303537 16034 raft_consensus.cc:359] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.303491 15732 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.320432 16034 raft_consensus.cc:385] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.321015 16034 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.321219 16028 tablet_bootstrap.cc:654] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.321756 16034 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.323947 16029 tablet_bootstrap.cc:654] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.312422 16052 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.324512 16094 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.324836 16052 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.327008 16052 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.328416 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.329305 16052 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.329818 16052 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.331055 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.331652 15838 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:31.331712 15952 leader_election.cc:343] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.333098 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.333877 15836 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:31.335407 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:31.334381 16034 ts_tablet_manager.cc:1434] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.016s
I20260709 12:23:31.336560 16094 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.336915 16094 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.336642 16053 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.337177 16034 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.337266 16094 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.337808 15988 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.340701 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:31.341554 16053 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.341919 16053 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.342252 16053 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.344034 16034 tablet_bootstrap.cc:654] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.344148 16094 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.347407 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.348074 15838 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.353478 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:23:31.355103 15952 leader_election.cc:343] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.357977 16094 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.363794 16094 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.364804 16034 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.365257 16034 ts_tablet_manager.cc:1403] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.011s
I20260709 12:23:31.367236 16034 raft_consensus.cc:359] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.367758 16034 raft_consensus.cc:385] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.368047 16034 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.369237 16032 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.375031 16034 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.376732 16034 ts_tablet_manager.cc:1434] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:23:31.377645 16034 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.383330 16034 tablet_bootstrap.cc:654] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.383759 15838 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:31.385083 16028 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.386765 16028 ts_tablet_manager.cc:1403] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.018s
I20260709 12:23:31.397477 16028 raft_consensus.cc:359] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.399039 16028 raft_consensus.cc:385] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.399394 16028 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.400520 16028 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.404065 16028 ts_tablet_manager.cc:1434] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:23:31.405750 16052 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.407033 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.407945 16028 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
W20260709 12:23:31.408458 15952 leader_election.cc:343] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.408258 16053 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.409369 16034 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.409799 16034 ts_tablet_manager.cc:1403] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:23:31.411173 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.411813 15836 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.412393 16034 raft_consensus.cc:359] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.413077 16034 raft_consensus.cc:385] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.413348 16034 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.414045 16034 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.416515 16076 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.416985 16076 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.418497 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:31.418992 16076 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.419330 16094 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.419989 16094 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:31.421387 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:31.421307 16028 tablet_bootstrap.cc:654] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.423156 16034 ts_tablet_manager.cc:1434] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:31.423844 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.424742 15838 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:31.426003 15876 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.427100 16076 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.428614 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.420795 16094 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:31.429812 15952 leader_election.cc:343] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.430510 16053 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.434072 16076 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.434727 15836 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:31.435848 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:31.437554 16034 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.439311 16052 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.439785 16052 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:31.442550 16029 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.442962 16029 ts_tablet_manager.cc:1403] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.000s
I20260709 12:23:31.444396 16034 tablet_bootstrap.cc:654] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.446753 16052 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.447655 16029 raft_consensus.cc:359] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.448549 16029 raft_consensus.cc:385] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.448892 16029 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.467461 16029 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.475330 16076 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.474936 15734 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.474990 16029 ts_tablet_manager.cc:1434] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:23:31.478313 16029 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.483807 16028 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.484320 16028 ts_tablet_manager.cc:1403] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.027s
I20260709 12:23:31.487365 16028 raft_consensus.cc:359] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.488054 16028 raft_consensus.cc:385] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.488386 16028 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.489197 16028 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.490947 16028 ts_tablet_manager.cc:1434] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:31.491815 16028 tablet_bootstrap.cc:492] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.495931 16029 tablet_bootstrap.cc:654] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.500010 16028 tablet_bootstrap.cc:654] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.502657 16034 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.503190 16034 ts_tablet_manager.cc:1403] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.027s
I20260709 12:23:31.506587 16034 raft_consensus.cc:359] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.507457 16034 raft_consensus.cc:385] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.507786 16034 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.507714 15734 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.508697 16034 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.510648 16118 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.520715 16034 ts_tablet_manager.cc:1434] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:23:31.523892 16034 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.536664 16045 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.539965 16034 tablet_bootstrap.cc:654] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.543089 16045 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.549413 16045 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.550823 16052 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.551426 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.551334 16052 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.553004 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:31.554819 16028 tablet_bootstrap.cc:492] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.556124 16028 ts_tablet_manager.cc:1403] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.037s
I20260709 12:23:31.557080 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:31.557613 15803 leader_election.cc:343] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.557663 15836 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:31.558811 15802 leader_election.cc:343] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.559152 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:31.559216 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.560582 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.561201 16094 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.561555 16094 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.561892 16094 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:31.561956 15952 leader_election.cc:343] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.562590 16045 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.564875 16029 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.560773 16053 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:31.565331 16029 ts_tablet_manager.cc:1403] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.015s
I20260709 12:23:31.566005 16052 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.568125 16029 raft_consensus.cc:359] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.572933 16094 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.575531 16096 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.580847 16096 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.582015 16096 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.583734 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.585137 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:31.572867 16029 raft_consensus.cc:385] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.587742 16029 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.600845 16094 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:31.600993 15803 leader_election.cc:343] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:31.600976 15952 leader_election.cc:343] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.602905 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.604319 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.604885 15836 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.606983 16029 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:31.608246 15802 leader_election.cc:343] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.606184 16028 raft_consensus.cc:359] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.608685 15802 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.609858 16028 raft_consensus.cc:385] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.610303 16028 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.610433 16045 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.610414 16094 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.611390 16028 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.613711 16045 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.615711 16029 ts_tablet_manager.cc:1434] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:23:31.607810 16096 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.620997 16029 tablet_bootstrap.cc:492] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.626510 16028 ts_tablet_manager.cc:1434] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.001s
I20260709 12:23:31.627656 16028 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.642038 15836 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:31.643538 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:31.644958 16052 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.645614 16052 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:31.646672 16052 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.653728 15910 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.669781 16094 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:31.685160 16034 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.685760 16034 ts_tablet_manager.cc:1403] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.162s	user 0.063s	sys 0.064s
I20260709 12:23:31.689363 16094 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:31.698690 15734 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.707048 16034 raft_consensus.cc:359] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.707715 16034 raft_consensus.cc:385] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.708000 16034 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.717983 16052 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.718629 16052 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.723903 16033 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.724391 16033 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.726101 16028 tablet_bootstrap.cc:654] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.727329 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.722748 16052 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.739437 16034 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.740914 16029 tablet_bootstrap.cc:654] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.742909 16034 ts_tablet_manager.cc:1434] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.002s
I20260709 12:23:31.743621 16034 tablet_bootstrap.cc:492] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.746445 15988 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.750782 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.751626 15834 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:31.751921 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:31.753319 15879 leader_election.cc:343] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.753971 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.751709 16033 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.743173 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.754784 16118 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.757117 16118 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.758349 16118 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:31.765231 16160 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 12:23:31.774598 15835 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:31.772938 16033 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:31.786058 15950 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:31.787415 16118 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.792289 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.792873 15835 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.794703 16118 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.795308 16033 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.796590 16032 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.797268 16034 tablet_bootstrap.cc:654] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.797863 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:23:31.799729 15879 leader_election.cc:343] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.802428 16028 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.802860 16028 ts_tablet_manager.cc:1403] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.015s
I20260709 12:23:31.803493 16029 tablet_bootstrap.cc:492] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.803995 16029 ts_tablet_manager.cc:1403] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.015s
I20260709 12:23:31.806715 16029 raft_consensus.cc:359] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.807351 16029 raft_consensus.cc:385] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.807943 16029 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.809669 16029 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.811712 16029 ts_tablet_manager.cc:1434] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:31.811539 16028 raft_consensus.cc:359] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.812263 16028 raft_consensus.cc:385] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.812556 16028 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.812636 16029 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:31.813330 16028 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.816707 16028 ts_tablet_manager.cc:1434] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:23:31.821648 16029 tablet_bootstrap.cc:654] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.822369 16162 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.831204 16028 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.839757 16034 tablet_bootstrap.cc:492] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.840385 16034 ts_tablet_manager.cc:1403] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.012s
I20260709 12:23:31.843232 16034 raft_consensus.cc:359] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.843393 16032 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.843990 16034 raft_consensus.cc:385] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.844240 16028 tablet_bootstrap.cc:654] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.844379 16034 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.844146 16032 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.845455 16034 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.847998 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.848223 16032 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.848811 15837 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:31.850647 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.852702 16034 ts_tablet_manager.cc:1434] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:23:31.852492 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:31.853556 16032 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.854043 16032 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.854382 16032 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:31.853489 15952 leader_election.cc:343] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.857298 16034 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.861195 16032 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.863214 16034 tablet_bootstrap.cc:654] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.865660 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:31.866062 16032 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.866314 15837 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.869359 16162 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.875267 15837 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:31.877583 16028 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:31.878037 16028 ts_tablet_manager.cc:1403] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 12:23:31.878531 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:31.879729 16094 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.881007 16094 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.881464 16094 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:31.881403 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:31.880892 16162 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.882341 16094 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.882947 16162 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.885869 16162 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:31.886070 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:31.886785 15952 leader_election.cc:343] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.886641 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:31.887490 15803 leader_election.cc:343] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:31.888414 15802 leader_election.cc:343] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.888365 16028 raft_consensus.cc:359] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.889268 16028 raft_consensus.cc:385] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.889093 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.889658 16028 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.890501 16162 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.890627 16028 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.893211 16028 ts_tablet_manager.cc:1434] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:23:31.902647 16095 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.904402 15910 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.906746 16034 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:31.907933 16034 ts_tablet_manager.cc:1403] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.000s
W20260709 12:23:31.909668 15952 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.911828 16034 raft_consensus.cc:359] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.912544 16034 raft_consensus.cc:385] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.912887 16034 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.913689 16053 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.915882 16034 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.918133 16034 ts_tablet_manager.cc:1434] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:31.919421 16034 tablet_bootstrap.cc:492] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:31.894325 16028 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:31.943189 16094 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.943861 16094 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.950812 15835 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:31.953426 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:31.960148 15835 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:31.960691 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:31.961813 15911 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:31.963474 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:31.972227 16033 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.973022 16034 tablet_bootstrap.cc:654] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.972873 16033 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:31.980815 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:31.981751 16052 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.980386 16033 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.984093 16029 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:31.984520 16029 ts_tablet_manager.cc:1403] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.172s	user 0.025s	sys 0.100s
I20260709 12:23:31.983911 15732 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.996855 16095 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.997412 16095 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:31.999370 16095 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:31.999284 16029 raft_consensus.cc:359] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.000010 16029 raft_consensus.cc:385] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.000335 16029 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.983261 16094 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:32.001163 16029 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.010035 16029 ts_tablet_manager.cc:1434] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:23:32.046582 16029 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.009912 16118 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.010087 16076 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.048010 16118 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.048574 16076 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.050534 16076 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.007704 16052 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.059264 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.059767 15838 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:32.004379 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.061765 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:32.064021 15879 leader_election.cc:343] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.067970 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.068540 15838 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.070374 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:23:32.064965 15952 leader_election.cc:343] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.073729 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.074134 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:23:32.076144 15876 leader_election.cc:343] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.076426 16076 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.077010 15876 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.077790 16033 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.077318 16076 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.078577 16076 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.079663 16028 tablet_bootstrap.cc:654] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.080024 16118 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.076361 16052 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.081063 16052 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.081223 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.081476 16052 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:32.082361 15879 leader_election.cc:343] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.086506 16076 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.087757 16029 tablet_bootstrap.cc:654] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.088888 16076 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.090040 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:23:32.091367 15879 leader_election.cc:343] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.092767 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.093346 15836 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.094306 16029 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.094774 16029 ts_tablet_manager.cc:1403] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.048s	user 0.001s	sys 0.010s
I20260709 12:23:32.097368 16029 raft_consensus.cc:359] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.098043 16029 raft_consensus.cc:385] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.098349 16029 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.099013 16029 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.099962 16052 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.101806 16029 ts_tablet_manager.cc:1434] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:23:32.102756 16029 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.102825 15836 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.103936 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.104964 16076 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.105453 16076 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:32.106231 16076 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.109346 16029 tablet_bootstrap.cc:654] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.113426 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.114184 15835 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.115108 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:23:32.116822 15952 leader_election.cc:343] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.118238 16052 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:32.121589 16029 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.122210 16029 ts_tablet_manager.cc:1403] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:23:32.123262 16162 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.123708 16162 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.124200 15835 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:32.125435 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:32.125694 16162 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.126529 16094 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.126981 16094 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:32.127226 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.127753 16094 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:32.128569 15803 leader_election.cc:343] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.129387 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.131088 16029 raft_consensus.cc:359] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.132030 16029 raft_consensus.cc:385] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.132344 16029 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
W20260709 12:23:32.133577 15802 leader_election.cc:343] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.133242 16029 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.133984 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.134785 16162 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.137128 16029 ts_tablet_manager.cc:1434] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:32.138216 16034 tablet_bootstrap.cc:492] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.140043 16034 ts_tablet_manager.cc:1403] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.007s
I20260709 12:23:32.140256 16029 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.146301 16029 tablet_bootstrap.cc:654] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.145888 15734 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:32.147446 15952 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.148557 16052 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.149268 16052 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.157938 16029 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.158424 16029 ts_tablet_manager.cc:1403] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:23:32.159044 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:32.160215 15950 leader_election.cc:343] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.163056 16034 raft_consensus.cc:359] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.163635 16052 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:32.163941 16034 raft_consensus.cc:385] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.164345 16034 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.164618 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:32.165643 15952 leader_election.cc:343] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.165190 16034 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.166036 15952 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:32.166967 16052 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.167927 16034 ts_tablet_manager.cc:1434] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:23:32.139016 15732 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.170460 16029 raft_consensus.cc:359] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.171321 16029 raft_consensus.cc:385] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.171630 16029 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.172258 16029 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.173621 16028 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.174039 16028 ts_tablet_manager.cc:1403] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.280s	user 0.033s	sys 0.085s
I20260709 12:23:32.174187 16029 ts_tablet_manager.cc:1434] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:23:32.174976 16029 tablet_bootstrap.cc:492] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.176326 16028 raft_consensus.cc:359] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.176935 16028 raft_consensus.cc:385] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.177199 16028 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.177977 16028 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.181341 16028 ts_tablet_manager.cc:1434] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:32.182339 16028 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.183300 16034 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.187816 16028 tablet_bootstrap.cc:654] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.190356 16029 tablet_bootstrap.cc:654] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.191674 16034 tablet_bootstrap.cc:654] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.199795 15733 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.200676 16034 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.200970 16029 tablet_bootstrap.cc:492] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.201136 16034 ts_tablet_manager.cc:1403] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:23:32.201399 16029 ts_tablet_manager.cc:1403] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 12:23:32.203070 16028 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.203994 16028 ts_tablet_manager.cc:1403] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:23:32.203678 16034 raft_consensus.cc:359] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.203889 16029 raft_consensus.cc:359] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.204594 16029 raft_consensus.cc:385] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.204546 16034 raft_consensus.cc:385] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.204941 16029 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.204984 16034 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.205760 16034 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.206957 16028 raft_consensus.cc:359] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.207630 16028 raft_consensus.cc:385] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.207717 16034 ts_tablet_manager.cc:1434] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:32.208029 16028 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.208770 16034 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.208935 16028 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.205916 16029 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.211647 16028 ts_tablet_manager.cc:1434] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:32.211845 16029 ts_tablet_manager.cc:1434] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:32.212657 16029 tablet_bootstrap.cc:492] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.213094 16028 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.219251 16029 tablet_bootstrap.cc:654] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.219297 16028 tablet_bootstrap.cc:654] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.222005 16034 tablet_bootstrap.cc:654] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.226619 16034 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.227027 16034 ts_tablet_manager.cc:1403] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:23:32.229110 16028 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.229526 16028 ts_tablet_manager.cc:1403] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 12:23:32.229813 16029 tablet_bootstrap.cc:492] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.229432 16034 raft_consensus.cc:359] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.230254 16034 raft_consensus.cc:385] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.230352 16029 ts_tablet_manager.cc:1403] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 12:23:32.230546 16034 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.231295 16034 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.232319 16028 raft_consensus.cc:359] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.233081 16028 raft_consensus.cc:385] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.233415 16028 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.233932 16034 ts_tablet_manager.cc:1434] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:32.233500 16029 raft_consensus.cc:359] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.234441 16029 raft_consensus.cc:385] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.234143 16028 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.234803 16029 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.234854 16034 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.236202 16028 ts_tablet_manager.cc:1434] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:32.235927 16029 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.237217 16028 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.238080 16076 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.238495 16029 ts_tablet_manager.cc:1434] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:23:32.239501 16029 tablet_bootstrap.cc:492] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.244092 16028 tablet_bootstrap.cc:654] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.245702 16029 tablet_bootstrap.cc:654] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.238523 16076 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.259564 16076 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.264796 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.269049 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.269850 15835 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:23:32.272642 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:32.278887 16095 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.282071 15910 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.296756 16028 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.297243 16028 ts_tablet_manager.cc:1403] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.023s
I20260709 12:23:32.297747 16034 tablet_bootstrap.cc:654] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.300983 16028 raft_consensus.cc:359] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.301712 16028 raft_consensus.cc:385] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.302062 16028 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.306051 16119 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.306505 16119 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.308476 16119 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.308683 15876 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.312338 16028 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.312654 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.313428 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.315440 15836 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:32.314795 16028 ts_tablet_manager.cc:1434] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:32.316839 16028 tablet_bootstrap.cc:492] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.317842 16076 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.318274 16076 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.322960 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.324110 16076 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.323609 15836 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.331055 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.331719 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:32.332360 16076 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.332557 16033 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.332919 16033 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.333287 16033 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.349666 16118 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.353828 16095 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.359681 16034 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.360147 16034 ts_tablet_manager.cc:1403] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.030s
I20260709 12:23:32.363075 16029 tablet_bootstrap.cc:492] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.363502 16029 ts_tablet_manager.cc:1403] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.124s	user 0.033s	sys 0.043s
I20260709 12:23:32.366182 16029 raft_consensus.cc:359] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.366792 16029 raft_consensus.cc:385] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.366711 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.367097 16029 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.367703 16029 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.370910 16028 tablet_bootstrap.cc:654] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.372769 16029 ts_tablet_manager.cc:1434] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
W20260709 12:23:32.374032 15879 leader_election.cc:343] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.374833 15911 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.374361 16033 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.377079 16029 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.380898 16034 raft_consensus.cc:359] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.381611 16034 raft_consensus.cc:385] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.381906 16034 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.382767 16034 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.386906 16076 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.387188 16034 ts_tablet_manager.cc:1434] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:23:32.388080 16034 tablet_bootstrap.cc:492] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.410049 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.410889 15835 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.449431 16076 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.449975 16076 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.415025 16033 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.455237 16076 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.453361 16045 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.459991 16045 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.461241 16052 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.461990 16045 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.467484 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:32.473294 16034 tablet_bootstrap.cc:654] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.476768 16029 tablet_bootstrap.cc:654] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.475854 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.479300 15987 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.480160 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.480922 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:32.484053 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:32.481469 15879 leader_election.cc:343] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.484949 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:32.487452 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.487901 16162 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.488070 15838 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.488304 16162 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.488680 16162 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.480931 15835 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.490300 15876 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:32.492093 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.493731 16118 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.494221 16118 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.494655 16118 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.499745 16198 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:32.507067 16028 tablet_bootstrap.cc:492] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.507659 16028 ts_tablet_manager.cc:1403] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.191s	user 0.016s	sys 0.000s
W20260709 12:23:32.489619 15802 leader_election.cc:343] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.509186 16119 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.513283 16119 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:32.514382 16119 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.526762 16198 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.526764 16162 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.529460 16162 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.530349 16197 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.530815 16197 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.535808 16029 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.536254 16029 ts_tablet_manager.cc:1403] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.025s
I20260709 12:23:32.538425 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:32.538983 16045 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.539245 15986 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.539453 16045 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.537106 16197 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:32.541359 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.539973 16118 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.541956 15835 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:32.541370 16045 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.543903 16118 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.544085 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.544633 15835 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.545397 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.546414 16029 raft_consensus.cc:359] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.547015 16029 raft_consensus.cc:385] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.547293 16029 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.547224 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.547983 16029 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.548352 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:32.548363 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:32.551370 15987 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:32.553133 15803 leader_election.cc:343] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.553821 15835 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.553769 15950 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:32.554890 16197 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.555189 16197 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.555904 16197 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.555203 15734 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.556560 16029 ts_tablet_manager.cc:1434] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:23:32.557432 16029 tablet_bootstrap.cc:492] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.550213 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.557977 16052 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.558032 15876 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:32.558435 16052 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.561314 16052 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:32.561460 15802 leader_election.cc:343] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.561878 15802 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.563994 16034 tablet_bootstrap.cc:492] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.564427 16034 ts_tablet_manager.cc:1403] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.177s	user 0.003s	sys 0.028s
I20260709 12:23:32.565409 16118 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.565876 16118 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:32.565938 15987 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.566733 16118 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.567258 16034 raft_consensus.cc:359] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.567889 16034 raft_consensus.cc:385] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.568156 16034 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
W20260709 12:23:32.568610 15952 leader_election.cc:343] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.565017 16162 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.570401 16028 raft_consensus.cc:359] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.571053 16028 raft_consensus.cc:385] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.571301 16028 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.571962 16028 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.572867 16053 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.573309 16053 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.574030 16028 ts_tablet_manager.cc:1434] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:23:32.574833 16028 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.575289 16053 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:32.576812 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.568780 16034 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.577491 15912 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:32.581501 15802 leader_election.cc:343] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.581975 15952 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:32.582820 16052 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.583170 16052 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.572489 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.583596 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:32.584048 16052 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.589587 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:32.592756 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.593897 16034 ts_tablet_manager.cc:1434] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 12:23:32.594895 16034 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.596203 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.596850 15837 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:32.604426 16118 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.593750 16162 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.604887 16118 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.605710 16162 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:32.606606 16162 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.607836 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.608467 15838 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.608870 15733 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.608487 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.610615 15835 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:32.610904 16118 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.614300 16045 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.614571 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:32.612195 15950 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:32.632975 16045 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.634783 16053 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.635082 16045 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.635207 16197 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:32.635591 15879 leader_election.cc:343] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.636420 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.638705 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:32.638855 16197 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:32.638257 15803 leader_election.cc:343] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.643132 16045 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:32.643309 15952 leader_election.cc:343] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.643621 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.643590 16045 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.643914 16119 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.645484 16119 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.646452 16045 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.646543 16053 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.647481 16119 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.648159 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:32.648514 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:32.649194 15802 leader_election.cc:343] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.649312 15987 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.648572 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.650116 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.650934 15837 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.647202 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.652499 15879 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:32.653334 16119 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.653674 16119 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.653997 16119 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.654862 16034 tablet_bootstrap.cc:654] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.640121 16118 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.655915 16045 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.657388 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:32.659304 15803 leader_election.cc:343] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.662658 16029 tablet_bootstrap.cc:654] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:32.663167 15802 leader_election.cc:343] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.663735 15802 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.650462 15835 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:32.658195 16118 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.665683 16118 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.667315 16028 tablet_bootstrap.cc:654] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.665010 16045 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.667806 16119 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.671460 16052 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.676280 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.676837 15838 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.675495 15733 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.679531 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.679701 16052 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:32.684092 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:32.688763 15913 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.684648 15837 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:32.680094 15834 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.691480 16198 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.701282 16119 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.700469 15950 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:32.705122 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:32.700618 16118 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.705876 16053 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.710065 15834 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:32.711089 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:32.710671 16053 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:32.711982 16118 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.712698 16053 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.713560 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:23:32.714862 15879 leader_election.cc:343] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.715507 16052 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.708161 16034 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.705963 15987 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.716038 16052 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:32.717060 16052 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.719040 16197 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.709210 15913 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:32.706362 15838 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.725595 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:32.727448 16119 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.728588 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:32.755716 15837 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.728780 15987 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.729694 16118 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.762509 16118 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:32.763545 16118 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.737994 16197 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.785521 16028 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.785809 16034 ts_tablet_manager.cc:1403] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.191s	user 0.008s	sys 0.019s
I20260709 12:23:32.785970 16028 ts_tablet_manager.cc:1403] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.006s
I20260709 12:23:32.789741 16028 raft_consensus.cc:359] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.790490 16028 raft_consensus.cc:385] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.790761 16028 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.791432 16028 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.793737 16028 ts_tablet_manager.cc:1434] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:32.794590 16028 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.802903 15733 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.810374 16034 raft_consensus.cc:359] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.811311 16034 raft_consensus.cc:385] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.811647 16034 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.812531 16034 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.798961 15837 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:32.817178 16034 ts_tablet_manager.cc:1434] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.003s
I20260709 12:23:32.818804 16034 tablet_bootstrap.cc:492] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.831477 15734 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.833344 15734 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.828737 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.840342 16033 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.840833 16033 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:32.841645 16033 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.853581 16162 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.854071 16162 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.855995 16162 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.856702 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:32.867108 16029 tablet_bootstrap.cc:492] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.867555 16029 ts_tablet_manager.cc:1403] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.310s	user 0.021s	sys 0.036s
I20260709 12:23:32.858280 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.871204 16029 raft_consensus.cc:359] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.871940 16029 raft_consensus.cc:385] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.872220 16029 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.872833 16029 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.874846 16029 ts_tablet_manager.cc:1434] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:32.875718 16029 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:32.859174 15802 leader_election.cc:343] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:32.878203 15803 leader_election.cc:343] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.884896 15803 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:32.887063 16162 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.891338 16028 tablet_bootstrap.cc:654] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.894761 16034 tablet_bootstrap.cc:654] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.901700 16029 tablet_bootstrap.cc:654] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.909403 15734 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.912439 16034 tablet_bootstrap.cc:492] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.912878 16034 ts_tablet_manager.cc:1403] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.005s
I20260709 12:23:32.915977 16028 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.916348 16028 ts_tablet_manager.cc:1403] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.008s
I20260709 12:23:32.918609 16028 raft_consensus.cc:359] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.918597 16034 raft_consensus.cc:359] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.919489 16028 raft_consensus.cc:385] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.919637 16034 raft_consensus.cc:385] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.919816 16028 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.920083 16034 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.920511 16028 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.920930 16034 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.922719 16028 ts_tablet_manager.cc:1434] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:32.923135 16034 ts_tablet_manager.cc:1434] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:32.925346 16034 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.927785 16028 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.930792 16034 tablet_bootstrap.cc:654] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.934190 16028 tablet_bootstrap.cc:654] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.942013 16028 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.942411 16028 ts_tablet_manager.cc:1403] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:23:32.944775 16028 raft_consensus.cc:359] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.945447 16028 raft_consensus.cc:385] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.945708 16028 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.948024 16029 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:32.948480 16029 ts_tablet_manager.cc:1403] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.004s
I20260709 12:23:32.948736 16034 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.949149 16034 ts_tablet_manager.cc:1403] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 12:23:32.950984 16029 raft_consensus.cc:359] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.951632 16029 raft_consensus.cc:385] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.951380 16034 raft_consensus.cc:359] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.951951 16029 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.952055 16034 raft_consensus.cc:385] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.952394 16034 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.952711 16029 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.952991 16034 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.954639 16029 ts_tablet_manager.cc:1434] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:32.955036 16034 ts_tablet_manager.cc:1434] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:32.955458 16028 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.956049 16034 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.957405 16028 ts_tablet_manager.cc:1434] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:32.958227 16028 tablet_bootstrap.cc:492] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.961450 16034 tablet_bootstrap.cc:654] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.964651 16028 tablet_bootstrap.cc:654] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.955428 16029 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:32.974090 16029 tablet_bootstrap.cc:654] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.975349 16028 tablet_bootstrap.cc:492] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:32.975770 16028 ts_tablet_manager.cc:1403] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:23:32.978304 16028 raft_consensus.cc:359] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.978981 16028 raft_consensus.cc:385] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.979266 16028 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.980049 16028 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.985005 16034 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:32.985450 16034 ts_tablet_manager.cc:1403] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.009s
I20260709 12:23:32.988335 16045 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.988780 16045 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.991168 16045 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:32.991230 16028 ts_tablet_manager.cc:1434] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:23:32.992467 16028 tablet_bootstrap.cc:492] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:32.987757 16034 raft_consensus.cc:359] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.993263 16034 raft_consensus.cc:385] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.993315 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:32.993948 15986 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:32.993618 16034 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.994742 16034 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:32.996100 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:32.996811 16034 ts_tablet_manager.cc:1434] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.002s
I20260709 12:23:32.997107 16162 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.997437 16162 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.997702 16034 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:32.997749 16162 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.999943 16028 tablet_bootstrap.cc:654] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.000234 16029 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:33.000640 16029 ts_tablet_manager.cc:1403] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.007s
I20260709 12:23:33.003423 16034 tablet_bootstrap.cc:654] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.003526 16029 raft_consensus.cc:359] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.004415 16029 raft_consensus.cc:385] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.004738 16029 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.005561 16029 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.007174 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:33.011982 16029 ts_tablet_manager.cc:1434] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:23:33.012780 16029 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:33.017135 15802 leader_election.cc:343] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.019014 16029 tablet_bootstrap.cc:654] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.019143 16033 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.019601 16033 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.021674 16033 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.024762 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:33.028386 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:33.029129 15838 raft_consensus.cc:2393] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:33.030289 16029 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:33.030807 16029 ts_tablet_manager.cc:1403] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:23:33.030961 15876 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:33.032579 16076 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.043257 16029 raft_consensus.cc:359] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.044181 16029 raft_consensus.cc:385] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.044531 16029 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.046783 16076 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.047925 15988 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.048066 16029 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.050746 16029 ts_tablet_manager.cc:1434] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:23:33.053596 16029 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:33.058128 16033 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.059172 16029 tablet_bootstrap.cc:654] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.064862 16119 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.065383 16119 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.068596 16119 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.070187 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:33.072796 15879 leader_election.cc:343] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.075915 16034 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:33.076339 16034 ts_tablet_manager.cc:1403] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.033s
I20260709 12:23:33.043756 16162 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.076918 16028 tablet_bootstrap.cc:492] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:33.077363 16028 ts_tablet_manager.cc:1403] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.018s
I20260709 12:23:33.078728 16162 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.079406 16029 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:33.079833 16029 ts_tablet_manager.cc:1403] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:23:33.082544 16034 raft_consensus.cc:359] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.083231 16034 raft_consensus.cc:385] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.083031 16028 raft_consensus.cc:359] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.083720 16028 raft_consensus.cc:385] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.083513 16033 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.083976 16028 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.084972 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:33.083531 16034 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.085506 15986 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.086014 16034 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.087527 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:33.088122 16034 ts_tablet_manager.cc:1434] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
W20260709 12:23:33.088646 15802 leader_election.cc:343] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.088969 16034 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:33.090430 16029 raft_consensus.cc:359] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.091081 16029 raft_consensus.cc:385] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.094156 16118 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.095203 16034 tablet_bootstrap.cc:654] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.103135 16076 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.091341 16029 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.105899 15986 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:33.109083 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:33.110351 16162 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.084733 16028 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.110811 16162 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:33.111833 16162 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.099565 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:33.114032 15838 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:33.118147 16076 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.119683 16076 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.120040 15876 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:33.121379 16198 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.121719 16198 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.121877 16076 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.122076 16198 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.125880 16053 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.128921 16198 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.106302 16029 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.133549 16198 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.134503 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:23:33.136009 15879 leader_election.cc:343] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.136391 16029 ts_tablet_manager.cc:1434] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:23:33.142989 16028 ts_tablet_manager.cc:1434] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 12:23:33.145568 16028 tablet_bootstrap.cc:492] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:33.158305 16162 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.158766 16162 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.160653 16162 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:33.166095 15802 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.167797 15910 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.168915 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:33.169354 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:33.169562 15834 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
W20260709 12:23:33.171321 15803 leader_election.cc:343] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.145076 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:33.172492 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:33.179857 16162 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.171283 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:33.194367 16119 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.194757 16119 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.195108 16119 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.195117 16029 tablet_bootstrap.cc:492] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:33.187500 15834 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.209129 16034 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:33.209657 16034 ts_tablet_manager.cc:1403] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.121s	user 0.042s	sys 0.053s
W20260709 12:23:33.190665 15879 leader_election.cc:343] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.219606 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:33.223088 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45112.7us
I20260709 12:23:33.224342 16053 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.224977 16053 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.224402 16119 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.239478 16034 raft_consensus.cc:359] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.240413 16034 raft_consensus.cc:385] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.240808 16034 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.241654 16034 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:33.258145 15802 leader_election.cc:343] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.271579 15802 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:33.272433 16162 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.273067 16198 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:33.345372 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 98233.5us
I20260709 12:23:33.347043 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:33.347769 15836 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:33.351118 16119 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.352174 15834 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:33.352905 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:33.356447 15832 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.359910 16034 ts_tablet_manager.cc:1434] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.150s	user 0.033s	sys 0.020s
I20260709 12:23:33.361141 16034 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:33.361562 16032 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.362079 16032 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.366598 15832 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:33.367877 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:33.371131 15876 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:33.372366 16118 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.372465 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:33.372932 16118 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:33.373400 15833 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:33.373919 16118 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.375082 16033 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.376781 16246 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.387341 16028 tablet_bootstrap.cc:654] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.377437 16246 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.392944 15950 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:33.401932 16197 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.402426 16197 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.402828 16197 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.407398 16246 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:33.383400 16053 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:33.416904 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:33.417616 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:33.421226 15910 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:33.405928 16032 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:33.453025 16053 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:33.459766 16197 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.463908 15734 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.470878 16029 tablet_bootstrap.cc:654] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:33.471441 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:33.470386 16033 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:33.497169 16034 tablet_bootstrap.cc:654] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.494097 15987 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.505409 16241 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.505564 16033 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.511067 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:33.505913 16241 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:33.507018 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 109455us
I20260709 12:23:33.513022 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:33.513844 15950 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:23:33.510188 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 114871us
I20260709 12:23:33.515437 16248 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.508102 16197 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:33.524283 15952 leader_election.cc:343] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.535338 16028 tablet_bootstrap.cc:492] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:33.535995 16028 ts_tablet_manager.cc:1403] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.391s	user 0.029s	sys 0.046s
I20260709 12:23:33.545735 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:33.546394 15838 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:33.546687 16076 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.548460 16045 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.548969 16045 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.554051 16241 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.538743 16248 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:23:33.548997 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:33.561292 15907 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.560976 16045 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:33.562186 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:33.564178 15803 leader_election.cc:343] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.566049 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:33.567514 15803 leader_election.cc:343] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.571810 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:33.572540 15838 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.575913 16053 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.589892 16034 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:33.590322 16034 ts_tablet_manager.cc:1403] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.002s
I20260709 12:23:33.593448 16241 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.593500 16034 raft_consensus.cc:359] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.594290 16034 raft_consensus.cc:385] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.594544 16034 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.595142 16034 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.596268 15838 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:33.596673 16034 ts_tablet_manager.cc:1434] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:23:33.597581 16034 tablet_bootstrap.cc:492] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:33.604907 16029 tablet_bootstrap.cc:492] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:33.605511 16029 ts_tablet_manager.cc:1403] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.411s	user 0.026s	sys 0.022s
I20260709 12:23:33.626920 16029 raft_consensus.cc:359] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.627854 16029 raft_consensus.cc:385] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.628191 16029 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.628988 16029 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.634706 16028 raft_consensus.cc:359] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.635620 16028 raft_consensus.cc:385] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.635937 16028 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.638859 15911 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.636765 16028 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.643208 16029 ts_tablet_manager.cc:1434] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:23:33.643940 16029 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:33.641901 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 98672.2us
I20260709 12:23:33.645337 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:33.646010 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:33.646684 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:33.649348 16244 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.657694 16034 tablet_bootstrap.cc:654] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.661325 15907 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:33.649718 16244 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.663280 16244 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.664191 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:33.671241 16252 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.671700 16252 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:33.671763 16033 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:33.673631 15802 leader_election.cc:343] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.675410 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:23:33.676792 15802 leader_election.cc:343] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.677171 15802 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:33.682003 16162 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.683566 16244 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.685644 16244 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:33.686496 16241 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.672569 16252 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.696055 16028 ts_tablet_manager.cc:1434] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.160s	user 0.009s	sys 0.000s
I20260709 12:23:33.698637 16028 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
W20260709 12:23:33.696058 15879 leader_election.cc:343] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.707899 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:33.719559 16241 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:33.722569 15952 leader_election.cc:343] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.732190 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:33.732684 15837 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.744781 16029 tablet_bootstrap.cc:654] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.767369 16034 tablet_bootstrap.cc:492] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:33.767988 16034 ts_tablet_manager.cc:1403] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.171s	user 0.035s	sys 0.002s
I20260709 12:23:33.764168 16251 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:23:33.797837 16034 raft_consensus.cc:359] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.798871 16034 raft_consensus.cc:385] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.799214 16034 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.799991 16034 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.804987 15732 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.807205 15732 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.866986 16034 ts_tablet_manager.cc:1434] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.005s
I20260709 12:23:33.869457 16034 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:33.890040 16028 tablet_bootstrap.cc:654] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.892488 16029 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:33.897828 16029 ts_tablet_manager.cc:1403] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.254s	user 0.011s	sys 0.005s
I20260709 12:23:33.902779 16034 tablet_bootstrap.cc:654] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.906292 15837 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:33.939517 15984 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.945426 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:33.946427 16053 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.951128 16053 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:33.952162 16053 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.966030 16029 raft_consensus.cc:359] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.966912 16029 raft_consensus.cc:385] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.967226 16029 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.958735 15733 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.969231 16076 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:33.969215 15879 consensus_peers.cc:597] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.976382 16029 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.978603 16028 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:33.979069 16028 ts_tablet_manager.cc:1403] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.281s	user 0.020s	sys 0.003s
I20260709 12:23:33.979130 16034 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:33.979571 16034 ts_tablet_manager.cc:1403] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.111s	user 0.027s	sys 0.021s
I20260709 12:23:33.980016 16029 ts_tablet_manager.cc:1434] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.002s
I20260709 12:23:33.980935 16029 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:33.981534 16028 raft_consensus.cc:359] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.981873 16034 raft_consensus.cc:359] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.982491 16034 raft_consensus.cc:385] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.982767 16034 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.984483 16034 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.986521 16034 ts_tablet_manager.cc:1434] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:33.986930 16029 tablet_bootstrap.cc:654] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.987356 16034 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:33.987799 16076 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.982188 16028 raft_consensus.cc:385] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.992723 16028 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.996097 16034 tablet_bootstrap.cc:654] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.995851 16028 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:33.998608 16028 ts_tablet_manager.cc:1434] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 12:23:33.999629 16028 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.009552 16029 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.009982 16029 ts_tablet_manager.cc:1403] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:23:34.012445 16029 raft_consensus.cc:359] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.013048 16029 raft_consensus.cc:385] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.013294 16029 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.014536 16028 tablet_bootstrap.cc:654] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.018041 16034 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.018491 16034 ts_tablet_manager.cc:1403] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.017s
I20260709 12:23:34.014499 16029 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.021596 16034 raft_consensus.cc:359] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.022207 16034 raft_consensus.cc:385] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.022481 16034 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.023262 16029 ts_tablet_manager.cc:1434] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:34.023201 16034 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.026007 16034 ts_tablet_manager.cc:1434] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:23:34.027122 16034 tablet_bootstrap.cc:492] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.029335 15734 catalog_manager.cc:5697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:34.031597 16029 tablet_bootstrap.cc:492] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.034413 16034 tablet_bootstrap.cc:654] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.044303 16265 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.044773 16265 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.046711 16265 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.048554 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.049237 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:34.050093 15803 leader_election.cc:343] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.051710 16034 tablet_bootstrap.cc:492] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.052254 16034 ts_tablet_manager.cc:1403] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
W20260709 12:23:34.052584 15802 leader_election.cc:343] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.053020 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.053913 16265 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.054536 16029 tablet_bootstrap.cc:654] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.059581 16028 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.060021 16028 ts_tablet_manager.cc:1403] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.021s
I20260709 12:23:34.062541 16265 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.063155 16265 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.065397 16034 raft_consensus.cc:359] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.066042 16034 raft_consensus.cc:385] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.066327 16034 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.067018 16034 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.069169 16034 ts_tablet_manager.cc:1434] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 12:23:34.076728 16028 raft_consensus.cc:359] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.077418 16028 raft_consensus.cc:385] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.077677 16028 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.078308 16028 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.080480 16028 ts_tablet_manager.cc:1434] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:34.081355 16028 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.082471 16034 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.082975 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.083560 15987 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:34.084679 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.085536 16269 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.085619 16265 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.086006 16269 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.086344 16269 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.086560 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.087143 15911 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:34.088500 16034 tablet_bootstrap.cc:654] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.100600 16029 tablet_bootstrap.cc:492] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.101089 16029 ts_tablet_manager.cc:1403] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.023s
I20260709 12:23:34.101459 16269 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.104070 16269 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.104193 16029 raft_consensus.cc:359] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.104833 16029 raft_consensus.cc:385] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.105190 16029 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.107069 16028 tablet_bootstrap.cc:654] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.107477 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.109691 15987 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.109994 16034 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.110435 16034 ts_tablet_manager.cc:1403] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.005s
I20260709 12:23:34.110297 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:34.111392 15911 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.113006 16034 raft_consensus.cc:359] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.113680 16034 raft_consensus.cc:385] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.113938 16034 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.114530 16034 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.116511 16034 ts_tablet_manager.cc:1434] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:34.117386 16034 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.122200 16029 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.122812 16034 tablet_bootstrap.cc:654] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.126554 15987 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:34.127754 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.128513 16265 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.129160 16265 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:34.130221 16265 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.134023 16029 ts_tablet_manager.cc:1434] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:23:34.134351 16028 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.138722 16028 ts_tablet_manager.cc:1403] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.005s
I20260709 12:23:34.141404 16028 raft_consensus.cc:359] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.142158 16028 raft_consensus.cc:385] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.142495 16028 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.143213 16028 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.145361 16028 ts_tablet_manager.cc:1434] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:34.134969 16029 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.150965 16029 tablet_bootstrap.cc:654] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.151860 16028 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.157387 16259 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.158129 15907 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.160825 16028 tablet_bootstrap.cc:654] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.174736 16265 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.175402 16265 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.177956 16265 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.186766 15911 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:34.197157 16259 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.197803 16259 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.201349 16259 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.205451 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.213953 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:34.214951 15803 leader_election.cc:343] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.213995 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.216349 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:34.217300 15838 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:34.219302 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.220542 16259 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:34.216444 15802 leader_election.cc:343] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.225410 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.226480 16265 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.239605 16246 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.241496 16028 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.241997 16028 ts_tablet_manager.cc:1403] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.018s
I20260709 12:23:34.241897 16259 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.244349 16028 raft_consensus.cc:359] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.247032 16034 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.247797 16034 ts_tablet_manager.cc:1403] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.131s	user 0.041s	sys 0.061s
I20260709 12:23:34.247133 16029 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.248803 16029 ts_tablet_manager.cc:1403] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.031s
I20260709 12:23:34.249265 15731 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.252671 16034 raft_consensus.cc:359] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.254145 16029 raft_consensus.cc:359] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.254771 16034 raft_consensus.cc:385] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.255538 16034 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.256194 16034 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.258126 16034 ts_tablet_manager.cc:1434] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:23:34.258952 16034 tablet_bootstrap.cc:492] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.254776 16029 raft_consensus.cc:385] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.259325 16029 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.260010 16029 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.255239 16028 raft_consensus.cc:385] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.260958 16028 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.261716 16028 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.263695 16028 ts_tablet_manager.cc:1434] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:23:34.266249 16028 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.265472 16029 ts_tablet_manager.cc:1434] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 12:23:34.272259 16034 tablet_bootstrap.cc:654] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.278697 16028 tablet_bootstrap.cc:654] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.294143 16029 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.308193 16028 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.309389 16034 tablet_bootstrap.cc:492] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.300331 16252 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:34.309923 16028 ts_tablet_manager.cc:1403] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.022s
I20260709 12:23:34.309979 16034 ts_tablet_manager.cc:1403] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.027s
I20260709 12:23:34.312536 16034 raft_consensus.cc:359] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.313189 16029 tablet_bootstrap.cc:654] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.313215 16034 raft_consensus.cc:385] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.313716 16034 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.314385 16034 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.315534 16265 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.317492 16265 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.319430 16265 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.321249 16034 ts_tablet_manager.cc:1434] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:34.322139 16034 tablet_bootstrap.cc:492] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.322275 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.324347 16029 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
W20260709 12:23:34.324831 15802 leader_election.cc:343] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.325306 16029 ts_tablet_manager.cc:1403] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 12:23:34.326478 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:34.328007 15803 leader_election.cc:343] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.327844 16029 raft_consensus.cc:359] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.328482 16029 raft_consensus.cc:385] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.328177 16028 raft_consensus.cc:359] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.328764 16029 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.328861 16028 raft_consensus.cc:385] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.329231 16028 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.329680 16029 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.328437 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.330647 16265 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.334544 16029 ts_tablet_manager.cc:1434] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:34.335343 16029 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.336117 16028 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.338014 16028 ts_tablet_manager.cc:1434] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:23:34.341007 16029 tablet_bootstrap.cc:654] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.341411 16034 tablet_bootstrap.cc:654] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.338873 16028 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.350514 16028 tablet_bootstrap.cc:654] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.352638 16034 tablet_bootstrap.cc:492] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.353188 16034 ts_tablet_manager.cc:1403] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.000s
I20260709 12:23:34.353906 16029 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.354305 16029 ts_tablet_manager.cc:1403] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:23:34.355952 16034 raft_consensus.cc:359] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.356725 16034 raft_consensus.cc:385] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.356791 16029 raft_consensus.cc:359] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.357172 16034 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.357519 16029 raft_consensus.cc:385] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.357837 16029 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.358157 16034 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.360586 16034 ts_tablet_manager.cc:1434] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:34.358428 16029 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.362877 16029 ts_tablet_manager.cc:1434] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:23:34.363989 16029 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.370419 16034 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.372877 16029 tablet_bootstrap.cc:654] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.373070 16028 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.373468 16028 ts_tablet_manager.cc:1403] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.009s
I20260709 12:23:34.382562 16034 tablet_bootstrap.cc:654] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.386737 16028 raft_consensus.cc:359] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.387401 16028 raft_consensus.cc:385] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.387568 16028 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.387972 16028 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.390003 16028 ts_tablet_manager.cc:1434] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:23:34.390821 16028 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.392828 16034 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.393288 16034 ts_tablet_manager.cc:1403] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:23:34.396358 16028 tablet_bootstrap.cc:654] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.396961 16034 raft_consensus.cc:359] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.397846 16034 raft_consensus.cc:385] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.398139 16034 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.398876 16034 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.401326 16034 ts_tablet_manager.cc:1434] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:34.402444 16034 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.411526 16029 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.412132 16029 ts_tablet_manager.cc:1403] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.024s
I20260709 12:23:34.412070 16265 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.412606 16265 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.414597 16265 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.414669 16029 raft_consensus.cc:359] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.415347 16029 raft_consensus.cc:385] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.415594 16029 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.416806 16029 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.419452 15984 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.420921 16029 ts_tablet_manager.cc:1434] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:34.421808 16029 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.425750 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.426806 15987 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:34.427009 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.428316 16251 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.428769 16251 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.429754 16053 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.430351 16262 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.431391 15802 leader_election.cc:343] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.432008 16028 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.432286 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:34.430778 16262 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.432883 15837 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:34.432469 16028 ts_tablet_manager.cc:1403] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.006s
I20260709 12:23:34.434937 16262 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.435701 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:34.435971 16028 raft_consensus.cc:359] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.436625 16269 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.437083 16269 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.430792 16251 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.437487 16269 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.440249 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.440868 15985 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:34.441990 15879 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.443418 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:34.443974 16269 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.444928 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.444164 15838 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:34.436618 16028 raft_consensus.cc:385] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.439260 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:34.448740 16033 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.449199 16269 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.447918 16028 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.449234 16033 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.450038 16076 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.450214 16033 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.450470 16076 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.450407 16028 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.450953 16076 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.456269 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:34.456774 16029 tablet_bootstrap.cc:654] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.451807 15987 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:34.458333 16265 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.458885 16265 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:34.461398 15802 leader_election.cc:343] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.462440 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.462986 15985 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.460278 16076 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.465394 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.465998 15986 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:34.465649 16076 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.467154 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.467718 15987 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.469624 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.462471 16265 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.474364 15985 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:34.478694 16269 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.479090 16269 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.479404 16269 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.480388 16033 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.483031 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:34.484542 16265 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.485059 16265 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:34.485327 16028 ts_tablet_manager.cc:1434] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:23:34.486475 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.486430 16265 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:34.488523 15802 leader_election.cc:343] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.489374 16162 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.489818 16162 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.491334 16028 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.497871 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:34.498436 15832 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.499141 16241 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.499588 16241 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.502127 16241 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.504407 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.506729 16162 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.508483 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.514381 16034 tablet_bootstrap.cc:654] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.518137 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.503252 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.493993 15987 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:34.520228 15879 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.521235 16262 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.521780 16262 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:34.522758 16262 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:34.524188 15803 leader_election.cc:343] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.547360 16241 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.552879 16241 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:34.626423 16306 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:23:34.632081 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 123442us
W20260709 12:23:34.632874 15802 leader_election.cc:343] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.635787 15802 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.633447 16265 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.648929 16162 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.651703 16241 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.659194 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.649149 16265 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.664649 16265 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.664964 16029 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.664860 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.665208 16162 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.665688 16162 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.666679 16029 ts_tablet_manager.cc:1403] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.245s	user 0.059s	sys 0.048s
I20260709 12:23:34.666158 16053 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:34.671308 16162 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.672676 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.676605 16033 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.678179 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.678723 15987 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:34.679193 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:34.684823 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:34.685377 15837 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.689654 15832 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:34.690102 16028 tablet_bootstrap.cc:654] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.694494 15837 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
W20260709 12:23:34.693001 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60160.1us
W20260709 12:23:34.695484 15802 leader_election.cc:343] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.699580 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.700034 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.703493 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.704150 15910 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 0.
I20260709 12:23:34.705982 16269 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.701618 16029 raft_consensus.cc:359] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.709647 16029 raft_consensus.cc:385] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.709960 16029 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.711732 16029 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.713224 16029 ts_tablet_manager.cc:1434] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260709 12:23:34.713629 16269 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.714011 16029 tablet_bootstrap.cc:492] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.714572 16197 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.715030 16197 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.715956 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.716486 15985 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.694286 15987 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:34.722267 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:34.724740 15837 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:34.725788 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.709496 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:34.726109 16197 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:34.728130 15734 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.731257 15731 catalog_manager.cc:5697] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.732177 16244 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.732564 16244 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.732890 16244 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.734083 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:34.738102 15803 leader_election.cc:343] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.738513 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.739490 15985 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
W20260709 12:23:34.741204 15803 leader_election.cc:343] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.740195 16265 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.741823 15907 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:34.742308 16259 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.742718 16259 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.744686 16259 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:34.745942 15803 leader_election.cc:343] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:34.746491 15803 leader_election.cc:343] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:34.746341 15802 leader_election.cc:343] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.745180 16262 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.747910 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.748235 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:23:34.749869 15802 leader_election.cc:343] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.750236 16269 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.753506 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.748579 16265 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:34.749739 16262 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:34.755077 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.755245 16241 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.754127 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:34.755749 16309 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.755892 16034 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.756122 16309 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.756341 16034 ts_tablet_manager.cc:1403] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.354s	user 0.027s	sys 0.031s
I20260709 12:23:34.756464 16309 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.752418 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:34.750313 16162 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.754210 16029 tablet_bootstrap.cc:654] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.756999 16162 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:34.757997 16162 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.765379 15910 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.759290 16262 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.769068 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:34.769659 15832 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:34.771972 16309 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.773700 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:34.779877 15910 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:34.780038 16034 raft_consensus.cc:359] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.780702 16034 raft_consensus.cc:385] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.780980 16034 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.782020 16034 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.782483 16259 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.793287 16259 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.793663 16259 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.797847 16028 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.798264 16028 ts_tablet_manager.cc:1403] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.312s	user 0.015s	sys 0.032s
I20260709 12:23:34.803025 16034 ts_tablet_manager.cc:1434] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:23:34.778635 16244 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.800494 15734 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.813607 16034 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.816080 15988 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:34.803756 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:34.820004 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:34.813663 16162 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:23:34.829384 15832 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.828326 15907 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.830317 16028 raft_consensus.cc:359] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.823592 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.821511 16309 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.832789 16028 raft_consensus.cc:385] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.819945 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:34.839839 15832 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:34.821550 16244 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:34.840338 15731 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.815649 16259 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.845118 16029 tablet_bootstrap.cc:492] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:34.859750 16029 ts_tablet_manager.cc:1403] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.006s
I20260709 12:23:34.859200 16028 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.860615 16028 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.862912 16028 ts_tablet_manager.cc:1434] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
W20260709 12:23:34.859553 15803 leader_election.cc:343] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.864915 16028 tablet_bootstrap.cc:492] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.868466 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.873734 16244 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.875857 16244 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:34.877174 15907 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:34.876811 16244 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.878118 16029 raft_consensus.cc:359] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.878804 16029 raft_consensus.cc:385] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.879071 16029 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.879007 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.879850 16029 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.880400 16269 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.881363 16269 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:34.883028 16269 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.884490 16034 tablet_bootstrap.cc:654] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.886116 15913 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:34.890038 16029 ts_tablet_manager.cc:1434] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 12:23:34.891644 16029 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:34.893999 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:34.894662 15837 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:34.897488 16259 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:34.898582 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:34.900837 15879 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:34.904815 16262 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.904748 16028 tablet_bootstrap.cc:654] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:34.906915 15802 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.912444 16028 tablet_bootstrap.cc:492] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.913121 16028 ts_tablet_manager.cc:1403] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.004s
I20260709 12:23:34.915061 16029 tablet_bootstrap.cc:654] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.921463 15732 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.934149 16028 raft_consensus.cc:359] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.934852 16034 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:34.935014 16028 raft_consensus.cc:385] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.935314 16034 ts_tablet_manager.cc:1403] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.023s
I20260709 12:23:34.935380 16028 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.936213 16028 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.937932 16034 raft_consensus.cc:359] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.938213 16028 ts_tablet_manager.cc:1434] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:23:34.938831 16034 raft_consensus.cc:385] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.939258 16034 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.939924 16028 tablet_bootstrap.cc:492] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.940162 16034 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.941367 15733 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:34.945205 16244 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.945626 16028 tablet_bootstrap.cc:654] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.945780 16244 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.950904 16244 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:34.953147 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:34.953883 15910 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:34.955590 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:34.956246 15832 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:34.957432 15950 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:34.961886 16252 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.962270 16252 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.962690 16252 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.965400 16028 tablet_bootstrap.cc:492] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:34.965780 16034 ts_tablet_manager.cc:1434] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:23:34.965858 16028 ts_tablet_manager.cc:1403] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:23:34.966754 16034 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:34.968310 16028 raft_consensus.cc:359] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.968930 16028 raft_consensus.cc:385] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.969300 16028 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.969954 16028 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:34.972482 16034 tablet_bootstrap.cc:654] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.972596 16028 ts_tablet_manager.cc:1434] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:34.974249 16028 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:34.999444 16252 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.001549 16028 tablet_bootstrap.cc:654] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.002880 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.003667 15832 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.000473 16029 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.004565 16029 ts_tablet_manager.cc:1403] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.113s	user 0.005s	sys 0.009s
I20260709 12:23:35.006991 16034 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.007589 16034 ts_tablet_manager.cc:1403] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.005s
I20260709 12:23:35.007948 16029 raft_consensus.cc:359] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.008610 16029 raft_consensus.cc:385] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.008667 16252 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.008913 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:35.009584 15913 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.010182 16028 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.010603 16028 ts_tablet_manager.cc:1403] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:23:35.010668 16034 raft_consensus.cc:359] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.011396 16034 raft_consensus.cc:385] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.011670 16034 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.012634 16034 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.013092 15832 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.013118 16028 raft_consensus.cc:359] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.013865 16028 raft_consensus.cc:385] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.014124 16028 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.014240 15950 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.014959 16252 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.014750 16028 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.015126 16034 ts_tablet_manager.cc:1434] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:35.016165 16252 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.016451 16034 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.016794 16028 ts_tablet_manager.cc:1434] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:35.016986 16252 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.023420 16053 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.024004 16028 tablet_bootstrap.cc:492] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.023867 16053 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.025831 16053 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.027706 15913 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.028571 16034 tablet_bootstrap.cc:654] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.008935 16029 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.029815 16028 tablet_bootstrap.cc:654] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.029664 16029 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.032891 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.034492 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.035308 15832 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:35.039850 15952 leader_election.cc:343] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.041626 16029 ts_tablet_manager.cc:1434] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 12:23:35.046907 16244 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.047674 16244 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.049849 16244 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.052701 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.053490 15837 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:35.051678 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.054997 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.056001 16197 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.056413 16197 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.056769 16197 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.058772 16269 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.059693 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:35.061002 16053 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.061368 16053 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.061686 16053 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:35.069907 15952 leader_election.cc:343] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.071713 16053 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.076648 16029 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.077739 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.078451 15832 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.079324 16197 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.086493 16197 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.087742 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.087761 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:35.088581 15837 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:35.090124 15952 leader_election.cc:343] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.091385 16053 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.094949 15832 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.099717 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.098097 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:35.100941 16053 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.100088 16029 tablet_bootstrap.cc:654] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.099192 15837 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.101919 16053 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.104192 16053 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.102985 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:35.105664 16028 tablet_bootstrap.cc:492] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.106765 16028 ts_tablet_manager.cc:1403] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.083s	user 0.042s	sys 0.018s
I20260709 12:23:35.107663 16252 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.107921 16034 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.108392 16034 ts_tablet_manager.cc:1403] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.014s
I20260709 12:23:35.109380 16252 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.110352 16252 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.112828 15734 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.115826 15952 leader_election.cc:343] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.117692 16034 raft_consensus.cc:359] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.118332 16034 raft_consensus.cc:385] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.118577 16034 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.119184 16034 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.122076 16034 ts_tablet_manager.cc:1434] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:35.129643 16034 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.130159 16028 raft_consensus.cc:359] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.130800 16028 raft_consensus.cc:385] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.131036 16028 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.131646 16028 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.136514 16028 ts_tablet_manager.cc:1434] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:23:35.137382 16028 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.151037 16034 tablet_bootstrap.cc:654] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.161646 16269 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.169426 16269 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.169783 16269 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.171216 16028 tablet_bootstrap.cc:654] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.171439 16269 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.169261 16029 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.172513 16029 ts_tablet_manager.cc:1403] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.003s
I20260709 12:23:35.172575 15734 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.173193 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.173601 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:35.174467 15802 leader_election.cc:343] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.174217 15734 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.175863 15803 leader_election.cc:343] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.176235 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.176621 16034 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.177088 16034 ts_tablet_manager.cc:1403] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.002s
I20260709 12:23:35.177695 16029 raft_consensus.cc:359] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.178522 16259 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.178700 16029 raft_consensus.cc:385] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.178979 16029 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.178979 16259 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.179778 16269 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.180954 16259 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.182757 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.183074 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.183601 15837 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
W20260709 12:23:35.184017 15879 leader_election.cc:343] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.184859 15876 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.185870 16259 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.186225 16259 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.186609 16259 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.189865 16034 raft_consensus.cc:359] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.191051 16034 raft_consensus.cc:385] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.190932 16251 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.191332 16034 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.179836 16029 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.205660 16262 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.210716 16269 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.211229 16259 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.212716 16053 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.213158 16053 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.213975 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.214529 15838 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.214905 16053 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.216313 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:35.217556 15952 leader_election.cc:343] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.219070 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.219658 15832 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:35.220849 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:35.223588 16252 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.223927 16252 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.224242 16252 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.224854 15838 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:35.227072 16269 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.227531 16269 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.229699 15876 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:35.229949 16269 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.230607 16252 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.231271 16262 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.248266 16262 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:35.233902 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.249868 16262 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.249967 16251 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:35.251904 15802 leader_election.cc:343] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.233717 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.234601 16034 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.254500 16162 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.254990 16162 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.259052 16162 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.235348 16029 ts_tablet_manager.cc:1434] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:23:35.231411 16076 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.261188 16029 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.252539 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.266045 15832 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.266225 16252 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.266443 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:23:35.267787 15952 leader_election.cc:343] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.276551 16034 ts_tablet_manager.cc:1434] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.000s
I20260709 12:23:35.278494 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.261121 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:35.280498 15802 leader_election.cc:343] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.290503 16034 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
W20260709 12:23:35.281635 15803 leader_election.cc:343] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.292254 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.296128 16269 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.310118 16259 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:35.346841 15803 leader_election.cc:343] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.347427 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.350993 16311 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.351742 16029 tablet_bootstrap.cc:654] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.352190 16265 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.352562 16265 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.355149 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:35.357339 16034 tablet_bootstrap.cc:654] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.358436 16028 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.358916 16028 ts_tablet_manager.cc:1403] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.222s	user 0.027s	sys 0.016s
W20260709 12:23:35.359150 15879 leader_election.cc:343] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.360661 15832 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.369663 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.369755 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:23:35.371055 15802 leader_election.cc:343] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.370906 16053 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.373172 16265 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.375648 16034 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.376185 16034 ts_tablet_manager.cc:1403] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.011s
I20260709 12:23:35.378662 16034 raft_consensus.cc:359] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.371522 16252 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.384325 16252 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.385440 16252 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.389861 15733 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.367237 16028 raft_consensus.cc:359] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.393572 16028 raft_consensus.cc:385] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.393888 16028 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.394677 16028 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.398662 16028 ts_tablet_manager.cc:1434] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.005s
I20260709 12:23:35.398662 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.371446 16162 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.399793 16028 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.399989 16162 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.402405 16162 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.402573 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.402935 16034 raft_consensus.cc:385] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.403407 16034 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
W20260709 12:23:35.403973 15802 leader_election.cc:343] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.404737 16034 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.408427 16034 ts_tablet_manager.cc:1434] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:23:35.408746 16028 tablet_bootstrap.cc:654] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.411211 16197 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.411711 16197 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.414894 16034 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.415262 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.415467 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.421494 15838 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:35.422748 15952 leader_election.cc:343] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.423477 16029 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.426026 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:35.415721 16197 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.427507 16197 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.427896 16197 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.428278 16197 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.430624 15733 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.425583 16034 tablet_bootstrap.cc:654] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.439914 16197 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.423966 16029 ts_tablet_manager.cc:1403] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.016s
W20260709 12:23:35.416710 15803 leader_election.cc:343] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.443681 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.445016 16309 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.444478 16029 raft_consensus.cc:359] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.446161 16029 raft_consensus.cc:385] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.447093 16029 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.450671 16029 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.455472 16029 ts_tablet_manager.cc:1434] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.002s
I20260709 12:23:35.459052 16244 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.459717 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.460289 15838 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.460539 16029 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.467737 16034 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.468319 16034 ts_tablet_manager.cc:1403] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.001s
I20260709 12:23:35.468602 15838 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.469897 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.470731 16053 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.471277 16053 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.471992 16053 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.482089 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:35.482221 16162 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:35.483451 15952 leader_election.cc:343] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.488749 16034 raft_consensus.cc:359] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.489670 16034 raft_consensus.cc:385] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.490000 16034 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.490801 16034 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.497670 16029 tablet_bootstrap.cc:654] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:35.498149 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 53384us
I20260709 12:23:35.478628 16197 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.513669 16034 ts_tablet_manager.cc:1434] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:23:35.514621 16034 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.514986 15732 catalog_manager.cc:5697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.541024 16034 tablet_bootstrap.cc:654] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.546511 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:35.561471 15803 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.562052 15803 leader_election.cc:343] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.562435 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.563616 16162 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.564461 16252 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.565555 16259 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.564451 16028 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.566052 16259 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.566823 16028 ts_tablet_manager.cc:1403] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.167s	user 0.026s	sys 0.041s
I20260709 12:23:35.569535 16028 raft_consensus.cc:359] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.570232 16028 raft_consensus.cc:385] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.570505 16028 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.571187 16028 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.571630 16259 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.569469 16034 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.573359 16034 ts_tablet_manager.cc:1403] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.009s
I20260709 12:23:35.573503 16028 ts_tablet_manager.cc:1434] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:23:35.574792 16029 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.576009 16029 ts_tablet_manager.cc:1403] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.116s	user 0.023s	sys 0.021s
I20260709 12:23:35.576526 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.574888 16028 tablet_bootstrap.cc:492] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.579099 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.579764 15838 raft_consensus.cc:2393] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:35.580013 16034 raft_consensus.cc:359] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.580718 16034 raft_consensus.cc:385] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.581080 16034 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.581725 16034 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.583879 16029 raft_consensus.cc:359] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.585054 15876 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.588289 16028 tablet_bootstrap.cc:654] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.589272 16251 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.595023 16028 tablet_bootstrap.cc:492] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.595418 16028 ts_tablet_manager.cc:1403] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.003s
I20260709 12:23:35.597155 16029 raft_consensus.cc:385] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.597608 16029 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.598589 16162 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.598346 16029 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.599058 16162 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.600591 16029 ts_tablet_manager.cc:1434] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:23:35.601009 16162 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.586105 16034 ts_tablet_manager.cc:1434] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:23:35.601449 16029 tablet_bootstrap.cc:492] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.602041 16034 tablet_bootstrap.cc:492] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.602707 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:35.605944 15802 leader_election.cc:343] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.611548 16028 raft_consensus.cc:359] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.612227 16028 raft_consensus.cc:385] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.612493 16028 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.613112 16028 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.613981 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:35.617934 15803 leader_election.cc:343] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.618765 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.619387 16162 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.609584 16251 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.622810 16028 ts_tablet_manager.cc:1434] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:23:35.623726 16028 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.631524 16197 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.644299 16034 tablet_bootstrap.cc:654] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.656870 16029 tablet_bootstrap.cc:654] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.645315 16252 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.669526 16252 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:35.666297 15952 consensus_peers.cc:597] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.672039 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.672665 15835 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:35.652808 16028 tablet_bootstrap.cc:654] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.673174 16197 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.674106 16052 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.677879 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.678611 16052 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.678936 16052 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.679121 16252 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.679255 16052 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.682322 16028 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.682814 16028 ts_tablet_manager.cc:1403] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.006s
I20260709 12:23:35.684875 16034 tablet_bootstrap.cc:492] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.685379 16034 ts_tablet_manager.cc:1403] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.013s
I20260709 12:23:35.685300 16028 raft_consensus.cc:359] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.686014 16028 raft_consensus.cc:385] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.686301 16028 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.687059 16028 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.688614 16034 raft_consensus.cc:359] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.689320 16029 tablet_bootstrap.cc:492] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.689321 16034 raft_consensus.cc:385] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.689802 16029 ts_tablet_manager.cc:1403] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.002s
I20260709 12:23:35.689917 16034 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.690794 16034 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.694259 16244 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.694142 16029 raft_consensus.cc:359] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.695374 16034 ts_tablet_manager.cc:1434] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:35.696587 16028 ts_tablet_manager.cc:1434] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:35.697492 16028 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.695489 16029 raft_consensus.cc:385] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.698189 16029 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.698861 16029 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:35.657980 15879 consensus_peers.cc:597] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.700877 16029 ts_tablet_manager.cc:1434] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:23:35.701767 16029 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.703042 16052 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.703790 16034 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.704929 16052 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.705829 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.706374 15835 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.713104 15835 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.714285 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.714946 16052 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.715415 16028 tablet_bootstrap.cc:654] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.715669 16052 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.716535 16052 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.718274 16034 tablet_bootstrap.cc:654] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.718981 16029 tablet_bootstrap.cc:654] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.734757 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.734784 16028 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.735685 15913 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:35.736164 16311 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.736619 16311 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.738586 16311 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.740036 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:35.742015 15802 leader_election.cc:343] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.735695 16028 ts_tablet_manager.cc:1403] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 12:23:35.743805 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:35.744935 15803 leader_election.cc:343] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.745427 15803 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.746541 16029 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.747095 16029 ts_tablet_manager.cc:1403] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.003s
I20260709 12:23:35.748888 16311 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.754261 16028 raft_consensus.cc:359] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.755155 16028 raft_consensus.cc:385] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.756477 16028 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.759941 16028 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.762123 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:35.762832 15910 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.763803 16029 raft_consensus.cc:359] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.764708 16029 raft_consensus.cc:385] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.765048 16029 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.765857 16029 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.767967 15734 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.770486 16034 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:35.771437 16034 ts_tablet_manager.cc:1403] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.008s
I20260709 12:23:35.785492 16252 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.785959 16252 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.787150 16034 raft_consensus.cc:359] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.787981 16252 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.788038 16034 raft_consensus.cc:385] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.788534 16034 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.789145 16311 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.789734 16311 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.791303 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.791923 16311 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.792918 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:35.794183 15803 leader_election.cc:343] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.794464 16052 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.794201 16034 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.794850 16052 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.796835 16029 ts_tablet_manager.cc:1434] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:23:35.799348 16052 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.801877 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.802508 15832 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:35.803647 16076 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.804067 16076 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.780805 15910 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.805668 16076 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.806681 16028 ts_tablet_manager.cc:1434] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 12:23:35.807598 16028 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.808776 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.811439 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.812091 15837 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:35.812656 16028 tablet_bootstrap.cc:654] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.812956 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:35.813339 16029 tablet_bootstrap.cc:492] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.814159 16052 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.814469 16052 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.814741 16052 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.818696 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.818945 16029 tablet_bootstrap.cc:654] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.821979 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.822866 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.823164 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:35.824120 16259 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.820711 16052 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.824362 15952 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:35.825649 16197 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.825883 16052 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:35.828972 16028 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.829424 16028 ts_tablet_manager.cc:1403] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.000s
W20260709 12:23:35.829744 15952 leader_election.cc:343] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.830777 16259 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.832154 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:23:35.833428 15952 leader_election.cc:343] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.834393 16028 raft_consensus.cc:359] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.835070 16028 raft_consensus.cc:385] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.835352 16028 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.835875 16028 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:35.837718 15802 leader_election.cc:343] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.838133 16033 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.840287 16029 tablet_bootstrap.cc:492] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.840771 16029 ts_tablet_manager.cc:1403] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 12:23:35.841534 16028 ts_tablet_manager.cc:1434] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:35.838109 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.842383 16269 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.842626 16028 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.843920 16029 raft_consensus.cc:359] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.844561 16029 raft_consensus.cc:385] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.844816 16029 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.849347 16028 tablet_bootstrap.cc:654] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.840090 16034 ts_tablet_manager.cc:1434] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:23:35.850533 16034 tablet_bootstrap.cc:492] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Bootstrap starting.
I20260709 12:23:35.851156 16029 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.852136 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:35.852659 15838 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.855391 16029 ts_tablet_manager.cc:1434] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:23:35.856467 16029 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:35.862803 16028 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:35.868088 15838 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:35.868616 16252 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.875561 16028 ts_tablet_manager.cc:1403] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.003s
I20260709 12:23:35.879066 16029 tablet_bootstrap.cc:654] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.882045 16033 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.883210 16033 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.884310 16028 raft_consensus.cc:359] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.885022 16028 raft_consensus.cc:385] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.885377 16028 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.886091 16028 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.887533 16028 ts_tablet_manager.cc:1434] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:23:35.888201 16028 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:35.890529 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:35.891192 15838 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:35.893635 16033 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:35.896344 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:35.904337 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:35.906874 16053 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.907315 16053 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:35.907995 16053 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.910333 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:35.914077 15985 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.912493 15910 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.929095 16252 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.961148 16033 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.962019 16034 tablet_bootstrap.cc:654] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:35.967031 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:35.968255 16252 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:35.981236 16028 tablet_bootstrap.cc:654] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.990545 16029 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:35.991007 16029 ts_tablet_manager.cc:1403] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.000s
I20260709 12:23:35.995127 16029 raft_consensus.cc:359] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:35.995783 16029 raft_consensus.cc:385] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.996098 16029 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.996767 16029 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.001129 15733 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.003886 16269 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.004348 16269 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.006309 16269 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.009811 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.010100 16029 ts_tablet_manager.cc:1434] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:36.010977 16029 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:36.012974 15802 leader_election.cc:343] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.033376 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:23:36.036650 15803 leader_election.cc:343] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.037065 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.040364 16269 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.045068 16053 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.045490 16053 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.047231 16053 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.049407 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.050020 15835 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.051685 16053 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.053354 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.053459 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:23:36.055006 15952 leader_election.cc:343] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.055414 16052 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.055771 16052 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.055864 16244 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.056102 16052 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.056289 16244 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.057200 16034 tablet_bootstrap.cc:492] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: No bootstrap required, opened a new log
I20260709 12:23:36.058550 16034 ts_tablet_manager.cc:1403] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Time spent bootstrapping tablet: real 0.208s	user 0.019s	sys 0.014s
I20260709 12:23:36.058230 16244 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.061007 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.061722 15832 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.083202 16052 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.081184 16076 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.116355 16028 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.116946 16028 ts_tablet_manager.cc:1403] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.229s	user 0.010s	sys 0.006s
I20260709 12:23:36.114998 16076 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.114177 16252 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.118538 16252 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.119336 16076 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.120378 16252 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.119240 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.120692 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.121325 15837 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:36.122330 15876 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:36.123042 16076 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.123450 16076 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.123864 16076 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.112417 16251 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.067518 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.128592 16034 raft_consensus.cc:359] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.129232 16034 raft_consensus.cc:385] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.129469 16034 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.130082 16034 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.137243 16052 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.140334 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.140877 15837 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.135989 16251 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.144153 16029 tablet_bootstrap.cc:654] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.149510 15950 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.149847 16076 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.151337 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.152014 16052 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.152277 16053 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.152565 16052 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.152719 16053 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.152943 16052 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.153138 16053 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.150581 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.154466 16076 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.155217 16034 ts_tablet_manager.cc:1434] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
I20260709 12:23:36.155290 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.156002 15837 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.166682 16028 raft_consensus.cc:359] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.167318 16028 raft_consensus.cc:385] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.167553 16028 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.168157 16028 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:36.170787 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51359.8us
I20260709 12:23:36.171099 15837 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:36.172084 15876 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:36.172274 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.173488 16251 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.175494 16052 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.177659 15985 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:36.179661 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.174834 15913 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:36.182014 16076 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.182452 16076 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:36.159332 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.184362 15988 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.184217 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:36.183243 16076 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.188592 16053 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.191319 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.195063 15837 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:36.194451 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.197456 15987 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:36.192343 16028 ts_tablet_manager.cc:1434] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.001s
I20260709 12:23:36.199265 16028 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.191721 15832 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.192842 16052 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:36.193104 15952 leader_election.cc:343] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:36.202039 15952 leader_election.cc:343] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.206687 16053 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.207007 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.207146 16053 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.207561 15837 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.210244 15913 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.212731 15879 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.216030 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.218211 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.224249 16029 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.224732 16029 ts_tablet_manager.cc:1403] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.000s
W20260709 12:23:36.219555 15952 leader_election.cc:343] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.225700 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:36.226425 16197 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.227625 16029 raft_consensus.cc:359] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.228364 16029 raft_consensus.cc:385] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.228688 16029 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.229368 16029 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.230266 15837 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.231954 16029 ts_tablet_manager.cc:1434] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:36.232928 16029 tablet_bootstrap.cc:492] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.234318 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.240110 16197 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.240705 16197 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.241714 16197 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.245990 16028 tablet_bootstrap.cc:654] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.234450 16033 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.252041 16053 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.259055 15832 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.264055 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.264976 16052 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.265515 16052 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.266499 16052 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.277263 15731 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.308806 16029 tablet_bootstrap.cc:654] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.353889 16033 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.354413 16033 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.356844 16033 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.357064 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.357775 15837 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:36.359025 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:36.359151 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.359935 16033 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.360378 16033 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:36.360836 15879 leader_election.cc:343] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.360586 15732 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.365808 16029 tablet_bootstrap.cc:492] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.365888 15732 catalog_manager.cc:5697] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.366715 16029 ts_tablet_manager.cc:1403] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.000s
I20260709 12:23:36.368590 16033 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.369120 16029 raft_consensus.cc:359] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.370102 16029 raft_consensus.cc:385] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.370353 16029 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.370975 16029 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.372802 16029 ts_tablet_manager.cc:1434] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:36.374660 16029 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.374749 16033 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.361267 16028 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.377458 16028 ts_tablet_manager.cc:1403] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.178s	user 0.008s	sys 0.005s
I20260709 12:23:36.380029 16028 raft_consensus.cc:359] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.380630 16028 raft_consensus.cc:385] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:36.380862 15952 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.380935 16028 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.387579 16033 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.388715 16029 tablet_bootstrap.cc:654] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.389029 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:23:36.390432 15879 leader_election.cc:343] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.391333 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.391484 16028 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.391970 15832 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.393597 16028 ts_tablet_manager.cc:1434] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:36.394387 16028 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.399721 16028 tablet_bootstrap.cc:654] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.412115 15832 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:36.413300 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.414323 16076 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.414759 16076 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:36.415506 16076 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.416254 16252 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.451524 16029 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.452028 16029 ts_tablet_manager.cc:1403] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.023s
I20260709 12:23:36.456323 16029 raft_consensus.cc:359] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.457026 16029 raft_consensus.cc:385] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.457331 16029 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.457962 16029 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.460230 16029 ts_tablet_manager.cc:1434] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:23:36.460378 16028 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.460822 16028 ts_tablet_manager.cc:1403] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.021s
I20260709 12:23:36.461108 16029 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.462881 16052 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.463217 16028 raft_consensus.cc:359] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.463923 16028 raft_consensus.cc:385] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.464193 16028 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.464794 16028 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.466238 16311 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.466677 16311 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.467379 16029 tablet_bootstrap.cc:654] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.468614 16311 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.463291 16052 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.470796 16028 ts_tablet_manager.cc:1434] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:36.471674 16028 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.477150 16028 tablet_bootstrap.cc:654] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.477718 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.472705 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.478034 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.479993 15837 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
W20260709 12:23:36.480258 15803 leader_election.cc:343] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.481357 15950 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.482295 16252 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.482625 16252 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.482949 16252 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:36.487874 15802 leader_election.cc:343] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.488312 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.489784 16311 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.479382 16052 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.497787 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:36.502038 15952 leader_election.cc:343] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.496819 16028 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.504195 16033 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.505548 16028 ts_tablet_manager.cc:1403] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 12:23:36.505616 16033 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.506595 16252 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.508126 16033 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.510547 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.511086 15837 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:36.510982 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.511991 15984 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:36.513347 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:36.514029 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.514590 15837 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.514463 16028 raft_consensus.cc:359] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.515136 16028 raft_consensus.cc:385] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.515417 16028 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.515731 16033 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.516053 16028 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.516458 16033 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.516947 16033 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.521528 16252 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.522907 15837 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.523826 15733 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.525830 15950 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.527331 16244 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.528100 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.529234 16028 ts_tablet_manager.cc:1434] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 12:23:36.535768 16028 tablet_bootstrap.cc:492] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.535717 16033 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.539636 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:36.540346 15984 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.544342 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.546262 16076 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.546675 16076 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.548408 16076 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.550338 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.551200 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.551968 15832 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:36.544888 15834 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.554364 15984 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:36.555923 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.556929 16076 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.556974 16033 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.557471 16076 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:36.558240 16076 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.559173 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.560041 16029 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.561446 16029 ts_tablet_manager.cc:1403] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.101s	user 0.034s	sys 0.030s
I20260709 12:23:36.562320 16259 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.564661 15834 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:36.564714 16029 raft_consensus.cc:359] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.565568 16029 raft_consensus.cc:385] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.565881 16029 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.566536 16029 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.568863 16029 ts_tablet_manager.cc:1434] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:36.569290 16028 tablet_bootstrap.cc:654] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.569839 16029 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:36.571774 15952 leader_election.cc:343] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.575752 16259 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.573019 16244 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.578287 16244 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.589349 15733 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.590395 16029 tablet_bootstrap.cc:654] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.597026 16028 tablet_bootstrap.cc:492] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.597502 16028 ts_tablet_manager.cc:1403] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.006s
I20260709 12:23:36.600216 16028 raft_consensus.cc:359] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.600903 16028 raft_consensus.cc:385] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.601212 16028 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.601979 16028 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.604063 16252 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.604554 16252 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.605844 16028 ts_tablet_manager.cc:1434] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:36.606817 16028 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.608784 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.609479 15834 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.610505 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.612180 16076 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.612622 16076 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.613541 16028 tablet_bootstrap.cc:654] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.614619 16076 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:36.616158 15952 leader_election.cc:343] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.616160 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.617761 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.618546 16383 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.606714 16252 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.618875 16383 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.619220 16383 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.618881 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.622310 15876 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.624464 16076 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.625229 16028 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.625692 16028 ts_tablet_manager.cc:1403] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:23:36.625973 16383 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.627897 16028 raft_consensus.cc:359] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.628595 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.628914 16244 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.628813 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.629467 15834 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.629427 16244 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:36.630190 15952 leader_election.cc:343] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.628582 16028 raft_consensus.cc:385] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.630743 16028 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.631457 16244 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.631642 16028 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.632426 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.633003 15837 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.633982 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.634102 16028 ts_tablet_manager.cc:1434] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:23:36.628671 15733 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.635610 16028 tablet_bootstrap.cc:492] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.636473 16076 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.637815 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.638423 16252 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.638921 16252 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.639940 16252 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:36.640116 15952 leader_election.cc:343] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.642577 16028 tablet_bootstrap.cc:654] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.644874 15911 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.648166 15834 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.651624 16252 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.654460 16028 tablet_bootstrap.cc:492] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.655004 16028 ts_tablet_manager.cc:1403] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:23:36.652495 16383 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.652664 16029 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.656816 16029 ts_tablet_manager.cc:1403] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.012s
I20260709 12:23:36.657816 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.659005 16028 raft_consensus.cc:359] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.660868 16028 raft_consensus.cc:385] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.661240 16028 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.661381 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.659976 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.662057 15834 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:36.662675 15952 leader_election.cc:343] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.660502 16252 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.664422 16028 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.675089 16028 ts_tablet_manager.cc:1434] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:36.677070 16028 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Bootstrap starting.
I20260709 12:23:36.673709 16383 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.678233 16029 raft_consensus.cc:359] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.678740 16029 raft_consensus.cc:385] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.679243 16029 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.679809 16029 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.680648 16383 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.683324 16029 ts_tablet_manager.cc:1434] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:23:36.689781 16029 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.694473 16028 tablet_bootstrap.cc:654] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.683357 16383 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.720294 16029 tablet_bootstrap.cc:654] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.728835 16259 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:36.743494 15952 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.749753 15834 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.750844 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.751899 16028 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: No bootstrap required, opened a new log
I20260709 12:23:36.752343 16028 ts_tablet_manager.cc:1403] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.018s
I20260709 12:23:36.753057 16029 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.753988 16029 ts_tablet_manager.cc:1403] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 12:23:36.755128 16401 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.756547 16029 raft_consensus.cc:359] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.757234 16029 raft_consensus.cc:385] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.757121 16028 raft_consensus.cc:359] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.757779 16028 raft_consensus.cc:385] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.758026 16028 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.755689 16401 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.758653 16028 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.759207 16401 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.757485 16029 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.760643 16028 ts_tablet_manager.cc:1434] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:23:36.760406 16029 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.762306 16029 ts_tablet_manager.cc:1434] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:36.763470 16029 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.766083 15731 catalog_manager.cc:5697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.768968 16029 tablet_bootstrap.cc:654] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.790673 16029 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.791103 16029 ts_tablet_manager.cc:1403] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.002s
I20260709 12:23:36.791705 16244 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.793572 16029 raft_consensus.cc:359] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.794278 16029 raft_consensus.cc:385] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.794567 16029 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.795450 16252 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.795203 16029 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.795233 16402 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.802983 16244 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.803504 16244 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.805565 16244 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.806826 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.807457 15837 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.807607 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.808202 16029 ts_tablet_manager.cc:1434] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
W20260709 12:23:36.809226 15952 leader_election.cc:343] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.809214 16029 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.811385 15950 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.812855 16402 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.813241 16402 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.813586 16402 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.816771 16029 tablet_bootstrap.cc:654] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.818229 15731 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.844177 16402 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.850433 16402 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.854411 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.855067 15835 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.856729 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:23:36.858377 15952 leader_election.cc:343] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.860921 16373 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.861410 16373 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.863708 15835 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.863806 16373 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.864147 15987 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.865370 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.869876 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.870595 15835 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 1: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:23:36.874572 15950 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.875295 16401 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.875823 16401 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.875684 16259 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.876776 16401 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.877959 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:36.878877 16244 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.883750 16029 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.884271 16029 ts_tablet_manager.cc:1403] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.007s
I20260709 12:23:36.891103 16251 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.892217 16029 raft_consensus.cc:359] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.893522 16029 raft_consensus.cc:385] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.893850 16029 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.895076 16029 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.900956 16029 ts_tablet_manager.cc:1434] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:23:36.902051 16029 tablet_bootstrap.cc:492] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.909595 15733 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.913470 16029 tablet_bootstrap.cc:654] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.923003 16401 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.923486 16401 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.925520 16401 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.927119 16033 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.927579 16033 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.927882 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.928527 15834 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 0.
I20260709 12:23:36.929394 16033 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.930052 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:36.930173 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:36.930672 16029 tablet_bootstrap.cc:492] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.930894 16252 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.931107 16029 ts_tablet_manager.cc:1403] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 12:23:36.931241 16252 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:36.931346 15952 leader_election.cc:343] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.931603 16252 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.932821 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.938262 16029 raft_consensus.cc:359] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.938894 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.939949 15834 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:36.941030 15876 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:36.942061 16251 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.938920 16029 raft_consensus.cc:385] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.952853 16252 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.953454 16029 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.954252 16029 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.954780 16252 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:36.956476 16029 ts_tablet_manager.cc:1434] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:23:36.958201 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:36.958431 16029 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
W20260709 12:23:36.959833 15952 leader_election.cc:343] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.948943 16251 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.960688 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:36.963822 15834 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.964025 16029 tablet_bootstrap.cc:654] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.974537 15834 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:36.974896 16029 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:36.975333 16029 ts_tablet_manager.cc:1403] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260709 12:23:36.975558 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:36.977802 16029 raft_consensus.cc:359] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.978434 16029 raft_consensus.cc:385] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.978689 16029 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.979286 16029 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.981261 16029 ts_tablet_manager.cc:1434] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:36.982141 16029 tablet_bootstrap.cc:492] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Bootstrap starting.
I20260709 12:23:36.984215 16401 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.984746 16401 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:36.985630 16401 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.987699 16029 tablet_bootstrap.cc:654] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.990468 15913 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.991894 16259 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.992338 16259 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:36.994275 16259 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:36.995643 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:36.995744 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:36.996364 15984 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:36.996587 15834 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 0.
I20260709 12:23:36.998062 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:37.000195 16259 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:37.000551 16259 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.000880 16259 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.002754 16029 tablet_bootstrap.cc:492] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: No bootstrap required, opened a new log
I20260709 12:23:37.003229 16029 ts_tablet_manager.cc:1403] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 12:23:37.005833 16029 raft_consensus.cc:359] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.006495 16029 raft_consensus.cc:385] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:37.006795 16029 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.007504 16029 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.009533 16029 ts_tablet_manager.cc:1434] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:37.010703 15734 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.016896 16251 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.017443 16251 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.020784 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:37.021597 15834 raft_consensus.cc:2393] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:37.023234 16259 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.024549 16251 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:37.026167 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:37.026577 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:37.026712 15837 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.029990 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:37.031174 16076 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.036723 16076 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:37.038089 15837 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:37.039091 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:37.039918 16076 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:37.040548 16076 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:37.042750 16033 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.044955 16033 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.048666 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:37.049275 15988 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.049624 16076 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.052421 16251 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.052897 16251 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.054895 16251 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:37.056852 15988 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:37.057554 16259 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:37.058915 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:37.059212 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:37.063458 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:37.064126 16259 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:37.119629 15783 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:37.149271 16402 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:37.151381 16262 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.152426 16262 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.155421 16262 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:37.162024 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:37.163208 15838 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:37.162072 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:37.169370 15913 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.185379 16401 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:37.188885 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:37.192297 16251 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.219703 16262 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.220348 16401 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.220456 16262 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:37.224133 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:37.225347 15834 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 1: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:23:37.241142 15910 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.248337 16262 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:37.250262 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:37.257390 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:37.258665 16076 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.264966 16251 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:37.274425 16076 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:37.275085 15733 catalog_manager.cc:5697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 0 to 1, leader changed from <none> to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.279597 16244 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:37.280557 16401 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.312950 16252 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:37.353781 16402 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:37.379158 16402 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.491328 16251 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.502620 16402 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.506476 16251 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:37.532203 16401 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:38.739132 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.767127 16451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.767164 16449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.767457 16448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.768353 14649 server_base.cc:1061] running on GCE node
I20260709 12:23:38.769858 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.770045 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.770187 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783599818770176 us; error 0 us; skew 500 ppm
I20260709 12:23:38.770651 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.773729 14649 webserver.cc:533] Webserver started at http://127.14.78.68:36127/ using document root <none> and password file <none>
I20260709 12:23:38.774381 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.774628 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.775056 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.776850 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-3-root/instance:
uuid: "2fa3925738bd485e912c7ac0e28b0265"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-vrh7"
I20260709 12:23:38.782814 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 12:23:38.787288 16456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.788467 14649 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:23:38.788805 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-3-root
uuid: "2fa3925738bd485e912c7ac0e28b0265"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-vrh7"
I20260709 12:23:38.789530 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.820689 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.823788 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.825685 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.828922 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.829278 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:23:38.829625 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.829901 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.883384 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.68:43743
I20260709 12:23:38.883509 16521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.68:43743 every 8 connection(s)
I20260709 12:23:38.889642 14649 auto_leader_rebalancer-test.cc:439] add a tserver: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:38.901018 16522 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37123
I20260709 12:23:38.901544 16522 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.902230 16522 heartbeater.cc:507] Master 127.14.78.126:37123 requested a full tablet report, sending...
I20260709 12:23:38.904152 15734 ts_manager.cc:194] Registered new tserver with Master: 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:38.905835 15734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34080
I20260709 12:23:39.260320 15834 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:39.277539 15913 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.278884 15987 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.278926 16530 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:39.280411 16309 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:39.292076 15803 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12b10f85daf040e1af9735597b9af404. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.295222 16461 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.298095 15987 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.302040 15910 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.319007 15731 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.343492 15988 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:39.354460 15910 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.355863 16539 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.359064 15834 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.360265 16539 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.368463 16402 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.378007 15834 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:23:39.388240 15953 consensus_peers.cc:597] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7571c77d7cc54b31955653214a4cee6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.389829 15913 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.393143 15987 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:39.415601 15733 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:39.418761 15953 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c8f740585214d0fb73ad203c56cbaaf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.425141 15834 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.427181 16252 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.427481 15913 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.432713 16402 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.460039 16252 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.461851 15913 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.475481 15987 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:39.474610 15832 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.480887 15734 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:39.484158 15953 consensus_peers.cc:597] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b792e6a0c581428bae7ae0020c5c6edc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.484571 15913 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.497931 16402 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.510655 15832 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.511986 16528 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.521988 16402 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.524791 15832 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.528692 15913 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.541028 15734 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:39.736549 16553 ts_tablet_manager.cc:933] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:23:39.743029 16553 tablet_copy_client.cc:323] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:23:39.756631 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 12b10f85daf040e1af9735597b9af404 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:23:39.757156 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 12b10f85daf040e1af9735597b9af404 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-12b10f85daf040e1af9735597b9af404
I20260709 12:23:39.762538 15848 tablet_copy_source_session.cc:215] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.771142 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b10f85daf040e1af9735597b9af404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.784509 16553 tablet_copy_client.cc:806] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.785141 16553 tablet_copy_client.cc:670] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.789350 16553 tablet_copy_client.cc:538] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.797843 16553 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:39.825004 16553 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:39.826043 16553 tablet_bootstrap.cc:492] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:39.826756 16553 ts_tablet_manager.cc:1403] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:23:39.829974 16553 raft_consensus.cc:359] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:39.830902 16553 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:39.831647 16553 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:39.833832 16522 heartbeater.cc:499] Master 127.14.78.126:37123 was elected leader, sending a full tablet report...
I20260709 12:23:39.834589 16553 ts_tablet_manager.cc:1434] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:23:39.836760 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-12b10f85daf040e1af9735597b9af404 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:23:39.837379 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-12b10f85daf040e1af9735597b9af404 on tablet 12b10f85daf040e1af9735597b9af404 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:39.898519 16553 ts_tablet_manager.cc:933] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:39.903172 16553 tablet_copy_client.cc:323] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:39.910104 16561 ts_tablet_manager.cc:933] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:39.916504 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet b792e6a0c581428bae7ae0020c5c6edc from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:39.917115 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet b792e6a0c581428bae7ae0020c5c6edc from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-b792e6a0c581428bae7ae0020c5c6edc
I20260709 12:23:39.929183 15998 tablet_copy_source_session.cc:215] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.929214 16561 tablet_copy_client.cc:323] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:39.933100 16553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b792e6a0c581428bae7ae0020c5c6edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.933320 16563 ts_tablet_manager.cc:933] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:39.935830 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 7c8f740585214d0fb73ad203c56cbaaf from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:39.936344 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 7c8f740585214d0fb73ad203c56cbaaf from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-7c8f740585214d0fb73ad203c56cbaaf
I20260709 12:23:39.943595 15998 tablet_copy_source_session.cc:215] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.946208 16563 tablet_copy_client.cc:323] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:39.946439 16561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f740585214d0fb73ad203c56cbaaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.948748 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 7571c77d7cc54b31955653214a4cee6c from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:39.949290 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 7571c77d7cc54b31955653214a4cee6c from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-7571c77d7cc54b31955653214a4cee6c
I20260709 12:23:39.952024 16553 tablet_copy_client.cc:806] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.952987 16553 tablet_copy_client.cc:670] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.959115 15998 tablet_copy_source_session.cc:215] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.961966 16553 tablet_copy_client.cc:538] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.962772 16563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7571c77d7cc54b31955653214a4cee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.974135 16553 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:39.986025 16563 tablet_copy_client.cc:806] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.986634 16563 tablet_copy_client.cc:670] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.990406 16563 tablet_copy_client.cc:538] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.996585 16561 tablet_copy_client.cc:806] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.997162 16561 tablet_copy_client.cc:670] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.000612 16561 tablet_copy_client.cc:538] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.006301 16563 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:40.011765 16553 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.012641 16553 tablet_bootstrap.cc:492] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:40.013294 16553 ts_tablet_manager.cc:1403] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.001s
I20260709 12:23:40.016127 16553 raft_consensus.cc:359] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:40.016918 16553 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:40.017189 16561 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:40.017570 16553 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:40.019870 16553 ts_tablet_manager.cc:1434] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:40.021564 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-b792e6a0c581428bae7ae0020c5c6edc received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:40.022049 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-b792e6a0c581428bae7ae0020c5c6edc on tablet b792e6a0c581428bae7ae0020c5c6edc with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:40.047282 16561 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.048215 16561 tablet_bootstrap.cc:492] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:40.048935 16561 ts_tablet_manager.cc:1403] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 12:23:40.051805 16561 raft_consensus.cc:359] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:40.052660 16561 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:40.054548 16561 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:40.056167 16563 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.057065 16563 tablet_bootstrap.cc:492] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:40.057718 16563 ts_tablet_manager.cc:1403] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.007s
I20260709 12:23:40.060202 16561 ts_tablet_manager.cc:1434] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:23:40.061717 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7c8f740585214d0fb73ad203c56cbaaf received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:40.061429 16563 raft_consensus.cc:359] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:40.062134 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7c8f740585214d0fb73ad203c56cbaaf on tablet 7c8f740585214d0fb73ad203c56cbaaf with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:40.062239 16563 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:40.062924 16563 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:40.065802 16563 ts_tablet_manager.cc:1434] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:23:40.067163 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7571c77d7cc54b31955653214a4cee6c received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:40.067518 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7571c77d7cc54b31955653214a4cee6c on tablet 7571c77d7cc54b31955653214a4cee6c with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:40.263041 16496 raft_consensus.cc:1217] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.333869 16496 raft_consensus.cc:1217] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.407143 16496 raft_consensus.cc:1217] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.513702 16496 raft_consensus.cc:1217] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.828718 16570 raft_consensus.cc:1064] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:40.831542 16570 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:40.838742 16496 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.839630 15987 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.840268 15908 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.841328 16537 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.843045 16537 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.844779 16537 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.870409 16570 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:40.873979 15987 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:40.886620 16496 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:40.896152 15731 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:40.907210 16568 raft_consensus.cc:1064] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:40.910737 16568 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:40.936861 16402 raft_consensus.cc:1064] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:40.941939 16496 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.939181 16402 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:40.943367 16252 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.950155 15908 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:40.960374 15910 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.963634 16528 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:40.976938 15834 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.978735 16252 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.979111 15834 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.979684 16496 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.979984 15913 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.981623 16252 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.982983 16528 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.984419 16581 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.006264 16402 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.008221 15910 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.017987 15834 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.019502 16496 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.033624 16568 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.047986 16528 raft_consensus.cc:1064] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:41.051630 16528 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:41.062004 16495 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.063460 15832 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.081414 15910 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.090920 15832 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.091212 15910 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.092628 16581 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.098932 16495 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.100369 16581 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.106267 15733 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.107733 15733 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.129662 16402 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:41.137192 15987 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:41.145588 15988 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:41.148893 15837 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:41.153903 16496 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.155434 15908 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.157388 16570 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:41.169018 16537 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.177202 15834 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.179136 16496 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.182137 16528 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.185251 16568 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.186494 16569 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.187808 16495 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.184738 16528 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:23:41.203330 16252 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.203770 15731 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.204326 15834 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.213708 15911 raft_consensus.cc:2955] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.221714 16496 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.223910 15908 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.229630 15838 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.238420 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12b10f85daf040e1af9735597b9af404 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.244794 15731 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.256484 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 12b10f85daf040e1af9735597b9af404 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:41.268566 15834 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.270057 16588 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:41.270560 16495 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.271838 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c8f740585214d0fb73ad203c56cbaaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.273126 16496 raft_consensus.cc:2955] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.275938 16588 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.292147 15733 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.296470 16528 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.298859 15834 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.307479 16596 tablet_replica.cc:333] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:41.314270 16596 raft_consensus.cc:2243] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.315047 16596 raft_consensus.cc:2272] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.307242 15988 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:41.320998 16596 ts_tablet_manager.cc:1916] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.322778 16496 raft_consensus.cc:2955] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.324573 16495 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.326197 16252 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.331207 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c8f740585214d0fb73ad203c56cbaaf with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:41.337558 16588 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.339794 15731 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.345702 16494 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.353772 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet b792e6a0c581428bae7ae0020c5c6edc with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:41.356398 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b792e6a0c581428bae7ae0020c5c6edc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.360211 15911 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.356953 16598 tablet_replica.cc:333] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:41.365686 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7571c77d7cc54b31955653214a4cee6c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.368947 15731 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.370358 16528 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.376713 15911 raft_consensus.cc:2955] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:41.378082 16598 raft_consensus.cc:2243] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.379079 16598 raft_consensus.cc:2272] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.382247 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 7571c77d7cc54b31955653214a4cee6c with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:23:41.406061 16596 ts_tablet_manager.cc:1929] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.406682 16596 log.cc:1199] T 12b10f85daf040e1af9735597b9af404 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/12b10f85daf040e1af9735597b9af404
I20260709 12:23:41.409132 16599 tablet_replica.cc:333] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:23:41.409188 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 12b10f85daf040e1af9735597b9af404 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:41.410451 16599 raft_consensus.cc:2243] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.412043 16599 raft_consensus.cc:2272] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.415364 16598 ts_tablet_manager.cc:1916] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.421228 16599 ts_tablet_manager.cc:1916] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.439471 16598 ts_tablet_manager.cc:1929] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.439980 16598 log.cc:1199] T 7c8f740585214d0fb73ad203c56cbaaf P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/7c8f740585214d0fb73ad203c56cbaaf
I20260709 12:23:41.441751 16598 tablet_replica.cc:333] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:41.441877 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 7c8f740585214d0fb73ad203c56cbaaf (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:41.442858 16598 raft_consensus.cc:2243] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.443487 16599 ts_tablet_manager.cc:1929] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.443638 16598 raft_consensus.cc:2272] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.444623 16599 log.cc:1199] T 7571c77d7cc54b31955653214a4cee6c P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/7571c77d7cc54b31955653214a4cee6c
I20260709 12:23:41.446389 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 7571c77d7cc54b31955653214a4cee6c (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:41.448868 16598 ts_tablet_manager.cc:1916] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.459074 16598 ts_tablet_manager.cc:1929] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.459324 16598 log.cc:1199] T b792e6a0c581428bae7ae0020c5c6edc P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/b792e6a0c581428bae7ae0020c5c6edc
I20260709 12:23:41.460656 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet b792e6a0c581428bae7ae0020c5c6edc (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:42.458498 15911 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:42.464751 15838 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.466370 15984 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.466416 16603 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:42.467942 16590 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:42.477921 15879 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5521db1dbeb94ad8ae63681494d5565d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.478320 16603 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.479957 15838 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.482684 15984 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.494436 15911 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:42.495054 15731 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.523882 15838 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.525336 16590 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.531090 15984 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:42.531342 15879 consensus_peers.cc:597] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21c971bd20d548a8a1dd8f98022a1f7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.532857 16590 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.537103 16603 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.554903 15838 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.559398 15988 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:42.561081 15987 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.565483 15734 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.567591 15911 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.569109 16615 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:42.570675 15953 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 506492d6bd024ce682676a3ecdcf186f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.574934 15834 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.586915 16588 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.591114 16252 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.597940 15911 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.613802 15838 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:42.617233 15731 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.633095 15834 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.633111 15988 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:42.637256 15803 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 661598743dad4055844a0b0f97c07156. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.639093 16569 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.644268 15910 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.648605 16569 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:42.671977 16569 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.674466 15987 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.686265 15908 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:42.702759 15731 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.914225 16626 ts_tablet_manager.cc:933] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:42.921689 16626 tablet_copy_client.cc:323] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:42.932111 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 21c971bd20d548a8a1dd8f98022a1f7e from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:42.932714 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 21c971bd20d548a8a1dd8f98022a1f7e from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-21c971bd20d548a8a1dd8f98022a1f7e
I20260709 12:23:42.939499 15923 tablet_copy_source_session.cc:215] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.942384 16626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c971bd20d548a8a1dd8f98022a1f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.956918 16626 tablet_copy_client.cc:806] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.957495 16626 tablet_copy_client.cc:670] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.965456 16626 tablet_copy_client.cc:538] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.971324 16629 ts_tablet_manager.cc:933] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:42.972102 16626 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:42.976408 16629 tablet_copy_client.cc:323] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:42.978050 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 5521db1dbeb94ad8ae63681494d5565d from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:42.978556 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 5521db1dbeb94ad8ae63681494d5565d from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-5521db1dbeb94ad8ae63681494d5565d
I20260709 12:23:42.985942 15923 tablet_copy_source_session.cc:215] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.990737 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5521db1dbeb94ad8ae63681494d5565d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.996044 16626 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.996893 16626 tablet_bootstrap.cc:492] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:42.997532 16626 ts_tablet_manager.cc:1403] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.008s
I20260709 12:23:43.001906 16626 raft_consensus.cc:359] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.003602 16626 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:43.004258 16626 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.009760 16626 ts_tablet_manager.cc:1434] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:23:43.011788 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-21c971bd20d548a8a1dd8f98022a1f7e received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:43.012204 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-21c971bd20d548a8a1dd8f98022a1f7e on tablet 21c971bd20d548a8a1dd8f98022a1f7e with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:43.013852 16629 tablet_copy_client.cc:806] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.014475 16629 tablet_copy_client.cc:670] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.017999 16626 ts_tablet_manager.cc:933] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:43.018311 16629 tablet_copy_client.cc:538] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.020303 16626 tablet_copy_client.cc:323] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:43.021811 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 506492d6bd024ce682676a3ecdcf186f from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:43.022328 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 506492d6bd024ce682676a3ecdcf186f from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-506492d6bd024ce682676a3ecdcf186f
I20260709 12:23:43.027906 15998 tablet_copy_source_session.cc:215] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:43.028764 16629 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:43.030198 16626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506492d6bd024ce682676a3ecdcf186f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:43.047153 16626 tablet_copy_client.cc:806] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.047667 16626 tablet_copy_client.cc:670] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.051534 16626 tablet_copy_client.cc:538] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.056856 16629 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.057724 16629 tablet_bootstrap.cc:492] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:43.058355 16629 ts_tablet_manager.cc:1403] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.003s
I20260709 12:23:43.059757 16626 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:43.061269 16629 raft_consensus.cc:359] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.062095 16629 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:43.062711 16629 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.065266 16629 ts_tablet_manager.cc:1434] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:23:43.067498 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-5521db1dbeb94ad8ae63681494d5565d received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:43.067876 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-5521db1dbeb94ad8ae63681494d5565d on tablet 5521db1dbeb94ad8ae63681494d5565d with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:43.081470 16626 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.082293 16626 tablet_bootstrap.cc:492] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:43.082902 16626 ts_tablet_manager.cc:1403] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:23:43.085580 16626 raft_consensus.cc:359] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.086347 16626 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:43.086935 16626 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.089214 16626 ts_tablet_manager.cc:1434] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:43.091089 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-506492d6bd024ce682676a3ecdcf186f received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:43.091477 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-506492d6bd024ce682676a3ecdcf186f on tablet 506492d6bd024ce682676a3ecdcf186f with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:43.093773 16629 ts_tablet_manager.cc:933] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:23:43.103367 16629 tablet_copy_client.cc:323] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:23:43.104964 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 661598743dad4055844a0b0f97c07156 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:23:43.105456 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 661598743dad4055844a0b0f97c07156 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-661598743dad4055844a0b0f97c07156
I20260709 12:23:43.111927 15848 tablet_copy_source_session.cc:215] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:43.115978 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661598743dad4055844a0b0f97c07156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:43.131918 16629 tablet_copy_client.cc:806] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.132481 16629 tablet_copy_client.cc:670] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.135962 16629 tablet_copy_client.cc:538] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.141654 16629 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:43.155867 16629 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.156515 16629 tablet_bootstrap.cc:492] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:43.157017 16629 ts_tablet_manager.cc:1403] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:23:43.160066 16629 raft_consensus.cc:359] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.160851 16629 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:43.161520 16629 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:43.163769 16629 ts_tablet_manager.cc:1434] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:43.167198 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-661598743dad4055844a0b0f97c07156 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:23:43.167590 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-661598743dad4055844a0b0f97c07156 on tablet 661598743dad4055844a0b0f97c07156 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:43.344305 16494 raft_consensus.cc:1217] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.487107 16494 raft_consensus.cc:1217] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.508720 16494 raft_consensus.cc:1217] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.562269 16494 raft_consensus.cc:1217] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.947233 16625 raft_consensus.cc:1064] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:43.949795 16625 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:43.956841 16494 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.956966 15987 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.957736 15838 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.958506 16590 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.959307 16603 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.960191 16639 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.980193 16639 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:43.982304 16494 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:43.990785 15838 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.002331 15734 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.014329 15988 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.045406 16624 raft_consensus.cc:1064] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:44.048018 16624 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.055049 16494 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.056550 15988 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.056448 16624 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.057767 15910 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.059523 16569 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.060284 16638 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.069224 15908 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.080389 16495 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.082396 16639 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.083705 15987 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.086917 16639 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.090190 16569 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.092145 15910 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.098714 16625 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.103758 16615 raft_consensus.cc:1064] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:44.106122 15988 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.111404 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21c971bd20d548a8a1dd8f98022a1f7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.122376 16603 raft_consensus.cc:1064] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:44.123414 16615 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.130388 15988 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.130963 16494 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.124739 16603 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.137849 16495 raft_consensus.cc:2955] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.140072 16496 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.142397 15834 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.143883 16615 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.150379 16619 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.154749 15908 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.156980 15732 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.162211 16619 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.162142 15732 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.185586 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 21c971bd20d548a8a1dd8f98022a1f7e with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:23:44.197288 15838 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.198848 16496 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.200198 16603 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.203439 15838 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.204687 15911 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.206373 16652 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:44.216423 16496 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.215694 16569 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.218323 15913 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.221355 15908 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.224196 16638 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.228613 16496 raft_consensus.cc:2955] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.235842 16639 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:23:44.291646 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 661598743dad4055844a0b0f97c07156 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.227707 16615 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.318500 16662 tablet_replica.cc:333] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:23:44.321136 15984 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.334252 16662 raft_consensus.cc:2243] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.335031 16662 raft_consensus.cc:2272] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.342312 16662 ts_tablet_manager.cc:1916] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.344066 15731 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.374302 15732 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.409394 16662 ts_tablet_manager.cc:1929] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.409895 16662 log.cc:1199] T 21c971bd20d548a8a1dd8f98022a1f7e P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/21c971bd20d548a8a1dd8f98022a1f7e
I20260709 12:23:44.413682 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 21c971bd20d548a8a1dd8f98022a1f7e (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:44.436559 16496 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.463999 16669 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 12:23:44.488232 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 143137us
I20260709 12:23:44.492003 16654 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.493546 16495 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:23:44.518970 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 212706us
I20260709 12:23:44.539731 15831 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:23:44.548218 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 53254.1us
I20260709 12:23:44.548545 15734 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.570220 15988 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.572419 15838 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.585986 15908 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.598003 16496 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.638103 16654 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:44.646588 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 50768.5us
I20260709 12:23:44.635860 15838 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.651098 16669 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.654112 16675 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.665701 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5521db1dbeb94ad8ae63681494d5565d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.681226 16496 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.686467 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 661598743dad4055844a0b0f97c07156 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:44.695246 15834 raft_consensus.cc:2955] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.698330 15732 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.750607 16676 tablet_replica.cc:333] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:44.755935 16676 raft_consensus.cc:2243] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.756924 16676 raft_consensus.cc:2272] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.762799 16676 ts_tablet_manager.cc:1916] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.836880 16676 ts_tablet_manager.cc:1929] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.837489 16676 log.cc:1199] T 661598743dad4055844a0b0f97c07156 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/661598743dad4055844a0b0f97c07156
I20260709 12:23:44.846292 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 5521db1dbeb94ad8ae63681494d5565d with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:44.846410 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 661598743dad4055844a0b0f97c07156 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:44.849675 16676 tablet_replica.cc:333] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:44.850682 16676 raft_consensus.cc:2243] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.851409 16676 raft_consensus.cc:2272] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.866272 16676 ts_tablet_manager.cc:1916] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.883657 15988 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:44.886790 16676 ts_tablet_manager.cc:1929] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.887307 16676 log.cc:1199] T 5521db1dbeb94ad8ae63681494d5565d P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/5521db1dbeb94ad8ae63681494d5565d
I20260709 12:23:44.890192 16496 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.890311 15834 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.890295 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 5521db1dbeb94ad8ae63681494d5565d (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:44.891935 16252 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.892863 16657 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:44.899396 16252 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.900806 15834 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.907204 16496 raft_consensus.cc:2955] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.908721 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 506492d6bd024ce682676a3ecdcf186f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.919157 15731 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:44.931808 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 506492d6bd024ce682676a3ecdcf186f with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:44.933604 16677 tablet_replica.cc:333] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:44.934603 16677 raft_consensus.cc:2243] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.935283 16677 raft_consensus.cc:2272] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.938130 16677 ts_tablet_manager.cc:1916] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.949386 16677 ts_tablet_manager.cc:1929] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.949703 16677 log.cc:1199] T 506492d6bd024ce682676a3ecdcf186f P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/506492d6bd024ce682676a3ecdcf186f
I20260709 12:23:44.950903 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 506492d6bd024ce682676a3ecdcf186f (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:46.001125 15908 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.007711 15984 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.007874 15831 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:46.007972 15879 consensus_peers.cc:597] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5852b04bfec4fa5b2fee780cfb44ce2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.009272 16675 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.010087 16682 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.017434 16682 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.018886 15984 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.029310 15836 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.029969 15834 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.040226 15731 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.052559 15913 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.054997 15984 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.055162 16569 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.056587 16680 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:46.057480 15803 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e12395965994c48bc79f9b642be60ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.069864 16680 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.071930 15913 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.083976 15988 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.094722 15984 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.109668 15732 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:23:46.117733 15953 consensus_peers.cc:597] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b3c37964b604d879b4e5a45e6154d8e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.117806 15913 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.120074 16679 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.120453 15834 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.122400 16615 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.141713 16679 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.144913 15834 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.145530 15913 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.174926 15731 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.178216 15836 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:23:46.196619 15803 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98e0016561fa4f72935bc3bc36cda023. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.197655 15984 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.199888 15913 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.199802 16692 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.202342 16692 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.207984 16693 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.209664 15988 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.216861 15913 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.230455 15732 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:46.505024 16702 ts_tablet_manager.cc:933] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:23:46.506896 16702 tablet_copy_client.cc:323] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:23:46.508504 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 3e12395965994c48bc79f9b642be60ef from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:23:46.509006 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 3e12395965994c48bc79f9b642be60ef from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-3e12395965994c48bc79f9b642be60ef
I20260709 12:23:46.516237 15848 tablet_copy_source_session.cc:215] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.519622 16702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12395965994c48bc79f9b642be60ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.533911 16702 tablet_copy_client.cc:806] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.534452 16702 tablet_copy_client.cc:670] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.537719 16702 tablet_copy_client.cc:538] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.543505 16702 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:46.561380 16704 ts_tablet_manager.cc:933] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:46.571030 16704 tablet_copy_client.cc:323] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:46.571305 16702 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.572321 16702 tablet_bootstrap.cc:492] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:46.572811 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet a5852b04bfec4fa5b2fee780cfb44ce2 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:46.573359 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet a5852b04bfec4fa5b2fee780cfb44ce2 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-a5852b04bfec4fa5b2fee780cfb44ce2
I20260709 12:23:46.577481 16702 ts_tablet_manager.cc:1403] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.007s
I20260709 12:23:46.579279 15923 tablet_copy_source_session.cc:215] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.580483 16702 raft_consensus.cc:359] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.581370 16702 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:46.582177 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5852b04bfec4fa5b2fee780cfb44ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.582000 16702 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.586558 16702 ts_tablet_manager.cc:1434] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:46.588397 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-3e12395965994c48bc79f9b642be60ef received from {username='slave'} at 127.0.0.1:59154
I20260709 12:23:46.588768 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-3e12395965994c48bc79f9b642be60ef on tablet 3e12395965994c48bc79f9b642be60ef with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:46.600587 16704 tablet_copy_client.cc:806] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.601172 16704 tablet_copy_client.cc:670] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.604600 16704 tablet_copy_client.cc:538] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.612597 16704 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:46.632674 16704 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.633577 16704 tablet_bootstrap.cc:492] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:46.634202 16704 ts_tablet_manager.cc:1403] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.013s
I20260709 12:23:46.636965 16704 raft_consensus.cc:359] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.637813 16704 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:46.638409 16704 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.640687 16704 ts_tablet_manager.cc:1434] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:23:46.645939 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-a5852b04bfec4fa5b2fee780cfb44ce2 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:46.646363 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-a5852b04bfec4fa5b2fee780cfb44ce2 on tablet a5852b04bfec4fa5b2fee780cfb44ce2 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:46.711426 16704 ts_tablet_manager.cc:933] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:23:46.713049 16704 tablet_copy_client.cc:323] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:23:46.714671 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 98e0016561fa4f72935bc3bc36cda023 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:23:46.715175 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 98e0016561fa4f72935bc3bc36cda023 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-98e0016561fa4f72935bc3bc36cda023
I20260709 12:23:46.717336 16702 ts_tablet_manager.cc:933] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:46.723453 15848 tablet_copy_source_session.cc:215] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.726367 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e0016561fa4f72935bc3bc36cda023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.729857 16702 tablet_copy_client.cc:323] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:46.732482 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 1b3c37964b604d879b4e5a45e6154d8e from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:46.732969 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 1b3c37964b604d879b4e5a45e6154d8e from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-1b3c37964b604d879b4e5a45e6154d8e
I20260709 12:23:46.743342 15998 tablet_copy_source_session.cc:215] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.744975 16704 tablet_copy_client.cc:806] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.745568 16704 tablet_copy_client.cc:670] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.746958 16702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b3c37964b604d879b4e5a45e6154d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.752326 16704 tablet_copy_client.cc:538] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.761269 16704 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:46.772208 16702 tablet_copy_client.cc:806] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.772737 16702 tablet_copy_client.cc:670] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.776532 16702 tablet_copy_client.cc:538] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.784307 16702 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:46.785970 16704 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.787348 16704 tablet_bootstrap.cc:492] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:46.787977 16704 ts_tablet_manager.cc:1403] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.005s
I20260709 12:23:46.790903 16704 raft_consensus.cc:359] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.791711 16704 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:46.792438 16704 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.795679 16704 ts_tablet_manager.cc:1434] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:46.798777 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-98e0016561fa4f72935bc3bc36cda023 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:23:46.799170 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-98e0016561fa4f72935bc3bc36cda023 on tablet 98e0016561fa4f72935bc3bc36cda023 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:46.817099 16702 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.817925 16702 tablet_bootstrap.cc:492] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:46.818558 16702 ts_tablet_manager.cc:1403] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 12:23:46.821411 16702 raft_consensus.cc:359] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.822201 16702 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:46.823007 16702 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:46.825275 16702 ts_tablet_manager.cc:1434] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:46.827015 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-1b3c37964b604d879b4e5a45e6154d8e received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:46.827369 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-1b3c37964b604d879b4e5a45e6154d8e on tablet 1b3c37964b604d879b4e5a45e6154d8e with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:47.020704 16496 raft_consensus.cc:1217] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:47.039511 16496 raft_consensus.cc:1217] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:47.293993 16496 raft_consensus.cc:1217] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:47.375505 16496 raft_consensus.cc:1217] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:47.531347 16715 raft_consensus.cc:1064] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:47.535125 16715 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:47.542901 16495 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.543862 15913 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.544548 16715 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.545459 15985 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.545758 16726 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:47.546921 16713 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.576628 16726 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.578670 16495 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.598486 15985 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.598764 15913 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.607223 15734 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.642406 16717 raft_consensus.cc:1064] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:47.645694 16717 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:47.655791 15836 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:47.660589 15985 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.663861 15834 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.665912 16495 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.666353 16719 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:47.672058 16719 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.674139 16716 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:47.685587 16496 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.688470 15985 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.700704 16726 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:47.709017 16569 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:47.718327 16717 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.722055 15831 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.723925 16715 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.729830 16496 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.726871 15985 raft_consensus.cc:2955] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.732586 15988 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.746363 15733 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.769740 16495 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.778409 15732 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.781675 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e12395965994c48bc79f9b642be60ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:47.803306 15908 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:47.809216 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e12395965994c48bc79f9b642be60ef with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:47.812501 16740 tablet_replica.cc:333] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:47.817998 16495 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.818810 15988 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.820073 16717 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.821401 16740 raft_consensus.cc:2243] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.821939 16716 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.822662 16740 raft_consensus.cc:2272] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.826474 16740 ts_tablet_manager.cc:1916] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:47.830260 16716 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.833384 15988 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.842573 16495 raft_consensus.cc:2955] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.846052 16740 ts_tablet_manager.cc:1929] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:47.846585 16740 log.cc:1199] T 3e12395965994c48bc79f9b642be60ef P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/3e12395965994c48bc79f9b642be60ef
I20260709 12:23:47.848887 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 3e12395965994c48bc79f9b642be60ef (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:47.855118 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5852b04bfec4fa5b2fee780cfb44ce2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:47.859457 15732 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.873607 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet a5852b04bfec4fa5b2fee780cfb44ce2 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:23:47.884595 16741 tablet_replica.cc:333] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:23:47.885821 16741 raft_consensus.cc:2243] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.886678 16741 raft_consensus.cc:2272] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.892419 16741 ts_tablet_manager.cc:1916] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:47.910216 16741 ts_tablet_manager.cc:1929] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:47.910748 16741 log.cc:1199] T a5852b04bfec4fa5b2fee780cfb44ce2 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/a5852b04bfec4fa5b2fee780cfb44ce2
I20260709 12:23:47.913196 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet a5852b04bfec4fa5b2fee780cfb44ce2 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:47.924043 16715 raft_consensus.cc:1064] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:47.926710 16715 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:47.935568 16722 raft_consensus.cc:1064] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:47.938535 16722 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:47.955160 16495 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.956707 16715 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.958640 15985 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.956736 15908 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.960945 16715 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.963197 16715 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.976037 16713 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.982172 15985 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:47.989745 16496 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.991395 16725 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:47.993638 15913 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.005435 15911 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:48.003995 15734 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.008334 15834 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:48.009805 16727 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:48.013192 16495 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.017724 16727 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:48.047638 15831 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:48.048053 16722 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.053877 16495 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:48.055179 16713 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:48.058145 15834 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.059434 15911 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.065284 16715 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.070230 15913 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:48.073688 16495 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.084326 16713 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:48.084085 15734 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.091169 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98e0016561fa4f72935bc3bc36cda023 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:48.091251 15913 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.089560 16496 raft_consensus.cc:2955] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.107508 15732 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.120394 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e0016561fa4f72935bc3bc36cda023 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:48.120997 15985 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:48.130678 16495 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:48.133024 16727 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:48.136765 15913 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:48.138669 16722 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:48.141417 16724 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.144199 16495 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.154110 15913 raft_consensus.cc:2955] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.157630 15734 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:48.159003 16750 tablet_replica.cc:333] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:48.160146 16750 raft_consensus.cc:2243] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:48.160751 16750 raft_consensus.cc:2272] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:48.169324 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b3c37964b604d879b4e5a45e6154d8e with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:23:48.170240 16741 tablet_replica.cc:333] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:23:48.171360 16741 raft_consensus.cc:2243] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:48.171716 16750 ts_tablet_manager.cc:1916] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:48.172122 16741 raft_consensus.cc:2272] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:48.174309 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b3c37964b604d879b4e5a45e6154d8e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:48.192093 16741 ts_tablet_manager.cc:1916] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:48.197234 16750 ts_tablet_manager.cc:1929] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:48.198154 16750 log.cc:1199] T 98e0016561fa4f72935bc3bc36cda023 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/98e0016561fa4f72935bc3bc36cda023
I20260709 12:23:48.200593 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 98e0016561fa4f72935bc3bc36cda023 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:48.211382 16741 ts_tablet_manager.cc:1929] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:48.211824 16741 log.cc:1199] T 1b3c37964b604d879b4e5a45e6154d8e P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/1b3c37964b604d879b4e5a45e6154d8e
I20260709 12:23:48.213215 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 1b3c37964b604d879b4e5a45e6154d8e (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:49.259274 15913 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.266625 15988 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.267045 15834 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:49.267515 15879 consensus_peers.cc:597] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 350f530ddf734358bef3d1a96410b5f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.268558 16654 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.269332 16719 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.276798 16654 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.278507 15988 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.279866 15834 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.299180 15988 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.301657 15731 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.309284 15913 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.311296 15834 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.311574 16722 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:49.312667 15953 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 879e5f4abbab45deb735e1ae9ae2d204. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.315307 16727 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.338548 16722 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.344394 15911 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.375954 15834 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.376441 15988 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.392652 15911 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:49.392781 15953 consensus_peers.cc:597] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25191835faf945ef870143a9ce1b2127. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.394191 15834 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.394837 16722 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.395676 16724 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.411312 16724 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.418962 15734 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.424058 15834 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.442248 15988 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:23:49.450232 15953 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e83c2c4f9a0f4e5aa1398c0e1d5d3dba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.449450 15911 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.452608 15908 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.453822 16771 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:49.459970 15834 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.462738 16722 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.459651 15731 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.473443 16722 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.478195 15908 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.494843 15834 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:49.497900 15733 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.744678 16775 ts_tablet_manager.cc:933] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:49.746675 16775 tablet_copy_client.cc:323] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:49.748579 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 350f530ddf734358bef3d1a96410b5f3 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:49.749135 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 350f530ddf734358bef3d1a96410b5f3 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-350f530ddf734358bef3d1a96410b5f3
I20260709 12:23:49.757961 15923 tablet_copy_source_session.cc:215] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.761257 16775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350f530ddf734358bef3d1a96410b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.772281 16775 tablet_copy_client.cc:806] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.772841 16775 tablet_copy_client.cc:670] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.776135 16775 tablet_copy_client.cc:538] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.783376 16775 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:49.806632 16775 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.807384 16775 tablet_bootstrap.cc:492] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:49.808035 16775 ts_tablet_manager.cc:1403] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 12:23:49.810973 16775 raft_consensus.cc:359] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.811815 16775 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:49.812450 16775 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.815337 16775 ts_tablet_manager.cc:1434] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:23:49.816917 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-350f530ddf734358bef3d1a96410b5f3 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:49.817354 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-350f530ddf734358bef3d1a96410b5f3 on tablet 350f530ddf734358bef3d1a96410b5f3 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:49.833410 16775 ts_tablet_manager.cc:933] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:49.834939 16775 tablet_copy_client.cc:323] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:49.836683 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 25191835faf945ef870143a9ce1b2127 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:49.837157 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 25191835faf945ef870143a9ce1b2127 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-25191835faf945ef870143a9ce1b2127
I20260709 12:23:49.843820 15998 tablet_copy_source_session.cc:215] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.846830 16775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25191835faf945ef870143a9ce1b2127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.861346 16775 tablet_copy_client.cc:806] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.861845 16775 tablet_copy_client.cc:670] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.865710 16775 tablet_copy_client.cc:538] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.873838 16775 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:49.900182 16781 ts_tablet_manager.cc:933] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:49.905774 16781 tablet_copy_client.cc:323] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:49.907426 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 879e5f4abbab45deb735e1ae9ae2d204 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:49.907969 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 879e5f4abbab45deb735e1ae9ae2d204 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-879e5f4abbab45deb735e1ae9ae2d204
I20260709 12:23:49.911103 16775 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.911986 16775 tablet_bootstrap.cc:492] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:49.912622 16775 ts_tablet_manager.cc:1403] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.017s
I20260709 12:23:49.915756 15998 tablet_copy_source_session.cc:215] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.915443 16775 raft_consensus.cc:359] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.916231 16775 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:49.916870 16775 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.919492 16775 ts_tablet_manager.cc:1434] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:49.920926 16781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879e5f4abbab45deb735e1ae9ae2d204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.934101 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-25191835faf945ef870143a9ce1b2127 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:49.934623 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-25191835faf945ef870143a9ce1b2127 on tablet 25191835faf945ef870143a9ce1b2127 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:49.940053 16781 tablet_copy_client.cc:806] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.940681 16781 tablet_copy_client.cc:670] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.943877 16781 tablet_copy_client.cc:538] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.950603 16781 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:49.974216 16781 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.974967 16781 tablet_bootstrap.cc:492] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:49.975493 16781 ts_tablet_manager.cc:1403] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 12:23:49.978149 16781 raft_consensus.cc:359] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.978860 16781 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:49.979377 16781 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:49.981346 16781 ts_tablet_manager.cc:1434] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:49.982897 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-879e5f4abbab45deb735e1ae9ae2d204 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:49.983292 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-879e5f4abbab45deb735e1ae9ae2d204 on tablet 879e5f4abbab45deb735e1ae9ae2d204 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:50.015712 16781 ts_tablet_manager.cc:933] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:50.018262 16781 tablet_copy_client.cc:323] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:50.019726 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:50.020251 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-e83c2c4f9a0f4e5aa1398c0e1d5d3dba
I20260709 12:23:50.026918 15998 tablet_copy_source_session.cc:215] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:50.030053 16781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:50.044639 16781 tablet_copy_client.cc:806] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:50.045172 16781 tablet_copy_client.cc:670] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:50.052510 16781 tablet_copy_client.cc:538] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:50.064342 16781 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:50.089326 16781 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:50.090135 16781 tablet_bootstrap.cc:492] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:50.090740 16781 ts_tablet_manager.cc:1403] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 12:23:50.093506 16781 raft_consensus.cc:359] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:50.094300 16781 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:50.094897 16781 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:50.097198 16781 ts_tablet_manager.cc:1434] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:50.098847 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-e83c2c4f9a0f4e5aa1398c0e1d5d3dba received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:50.099272 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-e83c2c4f9a0f4e5aa1398c0e1d5d3dba on tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:50.234750 16495 raft_consensus.cc:1217] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.291288 16495 raft_consensus.cc:1217] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.414049 16495 raft_consensus.cc:1217] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.561504 16495 raft_consensus.cc:1217] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.685173 16787 raft_consensus.cc:1064] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:50.687676 16787 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:50.695961 16495 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.697336 15988 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.700155 16719 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.701831 15832 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.701848 16719 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.703253 16654 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.717657 16654 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.718909 15832 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.738371 16785 raft_consensus.cc:1064] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:50.738539 15988 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.740846 16785 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:50.748741 15731 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.751453 16496 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.775521 15908 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.776218 15832 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.776994 16496 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.777585 16768 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.778469 16770 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.792410 16795 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.800293 16770 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.801934 16495 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.803756 15908 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.815826 15836 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.837123 15911 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:50.843425 15731 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.852922 16495 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.854682 15836 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.855070 16792 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.860008 16654 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.861341 16719 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.863267 16495 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.876549 16795 raft_consensus.cc:1064] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:50.878459 15731 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.879046 16795 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:50.885154 15988 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:50.886718 15834 raft_consensus.cc:2955] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.892153 16495 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.894465 15911 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.896919 16785 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.907599 16768 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.908591 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 350f530ddf734358bef3d1a96410b5f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.917454 16495 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.918923 16806 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.939512 15733 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:50.946913 16496 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:50.949787 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 54028.4us
I20260709 12:23:50.950352 16804 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:50.954128 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25191835faf945ef870143a9ce1b2127 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.958616 15834 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.960254 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 25191835faf945ef870143a9ce1b2127 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:23:50.959946 16770 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.967588 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 350f530ddf734358bef3d1a96410b5f3 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:50.988209 15908 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.989300 15911 raft_consensus.cc:2955] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.016669 16770 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:51.020474 16808 tablet_replica.cc:333] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:23:51.034502 16808 raft_consensus.cc:2243] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.035302 16808 raft_consensus.cc:2272] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.078302 16810 tablet_replica.cc:333] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:51.089389 16810 raft_consensus.cc:2243] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.090337 16810 raft_consensus.cc:2272] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.109622 16808 ts_tablet_manager.cc:1916] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.122296 16810 ts_tablet_manager.cc:1916] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.133857 16805 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.140023 16495 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.154666 16785 raft_consensus.cc:1064] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:51.156850 16785 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:23:51.163406 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 55345.6us
I20260709 12:23:51.168895 16808 ts_tablet_manager.cc:1929] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:51.169339 16808 log.cc:1199] T 25191835faf945ef870143a9ce1b2127 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/25191835faf945ef870143a9ce1b2127
I20260709 12:23:51.171103 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 25191835faf945ef870143a9ce1b2127 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:51.170975 15733 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.173955 16810 ts_tablet_manager.cc:1929] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:51.174376 16810 log.cc:1199] T 350f530ddf734358bef3d1a96410b5f3 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/350f530ddf734358bef3d1a96410b5f3
I20260709 12:23:51.194494 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 350f530ddf734358bef3d1a96410b5f3 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:51.194964 16494 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.199645 16805 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.202140 15908 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.203471 15907 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.215929 15988 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:51.218986 15836 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.218654 15834 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.221395 16804 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.227811 16494 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.229861 16804 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:51.232990 16805 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.241452 16785 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.243135 16494 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.248019 16806 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.258054 15832 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.273758 16495 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.280730 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 879e5f4abbab45deb735e1ae9ae2d204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:51.281373 15836 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.284104 16770 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.288931 15836 raft_consensus.cc:2955] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.306108 15731 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.306541 15734 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.311322 15913 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.325882 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 879e5f4abbab45deb735e1ae9ae2d204 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:51.336387 16819 tablet_replica.cc:333] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:51.337811 16819 raft_consensus.cc:2243] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.338526 16819 raft_consensus.cc:2272] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.342554 16819 ts_tablet_manager.cc:1916] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.359462 15984 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:51.359699 16819 ts_tablet_manager.cc:1929] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:51.361171 16819 log.cc:1199] T 879e5f4abbab45deb735e1ae9ae2d204 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/879e5f4abbab45deb735e1ae9ae2d204
I20260709 12:23:51.362660 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 879e5f4abbab45deb735e1ae9ae2d204 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:51.365453 16495 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.366771 16805 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.369122 15834 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.370378 16785 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.377844 16495 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.376309 16805 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.383006 15836 raft_consensus.cc:2955] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.391958 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:51.391340 15731 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:51.406152 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:51.406904 16819 tablet_replica.cc:333] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:51.407779 16819 raft_consensus.cc:2243] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.408417 16819 raft_consensus.cc:2272] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.410902 16819 ts_tablet_manager.cc:1916] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.424710 16819 ts_tablet_manager.cc:1929] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:51.425011 16819 log.cc:1199] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/e83c2c4f9a0f4e5aa1398c0e1d5d3dba
I20260709 12:23:51.426365 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet e83c2c4f9a0f4e5aa1398c0e1d5d3dba (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:52.464864 15911 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:52.470085 15988 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:52.470726 15832 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:52.471278 15879 consensus_peers.cc:597] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98db7b6a993347c8a1e39b15956132ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.472365 16814 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.473266 16654 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.481428 16821 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.483878 15984 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.486665 15832 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.504964 15730 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.511276 15984 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:52.520113 15913 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:52.520831 15953 consensus_peers.cc:597] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 021499433bf04873a1ec6376aba69864. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.522518 15832 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:52.522884 16815 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.525727 16815 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.533221 16815 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.538372 15834 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.548254 15907 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:52.541707 15913 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.555076 15733 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:52.568337 15879 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1db7600d8ee247d0abddcf104708f152. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.568871 15834 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:52.570475 16821 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.570932 15988 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:52.574955 16821 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:52.599617 16654 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.601257 15984 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.611375 15987 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:52.613710 15834 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.626931 15731 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:23:52.628523 15953 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c7327c39306430dbeb82a9c27813987. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.630841 15913 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:52.632238 16805 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.633404 15836 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:52.636431 16824 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:52.657312 16785 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.659577 15913 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.677692 15834 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:52.688490 15731 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.928397 16840 ts_tablet_manager.cc:933] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:52.930372 16840 tablet_copy_client.cc:323] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:52.931876 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 98db7b6a993347c8a1e39b15956132ce from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:52.932391 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 98db7b6a993347c8a1e39b15956132ce from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-98db7b6a993347c8a1e39b15956132ce
I20260709 12:23:52.939193 15923 tablet_copy_source_session.cc:215] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:52.942546 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98db7b6a993347c8a1e39b15956132ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:52.957743 16840 tablet_copy_client.cc:806] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:52.958284 16840 tablet_copy_client.cc:670] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:52.962059 16840 tablet_copy_client.cc:538] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:52.970408 16840 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:52.992286 16840 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:52.993147 16840 tablet_bootstrap.cc:492] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:52.993686 16840 ts_tablet_manager.cc:1403] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.014s
I20260709 12:23:52.996281 16840 raft_consensus.cc:359] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:52.997119 16840 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:52.997745 16840 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.001813 16840 ts_tablet_manager.cc:1434] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:23:53.009229 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-98db7b6a993347c8a1e39b15956132ce received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:53.009632 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-98db7b6a993347c8a1e39b15956132ce on tablet 98db7b6a993347c8a1e39b15956132ce with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:53.015656 16840 ts_tablet_manager.cc:933] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:53.021522 16840 tablet_copy_client.cc:323] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:53.023764 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 021499433bf04873a1ec6376aba69864 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:53.024291 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 021499433bf04873a1ec6376aba69864 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-021499433bf04873a1ec6376aba69864
I20260709 12:23:53.031495 15998 tablet_copy_source_session.cc:215] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.034847 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021499433bf04873a1ec6376aba69864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.049890 16840 tablet_copy_client.cc:806] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.050361 16840 tablet_copy_client.cc:670] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.054533 16840 tablet_copy_client.cc:538] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.060832 16840 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:53.079654 16840 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.080475 16840 tablet_bootstrap.cc:492] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:53.081152 16840 ts_tablet_manager.cc:1403] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.004s
I20260709 12:23:53.083808 16840 raft_consensus.cc:359] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.084483 16840 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:53.085038 16840 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.086934 16840 ts_tablet_manager.cc:1434] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:53.088740 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-021499433bf04873a1ec6376aba69864 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:53.089171 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-021499433bf04873a1ec6376aba69864 on tablet 021499433bf04873a1ec6376aba69864 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:53.158576 16840 ts_tablet_manager.cc:933] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:53.162686 16840 tablet_copy_client.cc:323] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:53.164187 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 1db7600d8ee247d0abddcf104708f152 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:53.164701 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 1db7600d8ee247d0abddcf104708f152 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-1db7600d8ee247d0abddcf104708f152
I20260709 12:23:53.176921 15923 tablet_copy_source_session.cc:215] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.180138 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db7600d8ee247d0abddcf104708f152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.192992 16840 tablet_copy_client.cc:806] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.193497 16840 tablet_copy_client.cc:670] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.197100 16840 tablet_copy_client.cc:538] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.203495 16840 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:53.217283 16840 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.217900 16840 tablet_bootstrap.cc:492] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:53.218448 16840 ts_tablet_manager.cc:1403] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.015s	user 0.016s	sys 0.000s
I20260709 12:23:53.220800 16840 raft_consensus.cc:359] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.221562 16840 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:53.222092 16840 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.224054 16840 ts_tablet_manager.cc:1434] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:53.225931 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-1db7600d8ee247d0abddcf104708f152 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:53.226321 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-1db7600d8ee247d0abddcf104708f152 on tablet 1db7600d8ee247d0abddcf104708f152 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:53.235885 16840 ts_tablet_manager.cc:933] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:53.237270 16840 tablet_copy_client.cc:323] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:53.238481 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 5c7327c39306430dbeb82a9c27813987 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:53.238893 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 5c7327c39306430dbeb82a9c27813987 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-5c7327c39306430dbeb82a9c27813987
I20260709 12:23:53.244706 15998 tablet_copy_source_session.cc:215] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.246963 16840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7327c39306430dbeb82a9c27813987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.259954 16840 tablet_copy_client.cc:806] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.260430 16840 tablet_copy_client.cc:670] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.263412 16840 tablet_copy_client.cc:538] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.272841 16840 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:53.291432 16840 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.292155 16840 tablet_bootstrap.cc:492] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:53.292622 16840 ts_tablet_manager.cc:1403] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.004s
I20260709 12:23:53.294519 16840 raft_consensus.cc:359] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.295066 16840 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:53.295557 16840 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:53.297331 16840 ts_tablet_manager.cc:1434] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.003s
I20260709 12:23:53.299640 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-5c7327c39306430dbeb82a9c27813987 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:53.300051 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-5c7327c39306430dbeb82a9c27813987 on tablet 5c7327c39306430dbeb82a9c27813987 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:53.361605 16494 raft_consensus.cc:1217] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:53.514086 16494 raft_consensus.cc:1217] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:53.697541 16494 raft_consensus.cc:1217] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:53.834692 16494 raft_consensus.cc:1217] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:53.955710 16814 raft_consensus.cc:1064] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:53.957597 16814 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:53.963313 16494 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.963361 15984 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.963678 15834 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.964903 16654 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:53.967319 16821 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.970067 16814 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.984483 16814 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:53.991497 16494 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.001787 15984 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.017763 15733 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.019958 15832 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.046205 16851 raft_consensus.cc:1064] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:54.048713 16851 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.062636 16494 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.064029 15911 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.064450 16856 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.065713 16815 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.074330 15832 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.075951 16785 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.079723 16814 raft_consensus.cc:1064] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:54.084779 15907 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.081962 16814 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.097281 16851 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.103958 15834 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.105403 16494 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.106849 16821 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.109184 15832 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.110483 16654 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.118235 16654 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.118552 15836 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.121145 16494 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.123064 16821 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.124157 16495 raft_consensus.cc:2955] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.137251 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98db7b6a993347c8a1e39b15956132ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.120406 15907 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.142199 16494 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.148274 15984 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.150930 16654 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.161895 16821 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.164178 16496 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.168593 15731 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:54.170650 15733 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:23:54.176764 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 47352.5us
I20260709 12:23:54.179891 15834 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.181939 16867 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.191890 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 98db7b6a993347c8a1e39b15956132ce with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:54.201749 15984 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.214279 15733 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.219946 15832 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.222669 15987 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.238301 16874 tablet_replica.cc:333] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:54.238953 15907 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.241990 16496 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.249305 16865 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.251353 16856 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.263028 16815 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.264739 15913 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.287726 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 021499433bf04873a1ec6376aba69864 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.289542 16494 raft_consensus.cc:2955] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.303471 15733 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.304819 16874 raft_consensus.cc:2243] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.305611 16874 raft_consensus.cc:2272] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.309278 16874 ts_tablet_manager.cc:1916] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.315872 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 021499433bf04873a1ec6376aba69864 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:23:54.327399 16874 ts_tablet_manager.cc:1929] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.327826 16874 log.cc:1199] T 98db7b6a993347c8a1e39b15956132ce P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/98db7b6a993347c8a1e39b15956132ce
I20260709 12:23:54.329140 16875 tablet_replica.cc:333] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:23:54.330837 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 98db7b6a993347c8a1e39b15956132ce (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:54.332042 16875 raft_consensus.cc:2243] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.333601 16875 raft_consensus.cc:2272] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.338207 16875 ts_tablet_manager.cc:1916] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.356230 16875 ts_tablet_manager.cc:1929] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.356607 16875 log.cc:1199] T 021499433bf04873a1ec6376aba69864 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/021499433bf04873a1ec6376aba69864
I20260709 12:23:54.358549 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 021499433bf04873a1ec6376aba69864 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:54.428339 16815 raft_consensus.cc:1064] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:54.430042 16815 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.436496 16494 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.437021 15913 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.437875 16865 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.439009 15832 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.439529 16851 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:54.441447 16865 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.457917 16815 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.460091 16494 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.460431 15913 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.470942 15832 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.474924 15731 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.495849 15987 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.501713 15834 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.501847 16494 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.503005 16865 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.506247 16865 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.510536 16785 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.516875 15834 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.520931 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c7327c39306430dbeb82a9c27813987 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.530715 16494 raft_consensus.cc:2955] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.535006 15733 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:54.551607 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c7327c39306430dbeb82a9c27813987 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:23:54.558183 16880 tablet_replica.cc:333] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:23:54.560184 16880 raft_consensus.cc:2243] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.560931 16880 raft_consensus.cc:2272] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.566082 16880 ts_tablet_manager.cc:1916] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.586565 16880 ts_tablet_manager.cc:1929] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.586910 16880 log.cc:1199] T 5c7327c39306430dbeb82a9c27813987 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/5c7327c39306430dbeb82a9c27813987
I20260709 12:23:54.588263 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 5c7327c39306430dbeb82a9c27813987 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:54.607115 15913 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:54.611609 16494 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.612139 15834 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.613170 16821 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.614521 16868 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.619293 16870 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.628383 15836 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.629488 16494 raft_consensus.cc:2955] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.647879 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1db7600d8ee247d0abddcf104708f152 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.650931 15730 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:54.666950 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 1db7600d8ee247d0abddcf104708f152 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:23:54.667989 16874 tablet_replica.cc:333] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:23:54.669088 16874 raft_consensus.cc:2243] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.669916 16874 raft_consensus.cc:2272] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.675093 16874 ts_tablet_manager.cc:1916] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.688638 16874 ts_tablet_manager.cc:1929] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.688941 16874 log.cc:1199] T 1db7600d8ee247d0abddcf104708f152 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/1db7600d8ee247d0abddcf104708f152
I20260709 12:23:54.690249 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 1db7600d8ee247d0abddcf104708f152 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:23:55.741542 15913 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:23:55.748380 15879 consensus_peers.cc:597] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bf6eca653c94d5bba2406c3006ac72e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.748433 15987 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.750526 15836 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.750833 16870 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.752036 16883 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.759056 16821 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.763284 15988 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.766780 15832 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.776475 15988 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:55.782232 15733 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:55.814154 15953 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58dc18a7b4f448bd8d86eec830a0f612. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.814224 15832 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.816615 16851 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.817294 15913 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.820817 16886 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.840039 16886 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.841876 15832 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.842248 15911 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.855516 15911 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:55.856844 15733 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.866605 15988 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:55.867517 15879 consensus_peers.cc:597] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afd0e40a445b47b68759b884aff8da86. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.868335 15832 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.868451 16870 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.869663 16889 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.875815 16821 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.877440 15988 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.920576 15832 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.929217 15731 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.933682 15913 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:55.954284 15836 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.956035 16889 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:55.964434 15879 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec82df0e9104447ab3e50c2a6968cf7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.966135 15987 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.968559 16883 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.974403 16889 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.978603 15832 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.986297 15987 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:23:55.997781 15733 catalog_manager.cc:5697] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.175804 16901 ts_tablet_manager.cc:933] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:56.177603 16901 tablet_copy_client.cc:323] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:56.178954 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 7bf6eca653c94d5bba2406c3006ac72e from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:56.179363 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 7bf6eca653c94d5bba2406c3006ac72e from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-7bf6eca653c94d5bba2406c3006ac72e
I20260709 12:23:56.187278 15923 tablet_copy_source_session.cc:215] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.190409 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf6eca653c94d5bba2406c3006ac72e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.205654 16901 tablet_copy_client.cc:806] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.206223 16901 tablet_copy_client.cc:670] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.211329 16901 tablet_copy_client.cc:538] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.221400 16901 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:56.242163 16901 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.242879 16901 tablet_bootstrap.cc:492] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:56.243448 16901 ts_tablet_manager.cc:1403] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:23:56.245692 16901 raft_consensus.cc:359] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.246529 16901 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:56.247221 16901 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.250898 16901 ts_tablet_manager.cc:1434] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:56.252625 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7bf6eca653c94d5bba2406c3006ac72e received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:56.253019 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7bf6eca653c94d5bba2406c3006ac72e on tablet 7bf6eca653c94d5bba2406c3006ac72e with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:56.336555 16901 ts_tablet_manager.cc:933] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:56.341346 16901 tablet_copy_client.cc:323] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:56.343806 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet ec82df0e9104447ab3e50c2a6968cf7e from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:56.344295 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet ec82df0e9104447ab3e50c2a6968cf7e from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-ec82df0e9104447ab3e50c2a6968cf7e
I20260709 12:23:56.351683 15923 tablet_copy_source_session.cc:215] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.354979 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82df0e9104447ab3e50c2a6968cf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.371086 16901 tablet_copy_client.cc:806] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.371660 16901 tablet_copy_client.cc:670] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.374891 16901 tablet_copy_client.cc:538] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.386523 16901 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:56.407624 16901 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.408270 16901 tablet_bootstrap.cc:492] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:56.408824 16901 ts_tablet_manager.cc:1403] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:23:56.411180 16901 raft_consensus.cc:359] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.411868 16901 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:56.412478 16901 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.414903 16901 ts_tablet_manager.cc:1434] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:56.416637 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-ec82df0e9104447ab3e50c2a6968cf7e received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:56.417024 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-ec82df0e9104447ab3e50c2a6968cf7e on tablet ec82df0e9104447ab3e50c2a6968cf7e with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:56.428243 16901 ts_tablet_manager.cc:933] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:56.430608 16901 tablet_copy_client.cc:323] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:23:56.432168 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 58dc18a7b4f448bd8d86eec830a0f612 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:23:56.432585 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 58dc18a7b4f448bd8d86eec830a0f612 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-58dc18a7b4f448bd8d86eec830a0f612
I20260709 12:23:56.438472 15998 tablet_copy_source_session.cc:215] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.441139 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58dc18a7b4f448bd8d86eec830a0f612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.452339 16901 tablet_copy_client.cc:806] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.452823 16901 tablet_copy_client.cc:670] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.453750 16908 ts_tablet_manager.cc:933] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:56.455767 16908 tablet_copy_client.cc:323] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:23:56.457145 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet afd0e40a445b47b68759b884aff8da86 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:23:56.457643 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet afd0e40a445b47b68759b884aff8da86 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-afd0e40a445b47b68759b884aff8da86
I20260709 12:23:56.461735 16901 tablet_copy_client.cc:538] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.463995 15923 tablet_copy_source_session.cc:215] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.466902 16908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd0e40a445b47b68759b884aff8da86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.470587 16901 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:56.483623 16908 tablet_copy_client.cc:806] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.484231 16908 tablet_copy_client.cc:670] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.487761 16908 tablet_copy_client.cc:538] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.497500 16908 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:23:56.697996 16901 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.698961 16901 tablet_bootstrap.cc:492] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:56.699641 16901 ts_tablet_manager.cc:1403] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.229s	user 0.041s	sys 0.035s
I20260709 12:23:56.702296 16901 raft_consensus.cc:359] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.703056 16901 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:56.703644 16901 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.705675 16901 ts_tablet_manager.cc:1434] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:56.720155 16908 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.721454 16908 tablet_bootstrap.cc:492] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:23:56.722275 16908 ts_tablet_manager.cc:1403] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.226s	user 0.039s	sys 0.030s
I20260709 12:23:56.725742 16908 raft_consensus.cc:359] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.726668 16908 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:23:56.727413 16908 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:56.730252 16908 ts_tablet_manager.cc:1434] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:23:56.733351 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-afd0e40a445b47b68759b884aff8da86 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:23:56.733573 16496 raft_consensus.cc:1217] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:56.733829 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-afd0e40a445b47b68759b884aff8da86 on tablet afd0e40a445b47b68759b884aff8da86 with peer 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:23:57.564601 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.010s	sys 0.007s
W20260709 12:23:57.565436 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.014s	sys 0.007s
W20260709 12:23:57.568430 15950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.003s	sys 0.012s
W20260709 12:23:57.571676 15950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.003s	sys 0.013s
I20260709 12:23:57.607503 16912 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.608886 16912 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.613049 16912 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:57.627936 15879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.003s	sys 0.010s
I20260709 12:23:57.649003 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-58dc18a7b4f448bd8d86eec830a0f612 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:23:57.651479 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-58dc18a7b4f448bd8d86eec830a0f612 on tablet 58dc18a7b4f448bd8d86eec830a0f612 with peer 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:23:57.657369 15879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.006s	sys 0.011s
W20260709 12:23:57.657972 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 921536us
I20260709 12:23:57.660225 16912 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.668399 16496 raft_consensus.cc:1217] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:57.701162 16821 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.702015 16821 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.737643 16821 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.729198 16912 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.747108 16912 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.754120 16924 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.754274 16923 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.754848 16923 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.761421 16904 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.762104 16904 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.763535 16923 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:57.754923 16924 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:23:57.794788 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800064860 after lost signal to thread 14652
I20260709 12:23:57.795797 16924 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:23:57.802292 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 51989.2us
I20260709 12:23:57.804567 16937 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.805514 16937 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.810191 16937 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.810580 16934 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.810871 16937 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.811275 16934 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.811548 16937 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.813364 16934 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.817049 16904 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.820024 16924 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.820750 16924 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.823103 16924 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:57.823694 16924 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.824311 16924 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.825327 16918 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.825742 16751 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.753613 16929 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.829058 16751 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.866302 16937 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:57.871610 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 50405.9us
W20260709 12:23:57.863842 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800064f40 after lost signal to thread 15769
I20260709 12:23:57.831611 16929 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.874826 16916 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.878306 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:57.841995 16912 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.891867 16821 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:57.839046 16918 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.893626 16751 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.843379 16934 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.842067 16936 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.842134 16881 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.896142 16937 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.909125 16883 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.913257 16927 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.913862 16927 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.903496 16922 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.898327 16923 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.917829 16944 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.915355 16916 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:57.911051 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08002e33c0 after lost signal to thread 15862
I20260709 12:23:57.901196 16904 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.918048 16936 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.909188 16881 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.921806 16821 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.925179 16938 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.909855 16883 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.905617 16912 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.918567 16927 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:57.955088 16940 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.956228 16751 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.939545 16918 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.937196 16929 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.964044 16751 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.938563 16922 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.926218 16934 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.922166 16937 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.975641 16925 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.976200 16937 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:57.976409 16925 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.979795 16941 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.955767 16940 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:23:57.969760 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800120b60 after lost signal to thread 15937
I20260709 12:23:57.969903 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:57.986452 16924 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.936722 16938 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.986657 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:57.987268 16928 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:57.937237 16904 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:57.993716 16821 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:57.988377 16496 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:57.992399 16494 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:57.996692 16917 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:57.997349 16917 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.999502 16917 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.000041 16942 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.000602 16942 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.002755 16942 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.967620 16943 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.982098 16918 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:57.962689 16923 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.960592 16944 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:57.983595 16883 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.010841 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.011458 15837 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:23:57.994776 16937 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:57.983263 16941 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.021852 16751 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.022807 16936 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.023018 16904 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:57.984513 16945 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.004634 16927 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.023352 16936 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.021131 16937 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.032546 16938 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:58.027971 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0220 after lost signal to thread 16012
I20260709 12:23:58.020658 16917 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.014803 16918 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.032568 16941 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.056758 16851 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.056926 16931 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.022976 16943 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:58.042379 16904 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.074110 16851 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.080499 16946 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.019814 16928 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.043773 16927 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.081367 16946 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.074918 16940 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.091226 16944 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:58.086880 15766 debug-util.cc:398] Leaking SignalData structure 0x7b080032ed80 after lost signal to thread 16521
I20260709 12:23:58.093149 16928 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.096191 16946 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.099637 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.100032 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.087421 16936 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:58.105139 16919 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.105515 15907 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:23:58.100332 16933 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.100836 16952 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.102208 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:23:58.102437 15766 debug-util.cc:398] Leaking SignalData structure 0x7b080005c180 after lost signal to thread 16901
I20260709 12:23:58.102885 16851 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.105800 16919 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.108322 16865 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.097581 16912 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.117198 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:23:58.094754 16916 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.110033 16934 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.089430 16904 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.064530 16945 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.086724 16917 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.127497 16945 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.133505 16941 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.133946 16941 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.134332 16941 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.134209 16865 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.094241 16931 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:23:58.152108 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 259724us
I20260709 12:23:58.128584 16881 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:23:58.155800 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 173913us
I20260709 12:23:58.156478 16919 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.158833 16865 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.150167 16923 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.166862 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.154384 16925 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.164307 16936 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.163053 16918 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.160778 16933 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.182871 16851 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.183054 16946 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.183148 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.151120 16952 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.185755 16943 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.186231 16933 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.186633 16851 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:58.187116 16927 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.187744 16940 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.189133 16940 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.173622 16937 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.193220 16940 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.184878 16946 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.194572 16916 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.196025 16931 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.196383 16916 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.171732 16957 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.201419 16851 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.202526 16937 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.205525 16904 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.207660 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.209417 15831 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:23:58.211663 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.211155 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:58.212656 16883 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.217440 16883 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.205572 16493 raft_consensus.cc:1217] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:58.217552 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:58.225006 16921 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.213732 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.223830 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.225203 16953 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.205569 16937 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.221727 16865 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.221585 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:58.229298 16933 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.251662 16933 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.254525 16916 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.229488 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:58.226780 16953 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.229537 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.258219 16493 raft_consensus.cc:1217] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:58.223335 16946 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.223616 16883 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.263113 15837 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:23:58.264050 16865 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.264351 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.265985 16865 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.266052 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.269469 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.259462 16917 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.273653 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.273734 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:58.274024 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.266503 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:58.277011 16935 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.277391 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.310179 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.313894 16952 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.310494 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.312803 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.247077 16921 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:58.221984 16957 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.328579 16922 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.274940 16937 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.339453 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.339042 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.340622 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.341180 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.341743 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:58.345575 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:58.347805 16917 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.349514 16941 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.350497 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.351183 16883 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.351500 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.352562 16946 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.352670 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.353977 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.354772 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.358464 16958 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.361645 16939 raft_consensus.cc:1064] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:58.361848 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.366519 16949 raft_consensus.cc:1064] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:58.367756 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.368052 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.465860 16495 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:58.467700 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.468163 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.468791 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.469296 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.469794 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.411828 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.425737 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.404254 16751 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.472352 16751 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.472715 16751 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.411054 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.472661 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.467319 15908 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:23:58.357935 16953 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.418519 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:58.368094 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.363243 16933 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:23:58.403797 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 62119.6us
I20260709 12:23:58.415575 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:58.478261 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 87232.1us
I20260709 12:23:58.479049 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:23:58.464504 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.368287 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.483820 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.480289 16889 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.493538 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:58.480578 16945 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.411612 16957 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.475445 16946 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.489769 16937 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.497465 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.490640 16889 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.502826 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:58.489383 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 146888us
I20260709 12:23:58.495285 16881 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.504494 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.495702 16945 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:23:58.505193 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47743.1us
I20260709 12:23:58.512595 16945 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.505570 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.504926 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.511922 16881 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.505707 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.517243 16923 raft_consensus.cc:1064] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:58.519148 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.483362 16917 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.520056 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.523921 16921 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.525615 16923 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.498700 16937 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:58.513815 16889 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.403833 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.469383 16949 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.485248 16883 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.425359 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.519447 16941 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.507628 16932 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:23:58.513370 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:58.529773 16937 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.533005 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.365805 16935 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.493011 16958 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.542009 16904 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.547042 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.547391 16958 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.550405 16751 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.544471 16904 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.564044 16904 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.564123 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.552192 16959 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.554984 16881 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.555920 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:58.558125 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.558542 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.558869 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.559584 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.565315 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.564121 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.566061 16959 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:58.570255 16751 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.571586 15985 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:58.577401 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.577762 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.581919 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.587759 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.589713 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:58.591378 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:58.592403 16930 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.592727 16930 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:23:58.593065 16930 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.560726 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.565804 16939 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:23:58.602175 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 57889.4us
I20260709 12:23:58.603124 15879 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.603922 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:23:58.605173 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 78518us
I20260709 12:23:58.607345 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.595765 16933 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.604279 16927 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.606143 16941 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.604736 16958 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.596421 16889 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.607465 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:23:58.634404 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.635161 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.636312 16851 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.636598 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.637238 15986 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:58.637348 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:58.638504 16959 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.639278 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.639914 16959 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.599690 15982 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:58.636942 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.631019 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.632274 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.639938 15984 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:23:58.633278 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.633376 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.630043 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.631019 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.642144 15913 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:58.608274 16917 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.645620 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.647096 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.678126 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.678663 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.679174 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.679790 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.680550 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.681267 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.682790 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.684348 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.685102 16960 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.685513 15950 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.686045 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.686264 16960 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.686640 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.687032 16946 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.687719 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.687366 16960 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.687842 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.688766 16960 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.691498 16889 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.688771 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.692571 16927 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.692981 15950 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.693756 16927 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.694133 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.695188 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.678540 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.684504 16937 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.697788 16960 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.687371 16904 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.698444 16933 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.709120 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.696633 16932 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.719280 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.724728 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:23:58.715349 15986 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:23:58.727617 16957 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:58.728109 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.646212 16945 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.731717 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.744983 15950 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.736270 15832 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:58.728770 16904 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.743048 16937 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.738695 16957 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:58.731854 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:58.747553 16933 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.747814 16935 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.752266 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.756454 16957 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.755143 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:58.761946 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.757705 16492 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:58.759769 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.776139 16487 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.779116 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.780071 16945 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:58.782392 16883 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:58.789515 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:23:58.756140 16920 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:23:58.792691 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.795293 15837 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.796135 15952 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.798482 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.800866 16928 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.801237 16928 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:58.801508 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.802033 16928 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.803429 16928 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.798316 16931 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.803785 16933 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:58.807258 16495 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.828191 16933 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.828532 16933 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:58.808059 15905 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.814672 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:58.829399 16933 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.814972 15879 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.830788 16883 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.833175 16949 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:58.834172 16917 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.834358 16949 raft_consensus.cc:1064] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:23:58.834554 16917 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:58.835387 16917 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.836478 16917 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.815320 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:58.815339 16927 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.804054 16923 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.820166 16930 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.825662 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.838663 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:58.843803 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:23:58.847741 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.848500 16904 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.832662 16883 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.851244 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.854696 16851 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.856246 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.857857 16865 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.859036 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:23:58.860445 16945 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.863160 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:23:58.868804 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.868973 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.827400 16957 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.870581 15830 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.873899 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.875278 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.876579 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.836591 16949 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:58.881001 16945 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.879338 16938 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.881479 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.881850 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.883482 16881 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.884210 16492 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.884315 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:58.885699 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.887424 16751 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.888307 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:58.878279 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.893996 16889 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:58.894861 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:58.893600 15988 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:23:58.890157 16960 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.893879 16933 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.891129 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.888490 16930 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:58.905299 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.905949 16751 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.905046 16943 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.906311 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.913417 16943 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.914239 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.915272 16889 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.913239 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.918114 15802 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.918792 16751 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.920090 15802 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.920727 16751 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.921132 15832 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.923293 16939 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:58.920707 16943 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.942839 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.946290 15830 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:58.950232 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.955816 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:58.965332 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.978440 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.977628 16939 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.980449 16889 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.980818 16889 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:58.981968 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.981755 16889 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:58.983048 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.983808 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.983932 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.984176 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.980744 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.984972 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.985304 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.985915 16889 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.986181 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.988272 15987 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.988432 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.989589 15986 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.989959 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.990960 16904 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.991453 16460 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.992179 16904 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.993525 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:58.994663 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:58.998162 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:58.998875 16821 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.978521 16957 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:59.006592 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.008729 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.010444 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:59.012049 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.013338 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.014417 16751 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.016268 15981 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.007989 16883 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.015096 16943 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:59.018774 15904 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.019979 16943 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:59.020393 16943 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.016443 16865 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.023061 16821 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.024194 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.025523 16904 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.030452 16883 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.031668 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:59.032959 16904 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:59.033258 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.033476 16904 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:59.028764 15879 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.035468 15879 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.034001 16904 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.036785 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:59.044548 16751 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:59.045013 16751 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:59.045395 16751 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.046484 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.047528 15803 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.048508 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:23:59.051290 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.053791 15879 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.049675 16957 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.055037 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.043439 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.056999 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.044153 16917 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.068647 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.053731 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.063344 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.052444 16963 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.052804 16938 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:59.059790 16883 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.056408 16939 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.074200 16946 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.085639 15879 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.091537 16937 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.082952 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.091415 15829 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.118075 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.088948 16953 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.119146 16937 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.060617 16945 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:23:59.092039 16938 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:59.123931 16751 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.129733 16751 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:59.110301 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.119841 16957 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.135058 16883 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.121749 16958 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.134423 16953 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.116611 16904 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:59.136147 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.136943 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.124599 16938 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.123126 16941 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.148200 16821 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.155311 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.137820 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:59.157128 16937 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.164261 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.166560 16942 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.170405 16489 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.170753 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:59.171814 16949 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.168717 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.173832 16904 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:59.174333 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.175776 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.160379 16958 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.166021 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.184751 15879 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.185652 16821 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.180461 16904 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.188215 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.190176 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.190542 16976 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.192200 15831 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.191871 16821 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.192615 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:23:59.237629 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45106.9us
I20260709 12:23:59.237841 16821 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.238651 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.238727 16958 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.239367 16946 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.230145 15832 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.208173 15983 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:23:59.242630 15986 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.244297 16488 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.187875 16939 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.201233 16881 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.249204 16881 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:23:59.248082 15733 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.250887 16492 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.201053 16976 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.195530 16959 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:23:59.195730 16933 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:23:59.202064 16489 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.259372 16938 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.262904 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:59.269200 16881 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.276094 16949 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.277355 16881 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.277724 16922 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:59.283133 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:59.278663 16821 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:59.287142 16958 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:23:59.286350 16922 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.285844 16927 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:23:59.269536 16943 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.295202 16950 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.295459 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:23:59.295578 16950 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:23:59.297425 16950 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:59.299640 16821 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.300624 16950 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.301311 16821 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:59.254102 16959 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:23:59.303462 16922 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:59.303826 16938 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:59.331923 16821 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:59.193461 15830 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:23:59.366138 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 174635us
I20260709 12:23:59.369486 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.334712 16943 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:23:59.384569 16821 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.387571 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:23:59.398108 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.371599 16917 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:23:59.402325 16976 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.327091 16492 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.464555 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:23:59.478178 16978 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.406072 16922 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.499370 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:23:59.578352 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 178041us
W20260709 12:23:59.673928 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 93326.4us
I20260709 12:23:59.679577 16959 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:23:59.683744 16489 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.698853 16883 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:59.699489 16883 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:59.711551 15829 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.717612 15831 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.713352 15838 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.738171 16953 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.739178 16953 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.739526 16953 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:59.740334 16953 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.751016 16953 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.742287 16958 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.755331 15981 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.766482 16958 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.766959 16958 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:59.768050 16958 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.830574 16958 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.865141 16883 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:59.886264 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:23:59.895027 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:23:59.894361 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:23:59.903066 16492 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:23:59.891855 15830 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.907437 15982 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:23:59.906714 16985 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.918592 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:23:59.919400 16922 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:59.920003 16922 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:23:59.920408 16922 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.903945 15983 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.911799 16492 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.937070 15905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:23:59.937826 15905 raft_consensus.cc:606] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:59.939262 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:59.956835 15982 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.949463 15832 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:23:59.974599 16958 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:59.976361 15905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:23:59.979619 15905 raft_consensus.cc:606] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:59.980006 15905 raft_consensus.cc:614] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:59.948086 16922 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:23:59.980127 16953 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.983693 16953 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:23:59.984489 16953 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:23:59.985175 15905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:23:59.985667 16953 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.985739 15905 raft_consensus.cc:606] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:23:59.990923 16922 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:23:59.992398 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:23:59.993331 16489 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:23:59.999327 16931 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:00.012426 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:00.030622 15732 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.027667 15982 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:00.032227 15732 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.045456 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:00.046464 16953 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.046953 16953 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:00.047796 16953 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.077710 15733 catalog_manager.cc:5697] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.079566 15983 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.080835 16922 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.082970 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:00.083644 15982 raft_consensus.cc:606] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:00.086912 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:00.087447 15982 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:00.088573 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:00.090548 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:00.095856 15730 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.091620 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:00.115265 16930 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.115736 16930 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.115617 15905 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.119773 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:00.120323 15832 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:00.121318 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:00.125185 16923 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.125555 16923 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.125945 16923 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.124912 15909 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.137135 16487 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.138607 16922 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.125828 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:00.146317 16985 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.147466 16489 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:00.145613 15832 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.149704 16930 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.151885 16487 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.153213 16953 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.159273 16923 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.161985 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:00.162289 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec82df0e9104447ab3e50c2a6968cf7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:00.162521 15838 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.169410 16489 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.172508 16982 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.174566 16923 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.176899 15832 raft_consensus.cc:2955] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.179257 15982 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.180449 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:00.180998 16489 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.181365 16982 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.183602 15732 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.186399 15838 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:00.189131 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:00.194808 16985 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.197491 15838 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.196401 16985 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.201143 16985 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:00.201730 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:00.202343 15830 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:00.191495 16950 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:00.206141 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:00.207037 15838 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.202157 15983 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.210788 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:00.212321 16952 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.204087 16492 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.209445 16950 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:00.216264 16950 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.220932 16985 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.221344 16985 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.221696 16985 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.226470 16489 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:00.193763 16953 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:24:00.228291 15731 catalog_manager.cc:5697] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 4, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.231881 15732 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.232177 15987 raft_consensus.cc:2955] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.245918 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet afd0e40a445b47b68759b884aff8da86 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:24:00.290563 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet afd0e40a445b47b68759b884aff8da86 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:00.302946 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet ec82df0e9104447ab3e50c2a6968cf7e with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43658
I20260709 12:24:00.329861 16942 raft_consensus.cc:993] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:00.330343 16942 raft_consensus.cc:1081] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:00.336793 15730 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.332192 15838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:24:00.339126 15838 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.339479 15838 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.347817 17002 tablet_replica.cc:333] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:24:00.348990 17002 raft_consensus.cc:2243] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.349740 17002 raft_consensus.cc:2272] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.348781 15838 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.352039 17000 tablet_replica.cc:333] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:24:00.355086 16985 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.361106 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:00.361600 15832 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.363126 15904 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.366111 15832 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:00.367136 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:00.372272 15838 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:00.373816 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:00.374413 15912 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.374715 15912 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:00.375312 17002 ts_tablet_manager.cc:1916] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:00.375720 16942 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:00.375500 15912 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.376199 16942 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:00.376655 15912 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.377049 16942 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.384438 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:00.385053 15987 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.384128 16938 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:00.391549 16938 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.394642 15982 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.394708 16487 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.398175 16922 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.399909 16938 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.400779 17000 raft_consensus.cc:2243] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.400889 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:00.401571 16933 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:00.402225 16933 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.402769 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:00.403301 15987 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:00.403579 16489 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:00.405123 16933 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:00.405469 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:00.406123 15838 raft_consensus.cc:2368] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:00.407256 15950 leader_election.cc:400] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:00.407534 15950 leader_election.cc:403] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.407914 15912 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:00.408320 16927 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.408651 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:00.408958 16922 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.401611 15904 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:00.415328 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:00.417282 17000 raft_consensus.cc:2272] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.417567 16958 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:00.421748 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:00.425432 16938 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.427832 16489 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.430205 16851 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.431306 16938 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:00.433027 16938 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.433874 17000 ts_tablet_manager.cc:1916] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:00.438385 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:00.443514 16936 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:00.443907 16936 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:00.444243 16936 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.422900 16985 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:00.463027 15731 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.472030 15982 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.478107 16927 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:00.480969 15838 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:00.486752 15987 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:00.494175 16923 raft_consensus.cc:993] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:00.494714 16923 raft_consensus.cc:1081] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:00.496874 15838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:24:00.439157 16487 raft_consensus.cc:2955] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.497587 15838 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.498056 15838 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.493423 16927 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:24:00.505926 15838 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.508299 15838 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:00.510164 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:00.510725 15904 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.512985 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bf6eca653c94d5bba2406c3006ac72e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:00.485019 16936 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.543830 16973 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.558405 17002 ts_tablet_manager.cc:1929] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:00.568346 17002 log.cc:1199] T ec82df0e9104447ab3e50c2a6968cf7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/ec82df0e9104447ab3e50c2a6968cf7e
I20260709 12:24:00.568243 16973 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.545325 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:00.570137 15983 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.570457 15983 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:00.571168 15983 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.588932 16942 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.598275 16851 raft_consensus.cc:993] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:00.598842 16851 raft_consensus.cc:1081] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:00.606745 15983 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.609001 16973 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.609691 15986 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:00.565779 16950 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.613862 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet ec82df0e9104447ab3e50c2a6968cf7e (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:00.611127 16985 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.582954 16489 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.622918 15904 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:00.627538 15983 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:00.629176 17000 ts_tablet_manager.cc:1929] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:00.649466 16936 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.649847 17000 log.cc:1199] T afd0e40a445b47b68759b884aff8da86 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/afd0e40a445b47b68759b884aff8da86
I20260709 12:24:00.636340 16492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:00.636422 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:00.651542 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:00.651744 16492 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.651847 16487 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:00.652262 16492 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.652720 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet afd0e40a445b47b68759b884aff8da86 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:00.653311 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:00.589529 16942 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.654201 16487 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:00.655843 16942 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.575479 15830 raft_consensus.cc:2955] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.660211 15834 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:00.653532 16938 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.661422 16938 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:00.662358 16938 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:00.662660 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:00.663362 16487 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:00.664749 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:00.665468 16985 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.665814 16985 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.666143 16985 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.667037 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:00.667711 15829 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:00.669360 16492 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.672346 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:00.672942 15829 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.674081 16985 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.656332 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:00.674630 16495 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:00.676654 16889 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.677683 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:00.679507 15829 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:00.679848 16985 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.680905 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:00.691211 16495 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.692035 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:00.692934 16904 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.698040 16495 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:00.699211 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:00.699425 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58dc18a7b4f448bd8d86eec830a0f612 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:00.681134 16492 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:00.681241 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:00.700199 15983 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.700584 15983 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:00.701407 15983 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.702405 15983 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.704160 16985 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:00.704680 16985 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:00.656528 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:00.705580 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 49201.2us
I20260709 12:24:00.707762 16973 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:00.708252 16973 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.623356 15730 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.708700 16973 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.719561 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:00.721709 16985 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.725080 15732 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.745126 15983 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:00.745436 16974 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.748085 16495 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:00.759275 16927 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.740864 16904 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:00.787669 16904 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:00.824699 17010 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:24:00.810070 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bf6eca653c94d5bba2406c3006ac72e with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:24:00.810156 16933 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:00.820688 17011 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.867965 17011 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.875308 17011 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:00.869890 16933 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.878350 16933 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:00.880895 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:00.881747 16489 raft_consensus.cc:2368] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:00.883737 15953 leader_election.cc:400] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:00.884208 15953 leader_election.cc:403] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.886585 17000 tablet_replica.cc:333] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:24:00.887751 17000 raft_consensus.cc:2243] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:00.888527 17000 raft_consensus.cc:2272] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:00.897439 15832 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:00.899389 15731 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.900926 15731 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:00.939186 16950 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:00.938174 16942 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.966646 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:00.967298 15832 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:00.965507 15905 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.952502 16973 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:00.981271 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:00.999940 16883 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.002719 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.004418 15909 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:01.004930 17000 ts_tablet_manager.cc:1916] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:01.011375 16985 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.013502 16931 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.015583 17018 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.021618 16976 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:01.059077 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.063127 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:01.065349 16851 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:01.057482 16904 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.065851 16851 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:01.055032 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73900.1us
I20260709 12:24:01.075791 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 58dc18a7b4f448bd8d86eec830a0f612 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:24:01.050401 16883 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.079476 16851 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:01.056000 16985 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.068511 16978 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.055652 16931 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.074846 16904 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.072134 15905 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:01.081616 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:01.058020 17018 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.089450 16904 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.135685 16883 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.149402 15830 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 2: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:01.145845 16938 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.160935 17016 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:01.164608 17027 tablet_replica.cc:333] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:24:01.163462 16973 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:01.177985 16978 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:01.165249 16938 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.180328 16931 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:01.187668 17027 raft_consensus.cc:2243] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:01.166134 17016 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.209194 16985 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.197199 17027 raft_consensus.cc:2272] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:01.222263 16938 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.224216 17016 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.225476 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.225685 15983 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:01.226154 15988 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:01.227100 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.227689 15980 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:01.243091 15731 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.253350 16950 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:01.235909 17027 ts_tablet_manager.cc:1916] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:01.251245 16904 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:01.266824 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.267447 15908 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
W20260709 12:24:01.268590 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 190289us
I20260709 12:24:01.269358 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.269956 15909 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:01.232692 17018 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.271723 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:01.296177 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:01.296773 15838 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:01.295522 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:01.298470 16938 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.298836 16938 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.299176 16938 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.277388 16985 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.281492 16976 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.287048 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:01.300454 15830 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:01.287187 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:01.300179 15906 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.301661 16936 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.302102 16936 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.302428 16936 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.288829 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:01.299098 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:01.300176 16976 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.307451 15833 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.308323 15834 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:01.277000 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.312075 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.314524 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.324225 15984 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:24:01.324512 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 253026us
I20260709 12:24:01.327190 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:01.328724 15730 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.317821 16889 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.326299 17017 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:01.379871 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 64035us
I20260709 12:24:01.366366 16889 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.374046 17017 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.380162 17030 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.373778 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:01.421671 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 43939.7us
I20260709 12:24:01.386176 15986 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.386695 16889 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.432327 15950 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.355932 16978 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:01.421669 17017 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.430186 15982 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:01.438315 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 105885us
I20260709 12:24:01.439225 16931 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.441287 16976 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.432917 17030 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:01.484150 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46135.9us
I20260709 12:24:01.463464 16931 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.469678 16985 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.448187 17039 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:24:01.501847 16931 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.512633 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.510784 16985 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.568234 16495 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:01.675179 16931 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.677400 16931 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:01.681490 17030 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.711449 16936 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.713702 16936 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.715469 17000 ts_tablet_manager.cc:1929] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:01.715798 17000 log.cc:1199] T 7bf6eca653c94d5bba2406c3006ac72e P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/7bf6eca653c94d5bba2406c3006ac72e
W20260709 12:24:01.713465 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 152532us
I20260709 12:24:01.683102 15833 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:01.734382 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:01.735262 15838 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:01.737226 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 7bf6eca653c94d5bba2406c3006ac72e (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:01.717644 16889 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.748345 16904 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:01.749405 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:01.750134 15905 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.756558 16889 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.761718 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:01.762280 15910 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.754242 16985 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.774618 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.775345 15980 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:01.739418 17048 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:24:01.779716 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 222166us
I20260709 12:24:01.782775 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.783340 15907 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:01.784029 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:01.785712 15907 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:01.789521 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.792321 16938 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.793129 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:01.793682 16487 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.794445 16938 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.795557 15831 raft_consensus.cc:2368] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:01.786377 17016 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:24:01.798599 15910 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:01.779275 16931 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:01.802718 16931 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.804693 16931 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:01.808374 17027 ts_tablet_manager.cc:1929] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:01.817968 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:01.820303 15910 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:01.809468 17027 log.cc:1199] T 58dc18a7b4f448bd8d86eec830a0f612 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/58dc18a7b4f448bd8d86eec830a0f612
I20260709 12:24:01.823380 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.823973 15987 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:01.833650 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.834167 15987 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:01.841351 15985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "021499433bf04873a1ec6376aba69864"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:01.842049 15985 raft_consensus.cc:606] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:01.843226 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:01.843391 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.843842 15984 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.844245 15982 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:01.845971 15983 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:01.840461 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:01.849754 15988 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:01.853417 15876 leader_election.cc:400] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:01.853726 15876 leader_election.cc:403] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:01.855432 15984 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:01.856366 16939 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:01.857689 17028 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.859097 17017 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.860162 16978 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.866185 15906 raft_consensus.cc:2368] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:01.872558 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 58dc18a7b4f448bd8d86eec830a0f612 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:01.870292 17017 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:01.863428 15905 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:01.875765 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.876259 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:01.877650 16904 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.878126 16904 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:01.878938 17052 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.879020 16904 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:01.879910 17052 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:01.883692 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:01.883455 17052 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.884454 15909 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:01.874799 16487 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:01.885835 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.888831 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:01.892263 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.894791 15988 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:01.895670 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.904029 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.896420 17018 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.902570 17030 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.905076 17018 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.905161 17030 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.905262 16938 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.905777 17030 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.905959 16938 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:01.905414 17018 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.900297 17048 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:24:01.901891 17045 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.918002 17045 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:01.918529 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.918913 17045 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:01.919269 17017 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:01.920143 17017 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.915912 15979 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:01.922463 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:01.922946 15984 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.907162 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:01.929020 16938 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.914129 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.920389 17017 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.938555 15984 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:01.936480 17042 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:01.941946 15912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:01.942139 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:01.943158 17050 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:01.950806 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:01.957566 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:01.955242 15982 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:01.956403 16942 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.964345 16942 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:01.965296 16942 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:01.965868 15830 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:01.954144 17050 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:01.967330 17050 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.984756 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:01.987654 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:01.989996 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:01.999464 16958 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.013836 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:02.053913 15952 leader_election.cc:400] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.054312 15952 leader_election.cc:403] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:02.074719 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:02.062964 17035 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.063300 16978 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:02.088721 17060 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
I20260709 12:24:02.064392 17030 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.089988 16976 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.108971 15838 raft_consensus.cc:2368] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.110070 17030 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.084215 16978 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.101408 16489 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:02.137024 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.146766 15950 leader_election.cc:400] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.140336 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:02.164261 17051 raft_consensus.cc:993] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:02.164731 17051 raft_consensus.cc:1081] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:02.170933 16978 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.172498 16489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "021499433bf04873a1ec6376aba69864"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:02.173105 16489 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.173539 16489 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.142071 17017 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.189309 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:02.192823 15913 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:02.198813 17039 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:02.199787 17039 consensus_queue.cc:1243] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:02.200399 17039 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:02.202698 17050 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.203840 17017 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.205076 15910 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:02.175709 17018 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.207393 15986 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.212167 17018 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.213346 15837 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:02.214965 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:02.215698 15832 raft_consensus.cc:2368] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.200781 17039 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:02.222577 15950 leader_election.cc:400] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.227761 15950 leader_election.cc:403] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:02.228009 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:02.224483 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:02.218658 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.271368 15832 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:02.273088 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:02.207753 15912 raft_consensus.cc:606] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:02.275336 15912 raft_consensus.cc:614] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:02.297600 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 75751.4us
I20260709 12:24:02.297223 17018 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:24:02.309535 16489 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.312577 17050 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:02.318817 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:02.319451 15985 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:02.319743 15985 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:02.321692 15730 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.323441 15983 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:02.325322 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 92321.7us
W20260709 12:24:02.326599 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 91426us
I20260709 12:24:02.320490 15985 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.336230 15985 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.331300 16489 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.345027 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.366001 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:02.379040 15911 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:02.368839 16958 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.370887 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.378376 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:02.402702 15985 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:02.406167 17048 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:02.410547 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:02.383723 15986 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:02.418547 16904 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:02.422048 16904 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:02.422501 17045 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:02.423056 16904 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.417263 17028 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:02.404481 15904 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.464167 15904 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:02.486943 15912 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.498103 17023 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.500375 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:02.503403 17030 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.494900 15904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:02.505862 17030 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:02.505925 15904 raft_consensus.cc:606] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:02.506912 17030 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.508848 15834 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.509016 15904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:02.510938 16883 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.511396 15904 raft_consensus.cc:606] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:02.516335 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:02.517014 15731 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:02.534600 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 117337us
I20260709 12:24:02.538529 15837 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.543159 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:02.547842 16938 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:02.548089 15988 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.549414 16922 raft_consensus.cc:993] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:02.549896 16922 raft_consensus.cc:1081] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:02.553664 15830 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:02.554128 17023 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.557950 15910 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.527123 17039 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.568646 17039 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.568660 17044 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:02.564536 16489 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:02.567065 15981 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.563422 17053 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.575969 17051 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:02.578730 15830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:24:02.579366 15830 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.579721 15830 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.583145 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:02.583847 16976 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.587628 17017 raft_consensus.cc:993] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:02.588090 16889 raft_consensus.cc:1081] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:02.601305 15911 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:02.602116 15909 raft_consensus.cc:606] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:02.594537 16936 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:24:02.606300 15832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:24:02.606858 15832 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.607250 15832 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.614491 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:02.616776 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.618746 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:02.605839 16990 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:24:02.625241 15832 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.632128 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.632704 15910 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:02.632995 15910 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:02.631470 15832 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.633756 15910 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.637859 15910 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.645201 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:02.668370 15910 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:02.671342 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:02.692082 16939 raft_consensus.cc:993] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:02.676734 16936 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:02.703235 16936 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:02.674165 15986 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.692714 16939 raft_consensus.cc:1081] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:02.727090 15733 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.747306 15733 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.704421 16936 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.778642 15833 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:02.779116 15833 pending_rounds.cc:85] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 4
I20260709 12:24:02.779392 15833 pending_rounds.cc:107] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:02.779696 15833 raft_consensus.cc:2889] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:02.783226 17048 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:02.804811 15986 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:02.845477 15830 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.847703 15830 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:02.849659 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.850276 15909 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:02.850571 15909 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:02.851400 15909 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.852078 15732 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 2 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 3 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.852576 15909 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.878302 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:02.878919 15986 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.888674 15986 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:02.896287 15909 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:02.900835 15732 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:02.906332 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:02.912814 15981 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.914381 15835 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:02.923244 15733 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.927559 17079 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:02.928063 17079 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:02.928925 17079 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:02.939977 15911 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:02.943241 15730 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.944171 16958 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.948176 16936 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.954893 16496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:42798
I20260709 12:24:02.955401 16496 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.955729 16496 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.962829 16496 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.965276 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:02.965811 15835 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.970263 16496 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:02.973646 15835 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:02.974866 15981 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:02.974798 16457 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:02.975692 17048 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:02.976193 17048 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:02.977540 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:02.977156 17048 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.978030 15911 raft_consensus.cc:3055] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:02.978304 15911 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:02.978890 15911 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:02.979759 15911 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.987959 17040 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.999692 16922 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.023439 15730 catalog_manager.cc:5697] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.028208 15909 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:03.019454 15879 consensus_peers.cc:597] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43b58d74f13f487eaa63ac4992bca77b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.033771 15911 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:03.034497 15732 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 4, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 4 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.037005 15732 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.040933 17043 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:03.043990 16985 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:03.046083 15988 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:03.050978 15835 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:03.087823 15981 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.090917 17043 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:03.260008 15732 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:03.314647 15909 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:03.317109 15835 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:03.324604 17030 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:03.341192 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 57851.1us
W20260709 12:24:03.354939 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 236717us
W20260709 12:24:03.363513 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 64720.6us
W20260709 12:24:03.390223 17103 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:24:03.444185 15803 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bb7213c7f6d42bc818fcdd60101ee30. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.483923 17115 ts_tablet_manager.cc:933] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:03.498435 15909 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:03.507025 15981 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:03.507514 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 51987.3us
I20260709 12:24:03.511533 17115 tablet_copy_client.cc:323] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
W20260709 12:24:03.512851 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 79380.8us
I20260709 12:24:03.513410 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 43b58d74f13f487eaa63ac4992bca77b from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:24:03.513957 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 43b58d74f13f487eaa63ac4992bca77b from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-43b58d74f13f487eaa63ac4992bca77b
I20260709 12:24:03.522586 15911 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.524339 17117 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:03.527369 15923 tablet_copy_source_session.cc:215] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:03.533464 17115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b58d74f13f487eaa63ac4992bca77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:03.538364 16976 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:03.541416 15829 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.542881 17117 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:03.549075 15986 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:03.559021 17039 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:03.567399 15981 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:03.570794 16976 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:03.573167 17039 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:03.573753 15981 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:24:03.577745 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 117389us
I20260709 12:24:03.602711 15906 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:03.611982 17115 tablet_copy_client.cc:806] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:03.612568 17115 tablet_copy_client.cc:670] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:03.617887 15835 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:03.644318 16936 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:24:03.661604 15910 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:03.692734 17120 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:24:03.732266 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 65429.1us
I20260709 12:24:03.748536 17115 tablet_copy_client.cc:538] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:03.773452 15730 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.785413 15984 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.795112 17079 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:24:03.827236 15803 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b51295f13874e3492f0541da8a1f625. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.856815 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:03.887684 15911 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.908795 17115 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:03.948330 16938 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.990504 17128 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.020217 15986 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.021454 15981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:04.022069 15981 raft_consensus.cc:606] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:04.029557 15906 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.041462 15983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25191835faf945ef870143a9ce1b2127"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:04.042129 15983 raft_consensus.cc:606] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:04.045971 15983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:04.046558 15983 raft_consensus.cc:606] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:04.049012 15983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:04.049612 15983 raft_consensus.cc:606] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:04.073609 15983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:04.074462 15983 raft_consensus.cc:606] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:04.075743 15733 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.080504 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:04.088614 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:04.089551 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.106264 15829 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.150768 17115 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:04.154340 17115 tablet_bootstrap.cc:492] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:04.162206 17115 ts_tablet_manager.cc:1403] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.254s	user 0.045s	sys 0.024s
I20260709 12:24:04.163311 17139 ts_tablet_manager.cc:933] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:04.162478 15906 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:24:04.164461 15803 consensus_peers.cc:597] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 636b8846a0e64d48a3b14ad3af01bb3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:04.164943 17131 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.171623 15986 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:04.175858 17115 raft_consensus.cc:359] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.179102 17115 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:04.180181 17115 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.181217 17131 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.187808 17139 tablet_copy_client.cc:323] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:24:04.194844 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 1bb7213c7f6d42bc818fcdd60101ee30 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:24:04.195379 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 1bb7213c7f6d42bc818fcdd60101ee30 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-1bb7213c7f6d42bc818fcdd60101ee30
I20260709 12:24:04.204552 15848 tablet_copy_source_session.cc:215] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:04.208267 17045 raft_consensus.cc:993] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:04.208868 17113 raft_consensus.cc:1081] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:04.210878 16495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:04.211585 16495 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.212086 16495 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.215663 15909 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.232607 16495 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.234391 17139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb7213c7f6d42bc818fcdd60101ee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.207592 17131 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.236999 15983 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:04.244053 17115 ts_tablet_manager.cc:1434] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 12:24:04.252007 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-43b58d74f13f487eaa63ac4992bca77b received from {username='slave'} at 127.0.0.1:41588
I20260709 12:24:04.252445 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-43b58d74f13f487eaa63ac4992bca77b on tablet 43b58d74f13f487eaa63ac4992bca77b with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:04.271006 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:04.271093 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:04.271569 15986 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.271761 15829 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.271906 15986 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:04.272822 15986 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.273820 15986 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.277130 16495 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:04.279964 15986 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:04.281024 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:04.282018 17117 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.282516 17117 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:04.283434 17117 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.272012 15730 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.281358 15829 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:04.326647 17139 tablet_copy_client.cc:806] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:04.327299 17139 tablet_copy_client.cc:670] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:04.336735 17045 raft_consensus.cc:993] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:04.337195 17045 raft_consensus.cc:1081] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:04.339072 16495 raft_consensus.cc:1217] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:04.339222 16492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:04.339905 16492 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.340296 16492 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.357573 17139 tablet_copy_client.cc:538] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:04.357167 16492 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.361196 15731 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.362569 17115 ts_tablet_manager.cc:933] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:04.364935 17113 raft_consensus.cc:993] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:04.365523 17113 raft_consensus.cc:1081] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:04.367498 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:24:04.368106 15906 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.368477 15906 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.381834 16492 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:04.381778 15906 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:04.383823 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:04.384382 15830 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.385211 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:04.385886 15829 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.392832 15829 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:04.394155 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:04.395089 17115 tablet_copy_client.cc:323] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:24:04.385272 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:04.396493 16889 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.397086 16889 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:04.396936 15983 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:04.398098 15983 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:04.398155 16889 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:04.397308 15906 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:04.399808 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 8b51295f13874e3492f0541da8a1f625 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:24:04.399773 15983 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.400485 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 8b51295f13874e3492f0541da8a1f625 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-8b51295f13874e3492f0541da8a1f625
I20260709 12:24:04.404791 15830 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:04.424036 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:04.411538 15848 tablet_copy_source_session.cc:215] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:04.425196 17117 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:04.428674 17117 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:04.429522 17115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b51295f13874e3492f0541da8a1f625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.430153 17117 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.432186 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:04.432750 15986 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.433009 15986 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:04.425189 15983 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.433723 15986 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:04.435068 15986 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.438043 17118 raft_consensus.cc:993] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:04.438483 17118 raft_consensus.cc:1081] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:04.439983 16487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25191835faf945ef870143a9ce1b2127"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:04.440537 16487 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.440899 16487 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.443455 15986 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:04.467527 16487 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.484763 15732 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.490700 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:04.491372 15906 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.496526 16487 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:04.489349 17139 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:04.502619 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:04.506624 15730 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 3 to 4, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.508694 15906 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:04.511415 16459 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:04.512317 17117 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.512871 17117 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:04.513827 17117 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.523016 17119 raft_consensus.cc:993] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:04.523485 17119 raft_consensus.cc:1081] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:04.527499 17115 tablet_copy_client.cc:806] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:04.522557 15983 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:04.533057 17115 tablet_copy_client.cc:670] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:04.532757 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:24:04.533985 15906 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.534413 15906 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.544114 17115 tablet_copy_client.cc:538] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:04.543613 15906 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:04.565675 17115 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:04.568102 15986 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.570598 15986 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:04.571470 15986 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.572805 15986 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.574782 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:04.575357 15829 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.584604 15986 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:04.586163 15829 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:04.587358 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:04.588357 17107 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.588899 17107 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:04.586913 15730 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.644027 15906 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:04.589862 17107 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:04.666785 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:04.667402 15983 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.667726 15983 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:04.668516 15983 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:04.671911 15983 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.688326 17151 ts_tablet_manager.cc:933] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:04.691438 17139 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:04.692392 17139 tablet_bootstrap.cc:492] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:04.693593 15986 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:04.710022 17117 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:04.697610 17139 ts_tablet_manager.cc:1403] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.011s
W20260709 12:24:04.719179 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 61271.2us
I20260709 12:24:04.730196 15731 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.740262 15983 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:04.748016 17139 raft_consensus.cc:359] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.749464 17139 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:04.750187 17139 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.752926 17139 ts_tablet_manager.cc:1434] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:24:04.761723 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-1bb7213c7f6d42bc818fcdd60101ee30 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:24:04.762203 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-1bb7213c7f6d42bc818fcdd60101ee30 on tablet 1bb7213c7f6d42bc818fcdd60101ee30 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:04.765957 17115 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:04.769613 17115 tablet_bootstrap.cc:492] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:04.770714 17115 ts_tablet_manager.cc:1403] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.205s	user 0.029s	sys 0.010s
I20260709 12:24:04.773667 17115 raft_consensus.cc:359] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.774524 17115 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:04.775213 17115 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:04.777083 17151 tablet_copy_client.cc:323] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:24:04.779247 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 636b8846a0e64d48a3b14ad3af01bb3c from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:24:04.779796 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 636b8846a0e64d48a3b14ad3af01bb3c from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-636b8846a0e64d48a3b14ad3af01bb3c
I20260709 12:24:04.787278 15829 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.789314 17133 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.791357 17115 ts_tablet_manager.cc:1434] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:24:04.792768 15848 tablet_copy_source_session.cc:215] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:04.799930 15838 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:04.801810 17151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636b8846a0e64d48a3b14ad3af01bb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.808698 17117 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:04.843101 16958 raft_consensus.cc:1064] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:04.850505 15986 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.869009 16958 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:04.872145 16889 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.819733 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-8b51295f13874e3492f0541da8a1f625 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:24:04.877501 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-8b51295f13874e3492f0541da8a1f625 on tablet 8b51295f13874e3492f0541da8a1f625 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:04.887488 16495 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.887598 15981 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.889170 17107 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.890905 17107 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.891521 15829 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.892956 16889 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.909879 15829 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:04.911319 17048 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:04.933715 17151 tablet_copy_client.cc:806] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:04.934257 17151 tablet_copy_client.cc:670] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:04.943527 15986 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:04.945194 17048 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:04.962316 16492 raft_consensus.cc:1217] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:04.970000 17151 tablet_copy_client.cc:538] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:04.979386 17151 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:04.986799 16889 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:04.990506 15838 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.005373 16495 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.019140 15986 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.019861 15730 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.069229 15838 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:05.071110 17166 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:05.083159 15906 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.084714 17151 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:05.085918 17151 tablet_bootstrap.cc:492] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:05.086823 17151 ts_tablet_manager.cc:1403] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.003s
I20260709 12:24:05.090570 17151 raft_consensus.cc:359] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:05.091557 17151 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:05.092327 17151 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:05.101209 16495 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:05.102398 15986 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:05.105012 17166 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.111294 15981 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.112135 15986 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:05.114194 16889 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.118014 17048 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.127527 16958 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:05.136675 17151 ts_tablet_manager.cc:1434] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.049s	user 0.002s	sys 0.004s
I20260709 12:24:05.138206 15909 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.140805 17107 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.142846 17048 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.158211 15848 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-636b8846a0e64d48a3b14ad3af01bb3c received from {username='slave'} at 127.0.0.1:59154
I20260709 12:24:05.162025 15848 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-636b8846a0e64d48a3b14ad3af01bb3c on tablet 636b8846a0e64d48a3b14ad3af01bb3c with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:05.173780 15986 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.181747 16495 raft_consensus.cc:2955] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.197443 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43b58d74f13f487eaa63ac4992bca77b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:05.205878 15730 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 3 to 4, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 1 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.220816 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b58d74f13f487eaa63ac4992bca77b with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57436
I20260709 12:24:05.222684 17177 tablet_replica.cc:333] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:24:05.223727 17177 raft_consensus.cc:2243] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.225920 16492 raft_consensus.cc:1217] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:24:05.230146 17177 raft_consensus.cc:2272] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.235625 17177 ts_tablet_manager.cc:1916] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:05.256335 17177 ts_tablet_manager.cc:1929] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:05.256851 17177 log.cc:1199] T 43b58d74f13f487eaa63ac4992bca77b P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/43b58d74f13f487eaa63ac4992bca77b
I20260709 12:24:05.258704 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 43b58d74f13f487eaa63ac4992bca77b (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:05.488909 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.510943 16492 raft_consensus.cc:1217] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:05.572329 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:05.573015 15986 raft_consensus.cc:606] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:05.577270 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:05.577853 15986 raft_consensus.cc:606] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:05.580530 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:05.581159 15986 raft_consensus.cc:606] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:05.583725 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:05.584201 15986 raft_consensus.cc:606] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:05.591610 17152 raft_consensus.cc:1064] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:05.593966 17152 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.601130 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:05.601723 15986 raft_consensus.cc:606] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:05.604466 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:05.606006 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:05.606729 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.637622 15906 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.642550 15986 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.644378 17180 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.646432 17153 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.646898 17180 raft_consensus.cc:1064] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:05.649338 17180 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.663631 16492 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.665810 17131 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.683231 16495 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:05.687007 17180 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.690236 15906 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:05.696264 17131 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.701602 15986 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:05.702953 17131 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.717085 17113 raft_consensus.cc:993] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:05.718405 17121 raft_consensus.cc:1081] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:05.720148 16488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:05.720775 16488 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.721211 16488 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.732324 16488 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.739393 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:05.739828 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:05.739966 15838 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.740386 15986 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.740746 15986 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:05.741474 15986 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.742440 15986 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.748664 15838 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:05.749987 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:05.750166 16488 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:05.750852 17117 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.751322 17117 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:05.752257 17117 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.751669 17131 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.764446 15986 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:05.763512 17153 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.769562 15986 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.775121 17113 raft_consensus.cc:993] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:05.775640 17113 raft_consensus.cc:1081] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:05.776475 15910 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.776924 15906 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.780576 15830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:24:05.781111 15830 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.781481 15830 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.782140 15732 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.785281 16488 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.789680 15981 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.798862 15830 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.834575 15830 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:05.836130 17184 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.086s	user 0.003s	sys 0.000s
I20260709 12:24:05.826618 17188 raft_consensus.cc:993] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:05.837401 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:05.837872 17188 raft_consensus.cc:1081] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:05.837958 15986 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.838294 15986 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:05.839005 15986 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.840179 15986 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.832818 15731 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.807271 15730 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.844202 15909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:24:05.848996 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:05.851662 15906 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.857527 16492 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.858503 15906 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:05.882776 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:05.885589 17191 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.886052 17191 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:05.888443 17191 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.894049 15986 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:05.904718 15838 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.851263 15909 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.910769 15909 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.914381 16488 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:05.915896 17191 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.920296 17188 raft_consensus.cc:993] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:05.920732 17188 raft_consensus.cc:1081] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:05.925474 17131 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.927268 15732 catalog_manager.cc:5697] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.927418 16488 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:05.931418 15909 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.934345 15909 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:05.936861 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:05.959693 15830 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.941244 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1bb7213c7f6d42bc818fcdd60101ee30 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:05.944144 15829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:24:05.965894 15829 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.966252 15829 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.970131 15830 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:05.971239 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:05.972298 17107 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.972752 17107 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:05.972815 15829 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.973685 17107 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.975090 15829 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:05.975495 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:05.976052 15983 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.975414 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:05.976368 15983 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:05.976540 15909 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.983465 17045 raft_consensus.cc:993] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:05.984015 17113 raft_consensus.cc:1081] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:05.985361 15838 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.948763 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:05.957443 17190 raft_consensus.cc:1064] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:05.989100 15909 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:05.990705 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:05.991822 17190 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:05.992417 17191 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.986212 16492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:05.992929 17191 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:05.993362 16492 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.993772 16492 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.993805 17191 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.996397 15983 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:05.997563 15983 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.001811 15981 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.002223 15981 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:06.007758 16495 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.008111 15986 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.010960 17131 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.012081 17180 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.945951 15906 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:06.012208 15981 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:06.015519 17180 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.019191 17153 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.014338 15981 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.024533 16488 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.026854 15910 raft_consensus.cc:2955] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.028756 15986 raft_consensus.cc:2955] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.036610 15983 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:06.045120 16492 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:06.046733 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b51295f13874e3492f0541da8a1f625 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.048007 16492 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:06.047751 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:06.049047 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:06.049571 15985 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.049834 15985 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:06.050629 15985 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:06.051863 15985 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.052184 15830 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.059695 15830 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:06.064169 15981 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:06.070470 15985 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:06.070518 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:06.068972 15732 catalog_manager.cc:5697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.073495 15730 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 4, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.074775 17117 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.064188 15731 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.075858 17117 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:06.077111 17117 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:06.081287 15981 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:06.081487 15910 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:06.082789 17180 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.085739 17191 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.106352 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bb7213c7f6d42bc818fcdd60101ee30 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43658
I20260709 12:24:06.114528 17180 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.118752 16488 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:06.118011 15985 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.120002 17191 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.133432 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b51295f13874e3492f0541da8a1f625 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50320
I20260709 12:24:06.133663 15732 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.146948 15838 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.149307 17117 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.170476 15731 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.180011 15733 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.183665 16495 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.192190 15910 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.206938 17203 tablet_replica.cc:333] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:24:06.238153 17204 tablet_replica.cc:333] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:24:06.239295 17204 raft_consensus.cc:2243] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.240198 17204 raft_consensus.cc:2272] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.242277 17206 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:24:06.243793 17204 ts_tablet_manager.cc:1916] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.249812 17203 raft_consensus.cc:2243] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.250615 17203 raft_consensus.cc:2272] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.261484 17203 ts_tablet_manager.cc:1916] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.268848 15981 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.270545 17117 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.281877 17203 ts_tablet_manager.cc:1929] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:24:06.285071 17204 ts_tablet_manager.cc:1929] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:06.287441 15910 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.294226 17204 log.cc:1199] T 8b51295f13874e3492f0541da8a1f625 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/8b51295f13874e3492f0541da8a1f625
I20260709 12:24:06.293251 17203 log.cc:1199] T 1bb7213c7f6d42bc818fcdd60101ee30 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/1bb7213c7f6d42bc818fcdd60101ee30
I20260709 12:24:06.296864 17191 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.298621 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 1bb7213c7f6d42bc818fcdd60101ee30 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:06.305946 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 8b51295f13874e3492f0541da8a1f625 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:06.396528 15985 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.396924 15986 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.400440 16958 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.402160 17180 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.417117 15910 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.437108 17190 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:06.460414 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 103508us
I20260709 12:24:06.521744 15984 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:06.533561 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45017.5us
I20260709 12:24:06.546514 15830 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.556541 15981 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.570307 15830 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.575103 17117 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.583582 17107 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.585846 17117 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.598408 17190 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.657889 15830 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:06.748807 15910 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.752043 17153 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.768522 17191 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.777396 15906 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.816622 16495 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.819957 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 636b8846a0e64d48a3b14ad3af01bb3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.820856 17190 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.827365 16495 raft_consensus.cc:2955] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.852334 15731 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 4 to 5, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:06.880035 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 636b8846a0e64d48a3b14ad3af01bb3c with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43658
I20260709 12:24:06.881789 17226 tablet_replica.cc:333] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:24:06.883234 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.885550 17226 raft_consensus.cc:2243] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.886293 17226 raft_consensus.cc:2272] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.889961 17226 ts_tablet_manager.cc:1916] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.903419 17226 ts_tablet_manager.cc:1929] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:06.903847 17226 log.cc:1199] T 636b8846a0e64d48a3b14ad3af01bb3c P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/636b8846a0e64d48a3b14ad3af01bb3c
I20260709 12:24:06.905380 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 636b8846a0e64d48a3b14ad3af01bb3c (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:24:06.946184 15906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:06.946776 15906 raft_consensus.cc:606] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:06.966112 15830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60558
I20260709 12:24:06.966696 15830 raft_consensus.cc:606] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:06.969224 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:06.969787 15986 raft_consensus.cc:606] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:06.972419 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:06.973009 15986 raft_consensus.cc:606] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:06.975521 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:06.976073 15986 raft_consensus.cc:606] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:06.978349 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:06.979836 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:06.980463 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.981464 17107 raft_consensus.cc:993] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:06.989226 17107 raft_consensus.cc:1081] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:06.991127 15838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:24:06.991648 15838 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.994726 15838 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.014171 15838 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.017161 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:07.017680 15906 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.017941 15906 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:07.100266 15838 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:07.018641 15906 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.114168 15906 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.120606 15906 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:07.129938 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:07.132054 17153 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.132534 17153 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:07.133399 17153 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.141014 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:07.141549 15981 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.148115 15981 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:07.162097 15732 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.289670 17217 raft_consensus.cc:993] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:07.290174 17188 raft_consensus.cc:1081] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:07.291595 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:24:07.292037 15906 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.292313 15906 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.297350 15906 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.298732 15906 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:07.299324 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:07.299875 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:07.299957 15838 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.300377 15981 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.300673 15981 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:07.301322 15981 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.302305 15981 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.307312 15981 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:07.307929 15838 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:07.308274 15879 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:07.309011 17107 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.309494 17107 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:07.310315 17107 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.319594 15732 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.324887 17153 raft_consensus.cc:993] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:07.325435 17152 raft_consensus.cc:1081] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:07.326977 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:24:07.327442 15906 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.327762 15906 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.332981 17188 raft_consensus.cc:993] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:07.333515 17188 raft_consensus.cc:1081] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:24:07.333740 15906 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.335079 16495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:34608
I20260709 12:24:07.335598 16495 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.335923 16495 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.336197 15906 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:07.336369 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:07.336884 15981 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.342947 15981 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:07.343797 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:07.344516 16958 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.347090 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:07.347657 15838 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.347990 15838 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:07.348790 15838 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.350028 15838 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.353777 16495 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:07.355989 16958 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:07.357106 15838 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:07.358495 16958 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.364288 16495 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:07.364439 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:07.364501 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:07.365296 15838 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.365482 15981 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.365928 15981 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:07.366719 15981 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:07.368011 15981 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.377146 15838 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:07.378551 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:07.380125 17117 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:07.379782 15732 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.380623 17117 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:07.381563 17117 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:07.384874 15981 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:07.397814 15732 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 3 to 4, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.520661 17212 raft_consensus.cc:993] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:07.522398 17188 raft_consensus.cc:1081] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:07.524691 15838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:24:07.525759 15838 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.526374 15838 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.563175 15838 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.567199 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:07.567680 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:07.568073 15910 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.568425 15981 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.568853 15981 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:07.570037 15981 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.571640 15981 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.567230 15838 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:07.576814 15906 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.578313 17190 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:07.579682 15910 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:07.581174 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:07.582353 17190 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.582890 17190 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:07.585230 17190 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:07.582492 15981 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:07.632685 15732 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.706524 15986 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.708297 17190 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:07.752036 15838 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.754825 17232 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:24:07.779948 15981 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.786337 16958 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:07.802690 15986 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.804806 16958 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.806362 15981 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:07.809563 17117 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:07.856985 15838 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.864603 17232 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:07.875619 15829 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:07.892537 17117 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.023672 15981 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:08.031195 15906 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:08.032508 15953 consensus_peers.cc:597] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21e8af32d711469181861fb4a98feec9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.033914 15829 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:08.034125 17236 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.035912 17217 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.049701 15910 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.050340 17217 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.051703 17190 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.052204 15829 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.063678 15906 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.071115 15732 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.073863 15838 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:24:08.093863 15803 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a4fafd7ec404ad9b05209ed0c8c1a19. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.097200 15981 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:08.099179 17152 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.105574 15906 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:08.107062 17190 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.114502 15983 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.126746 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.127566 17191 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:08.154549 17190 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.184842 15986 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.232838 15906 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.247246 15731 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 2, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 1 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.295936 15829 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:08.362727 15986 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:08.364833 15829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60558
I20260709 12:24:08.365494 15829 raft_consensus.cc:606] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:08.367255 17190 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:08.372409 15906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:08.372908 15906 raft_consensus.cc:606] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:08.377000 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:24:08.388736 15803 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e271b9d1bc8403ba1c9d3e80c36917c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.389549 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:08.392937 15909 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:08.399281 17153 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:08.403141 17153 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.411489 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.426481 15983 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.428043 15906 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.435915 15909 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:08.439494 15732 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:08.456911 15879 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cbb40ff3a44403a8705489ecc556e3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.464202 15983 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:08.466037 17231 raft_consensus.cc:993] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:24:08.466444 17231 raft_consensus.cc:1081] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:24:08.472411 15983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:24:08.472901 15983 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.477061 15983 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.477932 15829 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:08.479525 17232 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:08.487151 15983 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:08.490952 16958 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:08.493875 15983 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:08.495949 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:08.496953 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:08.497550 15910 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.497813 15910 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:08.498514 15910 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:08.499537 15910 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.506289 16495 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.510551 17232 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.512372 15986 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.520462 15829 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.537583 15910 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:08.549687 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:08.550558 17212 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.551262 17212 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:08.552198 17212 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:08.553130 15732 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 3, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:08.552942 16495 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:08.614629 17264 ts_tablet_manager.cc:933] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:08.627946 17264 tablet_copy_client.cc:323] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:24:08.630800 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 21e8af32d711469181861fb4a98feec9 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:24:08.631374 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 21e8af32d711469181861fb4a98feec9 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-21e8af32d711469181861fb4a98feec9
I20260709 12:24:08.639642 15998 tablet_copy_source_session.cc:215] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:08.646718 17264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e8af32d711469181861fb4a98feec9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:09.877570 15878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.028s	sys 0.060s
W20260709 12:24:09.878087 15878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.028s	sys 0.060s
W20260709 12:24:09.886233 16458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.010s	sys 0.003s
I20260709 12:24:09.887477 17107 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.888201 17107 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.890331 17107 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:09.895126 17107 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:09.898155 15951 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.006s	sys 0.017s
W20260709 12:24:09.898486 15951 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.006s	sys 0.017s
I20260709 12:24:09.900427 17272 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:09.900928 17272 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:09.895566 17107 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.903095 17107 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:09.903483 17272 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:09.903522 17107 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.906083 17107 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.907866 17107 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:09.910003 17272 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:09.910140 17217 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.913007 17217 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:09.906109 15950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.014s	sys 0.042s
W20260709 12:24:09.916865 15950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.015s	sys 0.042s
I20260709 12:24:09.917959 17153 raft_consensus.cc:993] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:09.911577 17272 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:09.941717 17117 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:09.945720 17217 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:09.947510 17272 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:09.951436 17117 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:09.952927 17217 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:09.960702 17217 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:09.966357 17217 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:09.967037 17212 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:09.967082 17272 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.967927 17212 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:09.967957 17217 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.969199 17217 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.970221 17212 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:09.970711 17212 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.971118 17217 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:09.967927 17272 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:09.971161 17212 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.973212 17272 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:09.973901 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.000s	sys 0.008s
W20260709 12:24:09.974232 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.000s	sys 0.009s
I20260709 12:24:09.983851 17272 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.984429 17272 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:09.984826 17117 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:09.984025 17107 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.986630 17272 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:09.987954 17217 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:09.987380 17107 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.988533 17217 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:09.992879 17107 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.001349 17212 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.001919 17212 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.002377 17212 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.004462 17212 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.006405 17217 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.006937 17217 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.007436 17217 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:10.008747 15953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.002s	sys 0.021s
W20260709 12:24:10.009096 15953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.002s	sys 0.021s
I20260709 12:24:09.989271 17272 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.014626 17107 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.004942 17212 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.024601 17212 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.023754 17272 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.026823 17212 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.028479 17232 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.027666 17107 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.058030 17117 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.058600 17117 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.037705 15732 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 275) took 1488 ms. Trace:
I20260709 12:24:10.029134 17217 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.066380 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.065945 17231 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.046271 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 114) took 1394 ms. Trace:
I20260709 12:24:10.072261 17272 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.061070 17232 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.029508 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.082525 17231 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.089103 17231 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.089578 17231 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.077157 15838 rpcz_store.cc:276] 0709 12:24:08.651968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.045424 (+1393456us) service_pool.cc:224] Handling call
0709 12:24:10.045752 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.045935 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.045960 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.046008 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:10.046040 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.046099 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.046214 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.090000 17231 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.085366 17107 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.093453 17107 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.093889 17107 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.094969 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.097959 17117 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.117514 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.118244 16496 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:10.118520 17272 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.121723 17231 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.103363 16488 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:10.124434 16489 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:10.121680 17107 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.129172 17117 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.129607 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.129957 17117 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.133834 17107 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.135921 17107 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.144701 17107 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.068706 15732 rpcz_store.cc:276] 0709 12:24:08.549542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.549672 (+   130us) service_pool.cc:224] Handling call
0709 12:24:08.564536 (+ 14864us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.564569 (+    33us) write_op.cc:454] Released schema lock
0709 12:24:10.037611 (+1473042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:08.556685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:08.557369 (+   684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:08.557409 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:24:08.557429 (+    20us) tablet.cc:662] Decoding operations
0709 12:24:08.557821 (+   392us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:08.557907 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:08.557953 (+    46us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:08.558256 (+   303us) tablet.cc:701] Row locks acquired
0709 12:24:08.558278 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:24:08.558446 (+   168us) write_op.cc:270] Start()
0709 12:24:08.558577 (+   131us) write_op.cc:276] Timestamp: P: 1783599848558392 usec, L: 0
0709 12:24:08.558603 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:08.559365 (+   762us) log.cc:844] Serialized 595 byte log entry
0709 12:24:08.561562 (+  2197us) op_driver.cc:464] REPLICATION: finished
0709 12:24:08.561990 (+   428us) write_op.cc:301] APPLY: starting
0709 12:24:08.562068 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:08.562180 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:08.562299 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:08.562625 (+   326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:08.562852 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:08.562929 (+    77us) write_op.cc:312] APPLY: finished
0709 12:24:08.563196 (+   267us) log.cc:844] Serialized 23 byte log entry
0709 12:24:08.563386 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.563469 (+    83us) write_op.cc:454] Released schema lock
0709 12:24:08.563524 (+    55us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6473,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":1805,"apply.run_wall_time_us":1805,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2982,"prepare.run_wall_time_us":2983,"replication_time_us":2825}]]}
I20260709 12:24:10.129858 17272 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.154793 17272 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.156075 17232 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.156409 17266 ts_tablet_manager.cc:933] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:10.169363 17232 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.149791 17191 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.185052 17232 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.185129 17264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34608 (request call id 429) took 1566 ms. Trace:
I20260709 12:24:10.186822 17152 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.186096 17264 rpcz_store.cc:276] 0709 12:24:08.606264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.606376 (+   112us) service_pool.cc:224] Handling call
0709 12:24:08.618453 (+ 12077us) ts_tablet_manager.cc:934] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
0709 12:24:08.645265 (+ 26812us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:09.672476 (+1027211us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:09.672676 (+   200us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:09.884277 (+211601us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:09.884616 (+   339us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:10.168461 (+283845us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:10.169278 (+   817us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":270,"tablet-copy.queue_time_us":7472,"thread_start_us":19516,"threads_started":2}
I20260709 12:24:10.187232 17232 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.187573 17264 tablet_copy_client.cc:806] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.187381 17152 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.188302 17264 tablet_copy_client.cc:670] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:10.185122 17191 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.172629 17212 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.149641 17190 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.172822 17217 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.198414 17268 raft_consensus.cc:1081] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:24:10.200982 17275 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.200934 17212 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.201138 17217 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.201822 17268 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.201715 17275 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.202324 17268 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.203109 17212 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.203231 17217 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.203632 17212 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.198658 17267 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.204233 17212 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.204831 17274 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.204664 17267 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.199246 17272 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.205353 17274 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.206027 17272 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.206779 17267 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.207420 17274 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.208132 17272 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.208223 17107 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.168560 17231 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.208770 17107 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.208886 17231 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.210518 17107 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.210645 17231 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.210952 17107 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.211092 17231 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.211436 17107 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:10.211898 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.292s	user 0.019s	sys 0.006s
W20260709 12:24:10.212240 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.019s	sys 0.006s
I20260709 12:24:10.213654 17191 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.204170 17232 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.214658 17232 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.216121 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.201081 17190 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.216558 17232 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.217160 17232 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:10.217178 16495 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.015s	sys 0.006s
W20260709 12:24:10.217677 16495 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.016s	sys 0.006s
I20260709 12:24:10.217618 17232 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.217994 17190 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.211571 17231 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.223433 17231 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.235884 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.238370 15910 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:10.235601 17107 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.225885 15731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 275) took 1679 ms. Trace:
I20260709 12:24:10.239928 17107 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.240551 17107 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.242763 17107 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.240164 15731 rpcz_store.cc:276] 0709 12:24:08.546607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.546758 (+   151us) service_pool.cc:224] Handling call
0709 12:24:10.225752 (+1678994us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1466055,"reported_tablets":1}
I20260709 12:24:10.243172 17107 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.245136 17212 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.245661 17212 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.246146 17212 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.250015 17217 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.228688 17231 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.269395 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.272301 15983 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:10.264248 17217 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.224948 17152 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.245952 17232 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.285106 17107 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.285939 17212 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.290581 17191 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.294019 17152 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.377511 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.380659 15985 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:10.381568 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.382649 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.385257 17266 tablet_copy_client.cc:323] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:24:10.387269 17217 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.284646 17231 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.338822 17232 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.387964 17212 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.393010 17191 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.393316 17232 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.393539 17212 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.395071 17107 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.395851 17107 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.347797 17272 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.396360 17107 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.387784 17217 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.410596 17212 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.411119 17212 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.413816 17274 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.413975 17212 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.414326 17274 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.414419 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.415385 15983 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:10.416177 17212 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.416285 17274 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.416392 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.416745 17212 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.395138 17190 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.417246 17212 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.417389 17190 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.417846 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:10.418548 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.466s	user 0.017s	sys 0.010s
W20260709 12:24:10.418854 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.017s	sys 0.010s
I20260709 12:24:10.419209 17190 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.427809 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.429903 17191 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.397583 17267 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.434290 17283 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.408352 17153 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.391498 17152 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.434442 17286 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.434973 17314 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.435093 17293 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.435716 17280 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.435935 17278 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.436348 17302 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.457713 17274 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.458298 17277 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.458537 17153 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.458567 17274 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.458947 17277 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.449417 17267 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.460726 17274 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.461395 17267 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.461869 17267 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.461964 17152 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.462383 17267 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.437050 17276 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.437404 17290 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.437873 17279 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.438768 17303 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.449774 17107 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.452535 17232 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.433333 17190 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:10.391076 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 108660us
I20260709 12:24:10.457683 17307 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.456044 17314 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.436602 17269 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.463250 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.490528 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.491294 15984 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:10.433106 17212 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.406797 17272 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.445683 17191 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.460736 17153 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.462538 17286 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.439692 17217 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.491910 17107 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.481292 17277 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.493477 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.493603 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.491189 15911 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:10.499584 17107 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.505375 17285 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.506047 17285 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.508656 17285 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.498121 17190 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.452672 17283 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.513547 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.512193 15988 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
W20260709 12:24:10.515746 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08000d40c0 after lost signal to thread 14652
W20260709 12:24:10.516849 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08000d41c0 after lost signal to thread 15769
I20260709 12:24:10.517278 17281 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.517373 17190 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.498257 17191 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.517856 17281 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.520061 17191 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.520193 17291 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.520658 17107 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.520744 17291 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.521205 17295 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.521809 17295 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.522914 17291 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.525287 17107 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.525678 17107 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.530478 17298 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.530781 17295 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.531052 17298 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.532158 17295 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.532411 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.532673 17295 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:10.534966 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 125448us
W20260709 12:24:10.539001 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51999.6us
I20260709 12:24:10.540155 17300 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.533771 15835 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:10.541066 17295 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.465337 17278 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.458262 17302 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.463194 17280 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.488142 17279 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.486258 17290 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.486608 17303 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.549539 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.552652 17107 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.536341 17217 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.520073 17281 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.464977 17293 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.536623 17190 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.540917 17300 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.496536 17307 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.485829 17276 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.612855 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.603605 15911 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:10.611894 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.609369 15730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 272) took 1969 ms. Trace:
I20260709 12:24:10.601866 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.621534 15730 rpcz_store.cc:276] 0709 12:24:08.632364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.632851 (+   487us) service_pool.cc:224] Handling call
0709 12:24:10.601876 (+1969025us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1399825,"reported_tablets":1}
I20260709 12:24:10.592639 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.495450 17269 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:10.580893 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.572891 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.623277 15908 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:10.629248 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.630666 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.632086 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.633050 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.622516 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.634140 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.593058 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.637689 17267 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.637852 17312 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:10.638540 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08000d54e0 after lost signal to thread 15783
I20260709 12:24:10.639791 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.635581 15912 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:10.611459 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.645871 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.646428 15909 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:10.646611 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.611711 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.612506 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.573202 17299 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.647428 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.612735 17272 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.610004 17286 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.571698 17231 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.661300 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.661458 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.662465 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.662539 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.663681 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.572192 17281 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.611212 17283 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.574471 17280 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:10.594048 17279 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.574348 17304 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.673085 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.601099 15848 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:24:10.638487 17312 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.660620 17302 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.613762 17190 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.663681 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.690150 15835 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.665653 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.613499 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.666297 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.669646 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.670821 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.671845 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.647938 15904 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:10.673660 17299 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.678349 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.673717 15987 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:10.677176 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.677230 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.677815 17314 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.677910 17269 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.698606 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.664721 15979 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.701649 17190 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.701771 15980 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:10.702279 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.702759 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.702878 15979 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:10.703794 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.672891 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.679235 16496 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:10.599062 17290 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.674458 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:10.672952 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.672930 17293 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.673882 17281 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.695343 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.712459 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.699379 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.695309 15910 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:10.699630 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.700817 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.700874 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:10.690943 15859 debug-util.cc:398] Leaking SignalData structure 0x7b0800331d60 after lost signal to thread 15862
I20260709 12:24:10.703866 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.707573 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.709183 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.709770 17299 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:10.710657 17312 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.695672 15848 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-3a4fafd7ec404ad9b05209ed0c8c1a19
I20260709 12:24:10.742957 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.730686 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.752888 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.757746 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:10.698364 15833 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.767469 15835 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.718346 17117 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.768759 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.693712 17304 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.751277 17303 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.785265 17312 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:10.812945 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.773404 15911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:24:10.761368 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:10.719309 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08002f18c0 after lost signal to thread 15863
I20260709 12:24:10.862183 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.815809 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.789939 17307 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.795913 17300 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.864931 15911 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.804924 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.865581 15911 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.866020 17304 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:10.862381 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8340 after lost signal to thread 15937
I20260709 12:24:10.866403 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.859395 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.790076 17322 ts_tablet_manager.cc:933] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:10.858852 17268 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.786768 17267 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.850004 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.719976 17275 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.867611 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.868157 15952 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:10.735224 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.864380 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.789348 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.798543 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.798106 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.859404 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:10.778625 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.799810 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.810411 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.813936 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.877336 17267 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:10.850520 17278 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.717219 17314 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:10.785280 15836 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.753098 17281 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.817518 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.860410 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:10.769654 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.815590 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.903095 15908 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:10.885495 17310 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.804975 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.787348 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.853943 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.794116 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.923771 15830 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:10.900933 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.815114 17312 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.902108 15835 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:10.928126 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.928723 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.929725 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.930691 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.930856 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.901929 17314 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:10.885991 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.904343 17305 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.901616 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.904554 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.905193 17304 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:10.950232 15836 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.950492 17304 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.927465 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.951026 17304 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:10.951098 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.946255 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:10.904934 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45605us
I20260709 12:24:10.953406 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:10.908980 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.954412 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:10.905897 17303 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:10.906046 17298 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.906563 17316 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:10.716315 17190 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.922709 15907 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:10.925086 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.926299 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.963362 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.926595 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.927202 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:10.927693 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.878955 17315 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:10.928231 17312 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.904551 17323 ts_tablet_manager.cc:933] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.944568 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.945771 17314 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.945815 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.920251 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.947551 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.973943 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.974480 15835 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:10.947820 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.750946 17276 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:10.802485 15879 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:10.803761 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:10.955624 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95376.2us
I20260709 12:24:10.959997 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:10.960724 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.961117 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:10.976743 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:10.961691 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.957011 15911 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.963907 15988 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:10.968415 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.970705 15833 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:10.978197 15830 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:10.979035 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.962601 17275 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.965029 17307 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.987396 15911 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:10.932559 17310 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:10.982096 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:10.983318 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 180884us
I20260709 12:24:10.983659 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.981348 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:10.998029 15835 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:10.995872 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:10.987776 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 119711us
I20260709 12:24:10.965538 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.001988 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.002110 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.003494 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.004522 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.005053 17313 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.005503 17313 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.005884 17313 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.966954 17298 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:10.971490 17281 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.007315 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:10.986433 17267 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.011798 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.013319 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:10.983246 17231 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.016547 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.987182 17275 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:11.021180 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:10.987098 17307 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:11.031071 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51677.5us
I20260709 12:24:11.031126 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.031019 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.015491 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.009310 17269 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.032451 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.011401 17285 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:10.970999 17190 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.019665 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:10.967268 17305 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.090628 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.030133 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.122779 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.098366 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.208441 15908 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:10.984017 17316 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.083717 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.111804 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.112643 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.035450 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.081290 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.098203 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.208681 15910 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:11.010954 17281 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.038386 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.038961 15879 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:11.235549 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 196660us
W20260709 12:24:11.235782 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 203933us
I20260709 12:24:11.053373 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.228404 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:11.235550 15906 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:11.123080 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.033408 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.237366 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.091228 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:11.238915 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 205534us
I20260709 12:24:11.212512 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:11.237742 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:11.098481 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.242717 15829 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:11.058110 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.243098 15829 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:11.239877 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:11.056099 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.007009 17315 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.034575 17307 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.238186 15879 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.053582 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.020234 17231 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.245990 17294 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.246075 17302 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.247733 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.215708 17285 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.244098 17317 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.252104 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.245222 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:11.011857 17298 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.282904 17298 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.283401 17299 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.283773 17299 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.284144 17299 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.285786 17190 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:11.253441 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 280510us
I20260709 12:24:11.287984 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.288661 17264 tablet_copy_client.cc:538] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:11.179545 15833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60558
I20260709 12:24:11.270196 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:11.180552 17312 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.114259 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.113188 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.208178 17275 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.265970 17231 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.128988 17322 tablet_copy_client.cc:323] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:24:11.054085 17290 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.122169 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.261234 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.236462 17281 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.098068 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.053568 17319 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.177997 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.236490 17321 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.265281 15836 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:11.123409 17310 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.241127 17232 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.266788 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.267175 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.265290 15829 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.269716 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.103636 15953 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.271149 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.271621 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.271179 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.278633 17315 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.280541 17304 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.210383 17269 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.263320 17276 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.269172 17317 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.319826 17232 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.334399 17232 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.053134 17292 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.240s
I20260709 12:24:11.257825 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.261574 17300 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.293556 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.264252 17294 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.365339 17294 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:11.366559 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73075.1us
I20260709 12:24:11.368494 17270 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.368853 17270 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.369239 17270 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.299085 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.266281 17302 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.300220 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:11.319516 17319 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.295449 15848 tablet_copy_source_session.cc:215] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:11.267755 15904 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:11.379551 17299 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.380630 17315 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.382055 15832 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.382354 17304 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:11.110682 15859 debug-util.cc:398] Leaking SignalData structure 0x7b0800270f60 after lost signal to thread 16012
I20260709 12:24:11.383158 17319 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:11.305636 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 208107us
W20260709 12:24:11.308056 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 52149.6us
I20260709 12:24:11.295990 17280 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.297222 17298 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.321794 17323 tablet_copy_client.cc:323] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
W20260709 12:24:11.323858 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 61910.9us
I20260709 12:24:11.289492 16460 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.301211 15833 raft_consensus.cc:606] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.337191 17269 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.345506 17317 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.337996 17276 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.358599 17283 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.362634 17316 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.398262 17321 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:11.398164 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 108764us
I20260709 12:24:11.399863 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.401253 17117 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.401683 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.402567 17117 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.405923 17266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:11.363570 17313 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:11.370949 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 71939.4us
I20260709 12:24:11.270521 17285 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.400738 17275 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.322695 17290 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.374521 17302 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.374845 17300 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:11.387354 17298 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:11.378461 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 120839us
I20260709 12:24:11.377221 15847 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 9e271b9d1bc8403ba1c9d3e80c36917c from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:24:11.385067 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:11.383700 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0000 after lost signal to thread 16521
I20260709 12:24:11.418078 17312 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:11.418390 15859 debug-util.cc:398] Leaking SignalData structure 0x7b0800388600 after lost signal to thread 17224
W20260709 12:24:11.418690 15859 debug-util.cc:398] Leaking SignalData structure 0x7b080032c160 after lost signal to thread 17225
W20260709 12:24:11.419044 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08003144a0 after lost signal to thread 17245
W20260709 12:24:11.419299 15859 debug-util.cc:398] Leaking SignalData structure 0x7b0800320360 after lost signal to thread 17247
I20260709 12:24:11.397380 17283 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:11.419610 15859 debug-util.cc:398] Leaking SignalData structure 0x7b0800388960 after lost signal to thread 17257
I20260709 12:24:11.419687 17264 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
W20260709 12:24:11.419970 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08003885c0 after lost signal to thread 17258
W20260709 12:24:11.420265 15859 debug-util.cc:398] Leaking SignalData structure 0x7b080034cd60 after lost signal to thread 17259
W20260709 12:24:11.420514 15859 debug-util.cc:398] Leaking SignalData structure 0x7b08003885e0 after lost signal to thread 17261
I20260709 12:24:11.421137 17321 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.421207 15847 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 9e271b9d1bc8403ba1c9d3e80c36917c from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-9e271b9d1bc8403ba1c9d3e80c36917c
I20260709 12:24:11.396978 17276 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.387113 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:11.392056 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.432535 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.414964 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.416146 15829 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:11.387931 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 284364us
I20260709 12:24:11.417728 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:11.429319 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:11.412793 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:11.433789 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.428628 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.434019 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:11.434283 17107 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.434409 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:11.434641 17107 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.435003 17107 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.383896 17307 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.436619 17153 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.437609 15838 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.437511 15802 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.421598 17321 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.382615 17270 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.435941 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.440184 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.444528 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:11.441406 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.441468 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.420588 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet 7cbb40ff3a44403a8705489ecc556e3b from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:24:11.426060 17298 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.419692 17283 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.414321 17290 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.460139 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:11.461189 17308 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.461480 15909 raft_consensus.cc:606] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.446332 17321 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.463129 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet 7cbb40ff3a44403a8705489ecc556e3b from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-7cbb40ff3a44403a8705489ecc556e3b
I20260709 12:24:11.437851 17291 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.439986 17286 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.464570 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:11.465345 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:11.445837 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 58795.6us
I20260709 12:24:11.478242 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.446604 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.465101 17293 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.467921 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.386376 17294 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.463985 17270 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:11.471288 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:11.447831 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:11.435655 17280 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:24:11.487967 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:11.487923 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.470885 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:11.445652 17315 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.459491 17312 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.465838 17190 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.480509 17153 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.466158 15835 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.482600 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.473937 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.485579 17293 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.503582 17117 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.472569 17292 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.488252 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:11.465629 17305 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.489044 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.503389 17299 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:11.473594 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 70301.2us
I20260709 12:24:11.516064 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.516563 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:11.518087 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.518505 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.489487 17330 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.490188 17275 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.533398 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:11.534099 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 100393us
I20260709 12:24:11.475988 17291 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.494005 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.477932 17286 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:11.496652 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 64174.9us
I20260709 12:24:11.484546 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:11.442587 17300 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.502406 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.514611 17117 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:11.546373 17117 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:11.546689 17117 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:11.495771 17328 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.498595 17303 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.530365 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.530834 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.491714 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.505385 17293 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.538136 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.504873 17292 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:11.556984 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.558684 17333 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.559089 17333 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:11.559446 17333 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.560591 17300 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.541141 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.544152 15829 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:11.538812 17291 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.557930 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.558284 15879 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.565366 17332 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.558475 17292 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.551818 17117 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.558517 17329 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.569504 17329 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:11.569867 17329 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.576558 17291 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:11.569766 17117 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.564968 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.586376 17278 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.586756 17278 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.587111 17278 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.588301 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.539160 17286 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.588510 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.539310 17330 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:11.596536 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 160646us
I20260709 12:24:11.598431 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:11.587755 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:11.555574 17328 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:11.605676 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.597117 17312 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.598678 17190 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.598344 17330 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.615883 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.607767 17328 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.603122 17313 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.630640 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.596691 17334 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:11.604795 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74069.6us
W20260709 12:24:11.645887 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 127859us
I20260709 12:24:11.623051 17191 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:11.645862 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 56235.6us
I20260709 12:24:11.650305 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:11.651962 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 204182us
I20260709 12:24:11.629397 16487 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.602473 17292 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.654206 17338 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.654426 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.655176 17313 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.655432 17292 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:11.656507 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:11.653247 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.659364 15905 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:11.654729 17338 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:11.666700 17338 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.668979 15979 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.656030 17292 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.652673 17270 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:11.674710 17292 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.674739 17270 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:11.675200 17292 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.675702 17270 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.676868 17270 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.678514 17276 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.596680 17333 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.687378 15879 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.688874 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.681722 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:11.684635 17292 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.693665 17292 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:11.694511 17292 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:11.694842 17292 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:11.695197 17292 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.679605 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:11.678848 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:11.653510 17334 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.697005 17334 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.616984 17331 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 12:24:11.703151 15981 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:11.686833 17294 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.702567 15904 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:11.751880 17333 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.708844 17285 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.725739 17291 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:11.757689 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 96858us
I20260709 12:24:11.760221 17276 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:11.746944 17313 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.763659 17107 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.751220 15923 tablet_copy_source_session.cc:215] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:11.766469 15911 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:11.724632 17281 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:11.770361 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.722292 17286 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.755967 17294 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.771272 17321 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.773260 17107 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.774905 17336 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 12:24:11.793004 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:11.787009 17314 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.000s
W20260709 12:24:11.814324 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 216518us
I20260709 12:24:11.819504 16486 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:11.842195 17290 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:11.851158 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 316411us
I20260709 12:24:11.851912 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.853709 17117 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:11.853930 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 165114us
I20260709 12:24:11.854420 17117 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.855273 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.813369 17330 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:11.865962 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 99478.2us
I20260709 12:24:11.866384 17117 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:11.866955 15876 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.867722 17291 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:11.868084 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.868566 17313 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.869191 17107 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.869779 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:11.815948 17314 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.851816 17286 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.825307 17269 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.810731 17308 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:11.868088 17291 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:11.887683 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:11.899020 15988 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.897197 17340 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:24:11.900049 17320 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:11.900218 17232 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.001s
I20260709 12:24:11.900591 17320 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.900664 17232 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.902825 17320 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.903146 17232 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.903836 15910 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.905685 17323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbb40ff3a44403a8705489ecc556e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:11.906091 16488 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:11.905499 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:11.918568 17335 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:11.918996 17335 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:11.919888 17335 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.922773 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:11.924181 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:11.925235 17286 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.927794 17232 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:11.925405 15847 tablet_copy_source_session.cc:215] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:11.928853 17286 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:11.929230 17286 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:11.929993 17286 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.939195 17341 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:11.939934 17341 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:11.941320 17313 raft_consensus.cc:993] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:24:11.941766 17313 raft_consensus.cc:1081] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
W20260709 12:24:11.942678 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.942723 17341 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.945894 17321 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:11.892421 17291 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:11.946341 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 78434.4us
I20260709 12:24:11.890838 17294 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.953593 15953 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.956616 17330 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.960489 17292 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:11.957720 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 800) took 1170 ms. Trace:
I20260709 12:24:11.962124 17269 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:11.957540 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:11.970734 17349 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:11.970878 17190 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:11.968817 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:11.891064 17344 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
W20260709 12:24:11.995100 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 122360us
I20260709 12:24:11.964411 17285 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:11.986270 17323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42798 (request call id 366) took 1354 ms. Trace:
I20260709 12:24:11.962136 17307 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:11.947613 17335 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:12.065960 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 58609.7us
W20260709 12:24:11.988981 17231 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.005s
I20260709 12:24:11.975600 17354 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:24:11.988466 17286 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:11.994637 17317 consensus_meta.cc:287] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260709 12:24:11.998239 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.009865 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:11.938117 17293 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:11.987550 15910 rpcz_store.cc:276] 0709 12:24:10.787160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.322637 (+535477us) service_pool.cc:224] Handling call
0709 12:24:11.346430 (+ 23793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.904286 (+557856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.957508 (+ 53222us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400420ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:11.957669 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281513216}
I20260709 12:24:11.999449 17281 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:12.069167 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 202091us
I20260709 12:24:12.069875 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.066947 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:12.040604 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 71891.1us
I20260709 12:24:12.095325 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.095391 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.097018 15953 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.002882 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.098910 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.098685 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:12.102116 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.105059 15953 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.107134 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.108603 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.071523 17276 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.101578 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.118108 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.106547 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:12.104308 17349 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.126067 17294 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:12.135028 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.126451 17345 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.130318 17348 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.131783 17354 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.109786 17344 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.106668 17320 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:12.102135 17328 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.091070 17231 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:12.144137 17298 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.671s	user 0.002s	sys 0.007s
I20260709 12:24:12.142827 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:12.145565 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46734.5us
I20260709 12:24:12.114107 17314 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:12.098554 17317 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.151564 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 707) took 1392 ms. Trace:
I20260709 12:24:12.193463 15988 rpcz_store.cc:276] 0709 12:24:10.759369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.179516 (+420147us) service_pool.cc:224] Handling call
0709 12:24:11.179745 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.907167 (+727422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.151340 (+244173us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400186ad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:12.151488 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653682944}
I20260709 12:24:12.151958 16496 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:12.151484 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52887.8us
I20260709 12:24:12.194795 15950 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.195026 15909 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.195006 17317 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.195873 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.197010 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.197124 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.153539 17293 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:12.154443 17292 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:12.071417 17329 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.119144 17340 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:12.148734 17319 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.765s	user 0.004s	sys 0.006s
I20260709 12:24:12.140822 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.168401 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.170826 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:12.172379 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.172992 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.174667 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.175268 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.175452 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.176410 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.158360 17351 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.142277 17285 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:12.178328 17231 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.162559 17307 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:12.201068 17298 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:12.227692 17302 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.797s	user 0.004s	sys 0.004s
I20260709 12:24:12.228089 17302 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.228840 17298 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.229077 15982 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.229157 15906 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.209941 17344 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.229534 17307 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.205291 17314 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.230258 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.001829 17323 rpcz_store.cc:276] 0709 12:24:10.635241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.663732 (+ 28491us) service_pool.cc:224] Handling call
0709 12:24:10.982947 (+319215us) ts_tablet_manager.cc:934] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
0709 12:24:11.848992 (+866045us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:11.978846 (+129854us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:11.978979 (+   133us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:11.985553 (+  6574us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:11.985801 (+   248us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:11.986141 (+   340us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:11.986203 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":6794,"tablet-copy.queue_time_us":213756,"thread_start_us":407059,"threads_started":2}
I20260709 12:24:12.231382 17323 tablet_copy_client.cc:806] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:12.231473 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.231468 17330 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.232033 17323 tablet_copy_client.cc:670] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:12.232141 17330 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.135447 17294 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:12.233354 17294 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.205124 17337 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:24:12.233472 17330 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.234822 17330 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.213685 17310 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.236295 17310 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.200726 17354 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.237104 17310 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.238214 17310 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.238394 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 374) took 1402 ms. Trace:
I20260709 12:24:12.181433 17322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e271b9d1bc8403ba1c9d3e80c36917c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.182397 17328 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:12.165251 17320 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.243728 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.243760 17319 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.186961 15908 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:12.188740 17278 consensus_meta.cc:287] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 12:24:12.191768 17291 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:12.198876 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56154.3us
I20260709 12:24:12.245577 15907 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:12.246066 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.199745 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.180836 17333 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:12.206298 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.206669 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.248651 15909 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:12.208096 17338 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 12:24:12.209241 17290 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:12.232769 15905 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:12.254247 17338 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.255043 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 811) took 1274 ms. Trace:
I20260709 12:24:12.256084 15913 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:12.252039 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 147065us
I20260709 12:24:12.179811 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.256459 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.257748 15910 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:12.239919 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 71629.4us
I20260709 12:24:12.214361 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.238791 16486 rpcz_store.cc:276] 0709 12:24:10.836130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.866375 (+ 30245us) service_pool.cc:224] Handling call
0709 12:24:10.907116 (+ 40741us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:12.238174 (+1331058us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400494154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:12.238312 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872875136}
I20260709 12:24:12.205933 17348 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.248157 17270 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.249053 17333 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.266959 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.267720 15979 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:12.267247 17333 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.268397 15979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:24:12.245354 17278 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:12.270658 15984 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.271154 17352 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.271852 15981 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:12.225908 17283 consensus_meta.cc:287] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.000s
I20260709 12:24:12.220513 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.258899 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.259514 15912 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:12.242224 17267 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.255473 15907 rpcz_store.cc:276] 0709 12:24:10.980656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.270868 (+290212us) service_pool.cc:224] Handling call
0709 12:24:12.254864 (+983996us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400153bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:12.254993 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116275584}
I20260709 12:24:12.218700 17329 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.239219 17351 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.259526 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.290329 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.291353 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.261356 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.263551 15983 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.263763 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.264322 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.304992 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.305548 15984 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.264227 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.264810 15953 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.265607 15904 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.265875 15905 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.310772 16493 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.287544 17283 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.311429 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.312507 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:12.267571 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61325.6us
I20260709 12:24:12.275326 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1973) took 1483 ms. Trace:
I20260709 12:24:12.231469 17307 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.248708 17285 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.268934 15979 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:12.338543 15979 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.292346 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.299515 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.309382 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.303659 17275 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.341935 15911 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.312556 17283 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.313535 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.276309 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.342900 17285 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.343779 15911 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.345359 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.313982 15913 rpcz_store.cc:276] 0709 12:24:10.791647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.332004 (+540357us) service_pool.cc:224] Handling call
0709 12:24:12.255935 (+923931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.256421 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.275090 (+ 18669us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b5400153bd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:12.275258 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124276480}
I20260709 12:24:12.348521 15913 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.315918 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.321584 17278 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.330397 17320 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:12.331125 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 66386.9us
I20260709 12:24:12.331486 17290 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.332710 17337 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:12.333268 15912 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.285012 17280 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.316628 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:12.318703 17326 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:12.309927 17191 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.338964 17291 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.351981 17345 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.352344 17352 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.353958 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.354583 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.355221 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.355846 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.356925 17323 tablet_copy_client.cc:538] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:12.355846 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.358861 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.362809 17294 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.367645 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.368947 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.391295 17351 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.372707 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:12.376972 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.392035 17319 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.400876 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.402377 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.403909 17338 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.403997 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.404560 17338 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.406229 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:12.376848 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.377758 16489 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.379213 15953 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:12.377274 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 84983.2us
I20260709 12:24:12.383487 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.385855 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.386617 17304 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:12.387580 17266 consensus_meta.cc:287] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:24:12.379761 17308 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.335626 17314 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:12.422137 17350 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.407860 17357 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.410831 17333 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.405165 17332 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.411073 16488 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:12.413141 17319 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.427613 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.420655 17191 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:12.421489 17266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34602 (request call id 266) took 3661 ms. Trace:
I20260709 12:24:12.531307 15837 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:12.530398 17266 rpcz_store.cc:276] 0709 12:24:08.759845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.760017 (+   172us) service_pool.cc:224] Handling call
0709 12:24:10.156762 (+1396745us) ts_tablet_manager.cc:934] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
0709 12:24:11.391381 (+1234619us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:11.807436 (+416055us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:11.811279 (+  3843us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:12.420749 (+609470us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:12.421025 (+   276us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:12.421361 (+   336us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:12.421416 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39432,"tablet-copy.queue_time_us":697274,"thread_start_us":1646088,"threads_started":2}
I20260709 12:24:12.531803 17191 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.532239 17266 tablet_copy_client.cc:806] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:12.532263 17191 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.532831 17266 tablet_copy_client.cc:670] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:12.533337 17191 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:12.423230 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 44096.3us
I20260709 12:24:12.393043 17326 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:12.534690 17326 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.534893 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.535459 17294 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.536073 15953 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.537201 17328 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.537842 17328 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.538971 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.540601 17328 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.541905 17326 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:12.422784 17264 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:12.542764 16489 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:12.543543 17264 tablet_bootstrap.cc:492] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:12.544257 17264 ts_tablet_manager.cc:1403] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 1.125s	user 0.023s	sys 0.016s
I20260709 12:24:12.544207 17326 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.545351 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.485499 15905 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.423858 17337 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.488962 17302 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:12.418522 17358 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:24:12.548029 17337 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.548362 17337 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.549172 17337 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.550313 17337 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.550596 17308 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:12.551658 17307 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.552016 17307 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.552130 17264 raft_consensus.cc:359] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:12.552946 17264 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:12.385253 17269 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:24:12.552822 17307 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:12.553876 17269 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.554252 17269 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.553629 17264 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:12.555961 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.419723 17304 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.557621 17304 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.558621 17304 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.422679 17314 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:12.502713 15906 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.561362 17314 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:12.562290 17314 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.564810 17347 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:12.567873 17314 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.571153 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:12.485498 17334 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.001s
I20260709 12:24:12.506645 15988 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.506873 17323 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:12.573359 17334 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.490269 15979 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.574350 15910 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.575353 17307 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.576460 15979 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.577452 17334 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:12.485989 17351 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.578110 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.578485 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:12.578650 15910 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.579025 15910 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.579654 15910 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.580684 15910 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.490664 17344 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.581180 17344 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.582032 17344 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.583264 17344 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.509548 15985 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:12.514881 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:12.516000 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:12.588794 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.589401 16494 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.517074 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.517338 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:12.517135 17329 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:12.518184 15987 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:12.487613 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.521590 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:12.522804 15907 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.523890 15912 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.525168 15909 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.525995 17275 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:12.528609 17267 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:12.371124 17331 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:12.425310 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.591984 17310 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:24:12.556203 17191 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.595757 17331 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.596138 17331 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:12.556672 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.586616 15879 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.587926 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.590226 17354 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:12.595404 17329 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:12.485458 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 58171.1us
I20260709 12:24:12.555114 17269 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.599138 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:12.599583 15983 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.599174 15953 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.617029 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.618187 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.601229 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.603039 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.606184 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.619957 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.620152 15910 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:12.620987 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.623824 15984 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.626704 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.628316 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.632153 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.611804 17330 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.633975 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.634768 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.603389 17331 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.610760 17350 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.638898 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.614830 17334 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.640723 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:12.651849 17349 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:12.652287 17349 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.641916 17359 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:12.627867 17357 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.610881 17329 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.616730 17302 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:12.646390 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 53396.2us
I20260709 12:24:12.666308 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.650501 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.627890 17281 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.593286 17308 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:24:12.627583 17232 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.627529 17354 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.627676 17312 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.669884 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.633601 17356 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.634080 17320 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.633853 17290 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.634693 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:12.674851 17334 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.644383 17231 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:12.677416 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 252160us
I20260709 12:24:12.720925 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.654796 17347 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:12.645244 17286 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:12.663797 17319 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.693356 17264 ts_tablet_manager.cc:1434] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.002s
I20260709 12:24:12.694118 17359 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.703608 15879 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.665964 17302 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.653851 17280 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:24:12.722038 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 55805us
I20260709 12:24:12.702756 15979 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.708539 17317 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.731120 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:12.727103 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.727227 17191 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.734465 17191 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.735257 17191 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.736145 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:34602 (request call id 267) took 2188 ms. Trace:
I20260709 12:24:12.736366 17191 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.737562 15909 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.739013 17345 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:12.653172 17349 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.741786 17291 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.742149 17291 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.742982 17291 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.726989 17366 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.728628 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:12.731848 17329 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.732143 17308 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:12.745333 15982 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.749342 17312 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.757272 17312 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:12.746364 17303 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:12.758267 17303 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.758064 17312 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.759260 17303 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.759768 17312 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.746570 17319 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:24:12.749917 17302 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.762570 17302 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.751842 17232 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:12.763252 17232 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.754530 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-21e8af32d711469181861fb4a98feec9 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:24:12.764089 17232 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.764671 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-21e8af32d711469181861fb4a98feec9 on tablet 21e8af32d711469181861fb4a98feec9 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:12.754878 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:12.765584 17319 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.765795 17331 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.765944 17319 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.744868 16489 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.766826 17319 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.768317 17319 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.733215 17365 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.727780 17359 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:12.782644 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.756318 16494 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:12.778868 17364 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.781337 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:12.782500 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 55464.7us
I20260709 12:24:12.782543 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:12.785712 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.731771 15907 raft_consensus.cc:606] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.744096 17291 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.787545 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.786916 17370 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.788559 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.731981 17310 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:12.790318 17326 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:12.790294 17308 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.751688 17329 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.785652 17335 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.792143 17307 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.787376 17300 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:24:12.804101 17300 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:12.804448 17300 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.790684 17364 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.802933 17269 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.793630 17310 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.811196 17300 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.792322 17359 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.788559 17334 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:24:12.794900 17326 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.840500 17307 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.841358 17326 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.823406 15985 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:12.851822 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.736541 17322 rpcz_store.cc:276] 0709 12:24:10.548106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.548288 (+   182us) service_pool.cc:224] Handling call
0709 12:24:10.868353 (+320065us) ts_tablet_manager.cc:934] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
0709 12:24:12.073556 (+1205203us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:12.504232 (+430676us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:12.504344 (+   112us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:12.735463 (+231119us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:12.735744 (+   281us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:12.736036 (+   292us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:12.736095 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":87328,"spinlock_wait_cycles":2432,"tablet-copy.queue_time_us":168111,"thread_start_us":181891,"threads_started":2}
W20260709 12:24:12.833353 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.839421 15836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:60558
I20260709 12:24:12.854961 15836 raft_consensus.cc:606] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.800845 17267 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:12.857420 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68927.6us
I20260709 12:24:12.842372 17370 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.862601 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.859110 17322 tablet_copy_client.cc:806] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:12.858863 17326 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.883428 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.865442 17300 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.853360 17275 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:24:12.877704 17308 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.904084 16490 raft_consensus.cc:1217] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:12.884312 17364 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:12.897431 15979 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:12.908630 17332 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:12.909901 17332 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.910486 17332 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:12.910926 17332 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:12.893466 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.879928 17267 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.877889 17359 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:12.912226 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.919914 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 56453.8us
I20260709 12:24:12.921314 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.922865 15979 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.928499 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.930418 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.934033 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.934572 17267 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.918720 17322 tablet_copy_client.cc:670] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:12.938603 17374 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:12.939585 17191 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:12.939942 17191 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:12.940156 17370 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.940721 17191 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.942119 17191 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.940979 17356 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:12.946636 17364 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.915139 16488 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:12.949191 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.912968 17332 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:12.950549 17368 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:12.959357 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 96110.5us
I20260709 12:24:12.935443 17367 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:12.970414 15980 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:12.976118 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:12.970629 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.973803 15879 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:12.935652 17373 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:12.978434 15981 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:12.984143 15829 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:12.986490 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:12.989372 15838 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:12.975018 17368 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:12.991206 17343 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:12.989864 17365 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:12.993460 17338 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.993878 17338 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:12.994462 17310 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.994750 17338 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:12.995700 17310 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:12.996138 17338 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.000919 17365 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.001358 17365 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:13.002213 17365 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:13.003641 17365 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.009884 17191 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:13.010381 15837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60558
I20260709 12:24:13.010929 15837 raft_consensus.cc:606] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.011229 15837 raft_consensus.cc:614] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:13.011771 17191 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:13.012168 17191 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:13.012585 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:13.012982 17191 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.017488 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.018116 17191 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.981940 17319 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.020258 17367 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:13.014212 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:13.023589 17367 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.024237 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.025545 17367 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.026410 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.036233 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.037494 17300 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.016348 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.041863 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.020510 17366 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:13.042668 17366 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.044896 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.046384 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.021333 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.021782 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.044744 17366 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.015386 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.048640 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.048897 15837 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.048208 15831 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:13.050454 15835 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:13.016094 17320 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.051503 17320 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.013495 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:13.047930 17275 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.058669 17275 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:13.059329 15832 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:13.021512 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:12.988464 17308 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.071794 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:13.073521 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:13.074416 15985 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:13.075099 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 53716.9us
I20260709 12:24:13.059559 17275 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.060537 15837 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:13.082180 15830 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:13.062197 15836 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:13.020612 17319 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:13.065068 17266 tablet_copy_client.cc:538] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:13.045413 15730 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.068006 17366 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:13.088515 17366 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.077838 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.089411 15832 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:13.061612 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:13.090423 16490 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:13.090559 17366 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.083178 15834 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:13.086412 15979 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:13.086279 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:13.095710 15982 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:13.086956 15833 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:13.069094 17320 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:13.095033 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.097612 17320 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:13.097971 17320 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.098294 17320 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.100628 17317 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.101142 17317 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:13.102056 17317 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.106269 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:13.111857 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.082095 17350 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:13.125346 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:13.109241 17322 tablet_copy_client.cc:538] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:13.114557 17366 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:13.110321 17364 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:24:13.126477 17331 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.126629 17320 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.127133 17319 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.161801 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:13.162848 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:13.163862 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:13.166256 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:13.166954 15910 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:13.172346 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:13.173405 17349 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:13.174269 17269 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.174952 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:13.188500 15908 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:13.175541 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:13.128746 17350 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:13.189833 17350 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.136164 17366 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:13.191164 17366 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.193938 17267 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.163348 17331 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.163467 15979 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:13.183612 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:13.185182 17359 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.200217 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:13.201241 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.202045 15834 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:13.204463 17267 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:13.204877 17267 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:13.205271 17267 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.210390 17350 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.213297 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.214381 17320 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:13.214499 17269 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:13.215396 17349 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.215739 17349 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:13.218108 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45831.2us
I20260709 12:24:13.219756 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:13.218374 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.219758 15731 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 5, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.222302 15834 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:13.225777 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.196907 17331 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.226341 15836 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.227363 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.228766 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.229802 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:13.222731 17364 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.223815 17308 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.225894 17320 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.216495 17349 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:13.238271 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.231140 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:13.231652 17343 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.246282 15836 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:13.247918 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.241330 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.239516 17320 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.246961 17323 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:13.241842 17344 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.252983 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.245651 17292 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.250631 15979 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:13.260425 17275 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.260967 17323 tablet_bootstrap.cc:492] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:13.261726 17323 ts_tablet_manager.cc:1403] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.755s	user 0.018s	sys 0.033s
I20260709 12:24:13.259207 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.261548 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:13.264407 16489 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:13.264715 16490 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:13.254895 17337 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.265362 17328 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.265998 15909 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:13.255393 17312 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.255923 17320 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.252701 17343 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:13.281203 17328 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:13.293550 17343 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.273773 17331 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.263708 17350 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:13.310832 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.276921 17337 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:13.286597 17312 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:13.309803 17334 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.310284 17329 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.285748 17302 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:13.322520 17338 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:13.313484 17331 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.335902 17266 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:13.344893 17337 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.326459 17344 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:13.334491 17329 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:13.321272 17292 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:13.360518 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 101387us
I20260709 12:24:13.361358 15950 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.362248 17269 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.362985 17269 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:13.326890 17334 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.364246 17269 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:13.338464 17338 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.381340 17308 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.384392 17331 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.386577 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.387445 15829 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:13.390363 17334 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.392218 17267 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.345449 17328 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.394654 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.395531 17314 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:13.395977 17314 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.396363 17314 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.400584 17329 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.374315 17366 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.407485 17338 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:13.410955 15836 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.414232 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:13.414798 15985 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:13.417605 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.418171 15834 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:13.417198 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:13.419178 15907 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:13.425841 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.426595 15829 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:13.432250 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:13.433256 16494 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:13.358589 17312 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.407527 17366 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.431455 15979 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.440770 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:13.441635 15907 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:13.375893 17323 raft_consensus.cc:359] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:13.438196 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:13.439728 17352 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.446302 17323 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:13.463393 17267 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.474442 17322 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:24:13.441381 17344 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.451924 17292 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.504999 15981 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.506135 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:13.507555 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.509483 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:13.510042 17232 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:13.510555 17232 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:13.511034 17232 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.511566 17334 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:13.511981 17334 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.512295 17334 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.515372 15833 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:13.517473 17338 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:13.519385 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:13.483080 17323 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:13.522063 17286 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:13.522563 17286 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:13.523252 17323 ts_tablet_manager.cc:1434] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.261s	user 0.009s	sys 0.000s
I20260709 12:24:13.529057 15983 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:13.523595 17286 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.531102 15981 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:13.537134 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 98090.3us
I20260709 12:24:13.494067 17320 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:13.551616 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 104509us
I20260709 12:24:13.555143 16489 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:13.556640 17364 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:13.563619 15983 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:13.577201 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7cbb40ff3a44403a8705489ecc556e3b received from {username='slave'} at 127.0.0.1:41588
I20260709 12:24:13.585477 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-7cbb40ff3a44403a8705489ecc556e3b on tablet 7cbb40ff3a44403a8705489ecc556e3b with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:13.592953 15980 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:13.615286 17349 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.632177 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.637643 17191 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.638299 17191 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:13.634696 17269 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:13.639362 17320 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:13.610661 17393 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:24:13.651938 17191 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.656425 17398 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.655392 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.659897 15833 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.659770 17398 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.663277 17232 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.646030 17317 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:24:13.670421 17232 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:13.671111 17394 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.240s	user 0.000s	sys 0.003s
I20260709 12:24:13.673228 17398 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:13.674273 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:13.674852 15912 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:13.676038 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:13.670694 17314 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.679597 17314 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.686718 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:13.687347 15980 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.688596 15833 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:13.642514 17338 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:24:13.696023 17312 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:13.696487 17312 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.697337 17337 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.697844 17337 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.700340 17298 raft_consensus.cc:993] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:24:13.700445 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.700814 17298 raft_consensus.cc:1081] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:24:13.702423 17337 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:13.696832 17312 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.703472 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:13.705060 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:13.706063 17337 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.655573 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:13.720242 15979 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:24:13.719142 17402 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:24:13.725198 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.726506 17267 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:13.727286 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.727782 17267 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.728243 17267 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:13.729883 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.730731 15979 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:13.730916 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.731451 15829 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.733246 17343 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.733568 15830 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:13.718763 17334 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.735006 17286 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.736471 17334 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.737958 15982 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:24:13.738523 15982 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.738909 15982 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.743115 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.724843 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.745102 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:13.745883 16494 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:13.746738 16496 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:13.753945 16493 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:13.757825 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:13.763577 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.764124 15836 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.766909 15829 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:13.769589 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:13.770521 17405 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.755705 17335 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.756276 17334 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.712891 17312 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.763059 15980 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:13.785737 17335 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:13.785393 15733 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 2 to 4, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:13.786593 17335 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.803606 15836 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:13.804951 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:13.773689 17405 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:13.754560 17267 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.815387 17319 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.816143 17319 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:13.817409 17319 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.828356 15982 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.791836 17298 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:13.834295 17312 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:13.836894 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:13.841751 15909 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.841977 15836 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:13.809827 17334 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:13.851418 15982 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:13.852059 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.852627 15829 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.858345 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:13.842828 17398 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.875787 17405 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.873629 15829 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:13.879519 15950 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:13.888270 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:13.897186 17421 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:13.873418 17344 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:24:13.887153 17337 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.875656 17398 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.914019 17398 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:13.897651 17421 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.916397 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:13.917233 16488 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:13.930449 16494 raft_consensus.cc:1217] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:13.934376 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:13.939788 15829 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:13.915659 17337 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:13.935189 15836 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:13.956601 17337 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:13.958806 16457 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:13.959980 17398 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:13.960361 17398 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.960695 17398 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.962742 15836 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:13.969352 15912 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:13.909230 17334 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:13.979765 15910 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:13.950779 17269 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:13.982057 15909 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:13.983276 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:13.974326 17415 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.125s	user 0.005s	sys 0.000s
I20260709 12:24:13.972584 17312 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:24:13.987844 17335 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:13.993731 15830 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:13.994611 17421 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:13.997913 17266 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:13.986460 17391 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:24:13.991351 17286 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:14.021620 15912 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:24:14.036641 17419 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:24:14.031589 17421 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.038277 17421 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.018321 17335 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:14.029470 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.043464 17266 tablet_bootstrap.cc:492] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:14.044512 17335 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.042986 17267 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:14.044571 17266 ts_tablet_manager.cc:1403] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.722s	user 0.024s	sys 0.010s
I20260709 12:24:14.033269 17286 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.077498 17433 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:14.085265 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 95532.1us
I20260709 12:24:14.088860 15834 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:14.093456 17405 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.093937 17405 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.096251 17405 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.052521 17267 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.073781 17350 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:14.106422 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.107347 15910 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:14.105862 17286 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.105623 17391 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:24:14.118695 17344 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.119333 17344 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.120337 15834 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:14.123206 17429 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:14.123090 17266 raft_consensus.cc:359] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:14.123952 17266 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:14.126186 17332 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.126650 17332 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.128634 17332 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.129400 17405 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:14.130059 17405 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.131471 17328 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:14.132829 17405 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.133641 17267 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.107993 17350 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.136233 15836 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:14.116720 17421 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.145098 17344 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.124751 17266 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:14.154122 17269 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:14.155303 17344 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:14.155706 17344 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:14.156543 17344 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.159265 17350 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.171919 17398 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.156536 17266 ts_tablet_manager.cc:1434] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 12:24:14.174593 17398 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:14.176134 17344 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:14.179543 17322 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:14.180404 17322 tablet_bootstrap.cc:492] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:24:14.181664 17322 ts_tablet_manager.cc:1403] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.707s	user 0.016s	sys 0.026s
I20260709 12:24:14.193054 17269 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.193708 17269 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.197957 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:14.198755 15832 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:14.199952 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.204460 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.204746 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.208998 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.209432 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.209700 15981 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:14.211222 15986 raft_consensus.cc:2393] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:14.192243 17388 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.196291 17269 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:14.215183 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.227777 17328 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:14.228286 17328 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.228824 17328 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.228145 15986 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:14.227754 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.231390 17418 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:14.231917 17418 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.232333 17418 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.216372 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.240275 15981 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 2: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:14.241526 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:14.241605 16460 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.242261 16489 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:14.242725 17335 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:14.242659 17328 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.243260 17335 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.243716 17335 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:14.244724 17328 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:14.247438 15909 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:14.249284 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:14.249789 15832 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.253528 17335 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.255826 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.256578 17436 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:14.256948 17436 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.257280 17436 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.261315 15832 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:14.260671 17418 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.265023 17388 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.266578 17405 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.267136 17388 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:14.267047 17405 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.270704 17319 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:14.271123 17405 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:14.274183 17334 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.274626 17334 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.276630 17334 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.276875 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.277254 15847 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-3a4fafd7ec404ad9b05209ed0c8c1a19 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:24:14.277704 15847 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-3a4fafd7ec404ad9b05209ed0c8c1a19 on tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:14.277626 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.278064 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:14.278550 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.278767 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.280491 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:14.281831 15982 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.282912 17366 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:14.283403 17366 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.283740 15730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 273) took 1442 ms. Trace:
I20260709 12:24:14.281787 17431 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:14.286000 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.285567 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:14.277467 15910 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:14.279124 15906 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:14.294894 15829 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.295576 15912 raft_consensus.cc:2368] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:14.295935 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:14.298338 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:14.298965 16494 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:14.294555 17275 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.301436 15833 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:14.301512 17275 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:14.302524 17366 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.303032 17431 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:14.303540 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:14.303696 17275 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.304153 15982 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:14.303890 17431 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.284111 15730 rpcz_store.cc:276] 0709 12:24:12.841481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.841670 (+   189us) service_pool.cc:224] Handling call
0709 12:24:14.283683 (+1442013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:13.273551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:13.287947 (+ 14396us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:13.287978 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:24:13.287997 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:13.309363 (+ 21366us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:13.311197 (+  1834us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:13.316136 (+  4939us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:13.325430 (+  9294us) tablet.cc:701] Row locks acquired
0709 12:24:13.326606 (+  1176us) write_op.cc:260] PREPARE: finished
0709 12:24:13.337191 (+ 10585us) write_op.cc:270] Start()
0709 12:24:13.345845 (+  8654us) write_op.cc:276] Timestamp: P: 1783599853337155 usec, L: 0
0709 12:24:13.346813 (+   968us) op_driver.cc:348] REPLICATION: starting
0709 12:24:13.394309 (+ 47496us) log.cc:844] Serialized 538 byte log entry
0709 12:24:13.717790 (+323481us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b540017c854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc29ee28 00007f03cfcd9581 00007f03cfcd8d58 00007f03cfcdd9f1 00007f03cfcdd9a9 00007f03cfcdd939 00007f03cfcdd901 00007f03cfcdcb2d 0000000000388634 0000000000388479
0709 12:24:13.884208 (+166418us) op_driver.cc:464] REPLICATION: finished
0709 12:24:13.971015 (+ 86807us) write_op.cc:301] APPLY: starting
0709 12:24:13.971101 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:13.971202 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:13.971222 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:13.971489 (+   267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:13.971642 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:13.971726 (+    84us) write_op.cc:312] APPLY: finished
0709 12:24:13.971893 (+   167us) log.cc:844] Serialized 23 byte log entry
0709 12:24:13.972026 (+   133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.972086 (+    60us) write_op.cc:454] Released schema lock
0709 12:24:13.972118 (+    32us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:13.972440 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.972466 (+    26us) write_op.cc:454] Released schema lock
0709 12:24:14.086280 (+113814us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:14.087642 (+  1362us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":99917,"reported_tablets":6,"spinlock_wait_cycles":289536,"child_traces":[["op",{"apply.queue_time_us":83552,"apply.run_cpu_time_us":1412,"apply.run_wall_time_us":1420,"num_ops":1,"prepare.queue_time_us":163595,"prepare.run_cpu_time_us":29249,"prepare.run_wall_time_us":458871,"raft.queue_time_us":291132,"raft.run_cpu_time_us":12252,"raft.run_wall_time_us":229207,"replication_time_us":517848,"spinlock_wait_cycles":3203840,"thread_start_us":399380,"threads_started":4,"wal-append.queue_time_us":183421}]]}
I20260709 12:24:14.309890 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:14.310662 16486 raft_consensus.cc:2368] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4.
I20260709 12:24:14.311852 17286 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:14.313550 17335 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.313009 15982 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:14.316249 16460 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.315585 17322 raft_consensus.cc:359] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:14.319002 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.328423 15910 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:14.329622 15906 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:14.329996 15906 pending_rounds.cc:85] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:24:14.327929 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:14.330482 15912 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:14.296002 17398 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.294729 17334 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.333731 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:14.334579 15832 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:14.334781 15879 leader_election.cc:400] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4.
I20260709 12:24:14.297200 17232 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.330240 15906 pending_rounds.cc:107] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:14.338110 15906 raft_consensus.cc:2889] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:14.339357 15829 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:14.336227 15879 leader_election.cc:403] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:14.317344 17405 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:14.317073 17335 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:14.353333 15908 raft_consensus.cc:2368] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3.
I20260709 12:24:14.346930 15912 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:14.336548 17286 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:14.363545 15953 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:14.350273 17405 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.342188 17322 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:24:14.369179 17421 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.369071 17314 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:14.358398 17298 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4.
I20260709 12:24:14.337549 17334 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.348556 17364 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:14.367871 17399 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:14.350024 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:14.337678 17398 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.383615 17364 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.349149 17232 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.386246 17364 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.386540 17232 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.367496 17431 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:14.387414 17431 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:14.373683 17405 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.376884 17421 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.390242 15982 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:14.388557 17334 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.392447 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.373551 17286 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:24:14.454418 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 89301.6us
W20260709 12:24:14.431334 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 91414.9us
W20260709 12:24:14.454702 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 351692us
I20260709 12:24:14.378050 16486 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:14.499578 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.520464 15985 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:14.500312 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:14.521502 15987 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.500756 15986 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:14.432632 17322 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:14.508682 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.506011 17343 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.512864 17436 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:14.513693 17398 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:14.514206 15909 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:14.522399 15984 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:14.507138 17232 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.589900 17267 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.517937 16457 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:14.593722 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 48841.9us
I20260709 12:24:14.741906 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.742560 15906 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:24:14.743697 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 225035us
I20260709 12:24:14.504355 17344 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:14.748701 17388 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:14.725117 17445 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:24:14.749114 17399 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:24:14.524278 17335 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:14.754832 17421 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.740497 17332 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.757884 17436 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.759235 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:14.760318 15832 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:24:14.775827 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 257181us
I20260709 12:24:14.774698 15829 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:14.722908 17431 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:14.533813 17343 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.769390 17331 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:14.770144 17399 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:14.790608 15731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 277) took 1628 ms. Trace:
I20260709 12:24:14.691748 17364 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:14.716712 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:14.771265 17322 ts_tablet_manager.cc:1434] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.575s	user 0.008s	sys 0.000s
I20260709 12:24:14.760948 17388 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.773715 17286 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:14.773516 17332 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.783471 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.783712 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:14.784014 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:14.786316 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:14.613699 17418 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:14.589447 17366 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:14.637465 17334 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.650751 17338 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.750274 17267 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.763109 17344 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.857585 15832 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:14.791184 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:15.294757 15910 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:14.857966 15907 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:15.295630 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 511952us
I20260709 12:24:15.300071 15830 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:15.296253 15907 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:24:14.973380 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 195361us
I20260709 12:24:14.791088 15912 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.269713 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 167) took 1258 ms. Trace:
I20260709 12:24:14.860213 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:15.329301 15911 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:14.932593 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:14.774514 17451 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.328792 15983 rpcz_store.cc:276] 0709 12:24:13.996432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.996574 (+   142us) service_pool.cc:224] Handling call
0709 12:24:15.253789 (+1257215us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:15.254029 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.254255 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:15.254291 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:15.254342 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:15.254383 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.254453 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.254589 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10282752}
I20260709 12:24:15.340821 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:15.343823 15986 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
W20260709 12:24:15.334542 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 402022us
I20260709 12:24:14.894986 17349 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.122233 17300 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:15.147207 17405 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 12:24:15.323061 15907 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.356588 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:15.363816 15983 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
W20260709 12:24:15.351507 15987 consensus_meta.cc:287] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.000s
I20260709 12:24:14.858065 17452 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.365073 15987 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:15.166069 15979 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:14.773115 17232 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.368059 17232 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.368831 15906 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:15.369524 15988 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:15.297096 17322 ts_tablet_manager.cc:1467] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Tablet startup took 1104ms
I20260709 12:24:15.080808 17337 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:15.275344 17319 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.323997 17449 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:15.372097 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:15.204715 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:15.303303 17286 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:15.275586 17440 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:15.374620 15912 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:14.878073 17269 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.894418 17331 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:15.255141 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:15.348122 17398 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:15.351223 17418 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:15.302983 17366 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.303408 17364 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:14.947184 17450 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.442s
I20260709 12:24:14.912020 17455 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.518s
I20260709 12:24:14.826201 17399 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.337910 17338 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.295552 15731 rpcz_store.cc:276] 0709 12:24:13.162098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.162536 (+   438us) service_pool.cc:224] Handling call
0709 12:24:14.790554 (+1628018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:13.718134 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:13.718689 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:13.718724 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:13.718753 (+    29us) tablet.cc:662] Decoding operations
0709 12:24:13.719134 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:13.719177 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:13.719202 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:13.719391 (+   189us) tablet.cc:701] Row locks acquired
0709 12:24:13.719409 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:13.719528 (+   119us) write_op.cc:270] Start()
0709 12:24:13.719630 (+   102us) write_op.cc:276] Timestamp: P: 1783599853719486 usec, L: 0
0709 12:24:13.719651 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:13.738304 (+ 18653us) log.cc:844] Serialized 533 byte log entry
0709 12:24:13.739750 (+  1446us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b540017c854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc29ee28 00007f03cfcd9581 00007f03cfcd8d58 00007f03cfcdd9f1 00007f03cfcdd9a9 00007f03cfcdd939 00007f03cfcdd901 00007f03cfcdcb2d 0000000000388634 0000000000388479
0709 12:24:13.983075 (+243325us) op_driver.cc:464] REPLICATION: finished
0709 12:24:14.009276 (+ 26201us) write_op.cc:301] APPLY: starting
0709 12:24:14.015346 (+  6070us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:14.025233 (+  9887us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:14.029545 (+  4312us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:14.038076 (+  8531us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:14.038209 (+   133us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:14.038260 (+    51us) write_op.cc:312] APPLY: finished
0709 12:24:14.038434 (+   174us) log.cc:844] Serialized 23 byte log entry
0709 12:24:14.038606 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:14.038677 (+    71us) write_op.cc:454] Released schema lock
0709 12:24:14.038712 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:14.039047 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:14.039079 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":162975,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":4300,"apply.run_cpu_time_us":1572,"apply.run_wall_time_us":37039,"num_ops":1,"prepare.queue_time_us":487989,"prepare.run_cpu_time_us":4008,"prepare.run_wall_time_us":21780,"replication_time_us":255042,"spinlock_wait_cycles":41154304}]]}
I20260709 12:24:15.453640 17398 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.391424 17454 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:15.338311 17334 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.370277 17349 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.219784 17335 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.376554 17300 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.438162 17421 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:15.466843 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 170395us
I20260709 12:24:15.489869 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:15.479079 17453 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:15.453248 16486 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.356992 17451 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.385803 17405 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:15.482384 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 119354us
I20260709 12:24:15.452952 17418 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.490427 17467 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.395716 17337 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.398998 17459 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:24:15.454445 17343 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.403759 17319 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.449452 15833 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:15.451053 17269 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:15.443157 17286 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.464593 17462 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:15.398872 17452 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.543480 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 183) took 1249 ms. Trace:
I20260709 12:24:15.486100 17398 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.424327 17449 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.511622 15908 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:15.512136 15985 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:15.500403 17451 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.513123 17331 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.516395 15830 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:15.443310 17440 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:15.572227 17465 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:24:15.574465 17300 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.517722 16486 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:15.510111 17467 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.540977 15981 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:15.507825 17464 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.512825 17468 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:15.509534 17418 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.543862 15837 rpcz_store.cc:276] 0709 12:24:14.287260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.287367 (+   107us) service_pool.cc:224] Handling call
0709 12:24:14.287715 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.296900 (+  9185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.296934 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.297371 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.265767 (+968396us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18002d3640. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:24:15.358754 (+ 92987us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:15.358826 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.358936 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.519818 (+160882us) raft_consensus.cc:1685] finished
0709 12:24:15.519837 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.536319 (+ 16482us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11557,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10873,"spinlock_wait_cycles":25591552,"thread_start_us":92750,"threads_started":1,"wal-append.queue_time_us":1202902}
I20260709 12:24:15.512099 17469 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.506021 17421 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.510838 17457 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:15.522498 17458 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:15.567714 17269 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.567876 17366 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.568471 17452 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.568982 17349 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.570024 17286 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:15.569962 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1292) took 1242 ms. Trace:
I20260709 12:24:15.544258 17459 consensus_queue.cc:1243] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:15.615412 17451 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:15.626600 17451 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.570799 17461 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:15.538865 17473 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:15.580039 17463 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:24:15.541150 17476 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:15.571190 17479 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.635007 17476 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.617631 15980 rpcz_store.cc:276] 0709 12:24:14.327136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.328318 (+  1182us) service_pool.cc:224] Handling call
0709 12:24:14.352751 (+ 24433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.376241 (+ 23490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.378220 (+  1979us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.390859 (+ 12639us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.084828 (+693969us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:15.132683 (+ 47855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.187352 (+ 54669us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:15.569669 (+382317us) raft_consensus.cc:1685] finished
0709 12:24:15.569706 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.569890 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7764,"raft.queue_time_us":1089,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":2861,"spinlock_wait_cycles":154368,"thread_start_us":486318,"threads_started":1,"wal-append.queue_time_us":1098042}
I20260709 12:24:15.635589 17479 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.637403 17476 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.615378 17319 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.639688 17440 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:15.385093 17322 ts_tablet_manager.cc:1469] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Trace:
0709 12:24:10.548106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.548288 (+   182us) service_pool.cc:224] Handling call
0709 12:24:10.868353 (+320065us) ts_tablet_manager.cc:934] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
0709 12:24:12.073556 (+1205203us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:12.504232 (+430676us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:12.504344 (+   112us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:12.735463 (+231119us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:12.735744 (+   281us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:12.736036 (+   292us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:12.736095 (+    59us) inbound_call.cc:177] Queueing success response
0709 12:24:13.474063 (+737968us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:14.200025 (+725962us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:14.313434 (+113409us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:14.313991 (+   557us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":87328,"mutex_wait_us":1267,"raft.queue_time_us":46823,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":2432,"tablet-copy.queue_time_us":168111,"tablet-download-pool.queue_time_us":16220,"tablet-download-pool.run_cpu_time_us":1104,"tablet-download-pool.run_wall_time_us":133011,"thread_start_us":181891,"threads_started":2}
I20260709 12:24:15.489940 17454 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.642351 17467 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.643026 17467 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.643563 17467 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.644397 17454 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.592600 17468 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:15.592799 17474 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:15.572114 17338 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.573457 17332 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.555562 17453 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:15.612277 17458 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.575798 17267 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.590925 16493 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:15.617395 17452 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:15.611928 15904 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:15.615612 17366 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:15.658581 17451 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.658223 17468 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.682510 17366 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.683096 17468 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:15.684690 17366 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.614037 17388 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.662240 17337 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.661605 17479 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.690270 17405 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.663748 17477 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:15.645695 17461 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.691099 17477 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.612207 17457 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.640347 17473 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.616674 17269 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.681758 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:15.551384 17462 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.697741 15802 leader_election.cc:400] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:15.685953 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 417) took 1392 ms. Trace:
I20260709 12:24:15.659533 17474 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.678864 17267 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:15.675976 17458 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.698246 15802 leader_election.cc:403] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:15.617614 17464 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:15.687830 17298 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:15.667363 17454 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:15.661157 17398 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:15.731194 15907 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.692468 17399 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.680398 17364 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.724301 17269 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.631613 17469 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:15.680154 17452 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.413535 17469 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:15.693559 17461 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.725625 17334 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:15.767429 17388 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.414412 17388 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:16.414801 17388 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.414855 17452 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:16.415650 15801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.001s	sys 0.009s
W20260709 12:24:16.416095 15801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.009s
I20260709 12:24:15.818473 17267 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.417906 15837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60558
I20260709 12:24:16.418458 15837 raft_consensus.cc:606] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:15.870167 17298 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:16.418805 15837 raft_consensus.cc:614] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:16.418812 17267 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.420042 17267 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.420320 17298 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:15.963661 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 378547us
I20260709 12:24:16.420560 17267 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:16.044749 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.422008 17269 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.422550 17267 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.423048 17267 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.424109 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:16.424674 15912 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.425189 17485 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.425642 17485 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.426388 17433 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:16.426864 17433 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.427670 17485 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.428803 17433 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.423434 17267 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.430573 17462 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.430883 17267 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.431445 15912 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:16.432514 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.433969 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.435806 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.436024 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.436734 15985 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 2: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:16.438516 17464 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.399766 17473 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.441181 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.440877 15912 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:16.444947 15980 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:16.445881 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:16.119031 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.053s	sys 0.083s
W20260709 12:24:16.447865 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.053s	sys 0.088s
W20260709 12:24:16.448163 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 862948us
I20260709 12:24:16.450268 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.450814 15837 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:16.155323 17480 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.452349 15847 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-9e271b9d1bc8403ba1c9d3e80c36917c received from {username='slave'} at 127.0.0.1:59154
I20260709 12:24:16.452298 17480 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.454924 17480 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.155934 17482 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:16.157418 17477 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.455654 17482 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.457165 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:16.457748 15834 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.457832 17482 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.156397 17483 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.458683 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.157522 15907 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
W20260709 12:24:16.459383 15907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2031) took 2571 ms (client timeout 1723 ms). Trace:
W20260709 12:24:16.459738 15907 rpcz_store.cc:269] 0709 12:24:13.887948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.888061 (+   113us) service_pool.cc:224] Handling call
0709 12:24:14.827225 (+939164us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54004c16a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc21adc0 00007f03cc2a6e18 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:15.730713 (+903488us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b580039d4d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc1ff0aa 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a727c 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c
0709 12:24:16.459296 (+728583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265747200}
I20260709 12:24:16.460842 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.461500 15907 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:16.462179 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.462666 15907 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:16.462986 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:16.463393 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.463551 16494 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:16.463953 15907 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:16.464685 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.161339 17391 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.474833 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.475333 17391 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.164803 17489 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:16.476256 17489 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.477322 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:16.477694 17391 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.179656 17488 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.478140 17462 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.162061 17467 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.478935 17462 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:16.479357 17462 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.479673 17488 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.280913 17405 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.481523 17405 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.482543 17488 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.179479 17458 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.483929 17405 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.484555 17458 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:16.302701 17468 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 12:24:16.484875 17454 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:16.256250 15981 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1304) took 1403 ms (client timeout 1576 ms). Trace:
W20260709 12:24:16.487475 15981 rpcz_store.cc:269] 0709 12:24:14.783680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.783789 (+   109us) service_pool.cc:224] Handling call
0709 12:24:16.186581 (+1402792us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003151d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:16.186693 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486773120}
I20260709 12:24:16.497713 17388 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:24:15.755985 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 240603us
W20260709 12:24:16.320274 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.557s	user 0.012s	sys 0.032s
W20260709 12:24:16.500942 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.738s	user 0.012s	sys 0.032s
W20260709 12:24:16.501248 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.73844e+06us
I20260709 12:24:16.503520 17462 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.505689 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:16.506337 15913 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.509761 17486 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.509868 17475 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.510329 17486 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.510427 17475 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.512410 17486 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.512522 17475 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.512708 15913 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:16.330796 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:16.338275 17366 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.516248 17366 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.346127 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:16.517220 16486 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.518285 17366 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.340709 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2046) took 1548 ms. Trace:
I20260709 12:24:16.518945 15904 rpcz_store.cc:276] 0709 12:24:14.792020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.792437 (+   417us) service_pool.cc:224] Handling call
0709 12:24:15.348934 (+556497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.678057 (+329123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.340457 (+662400us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400420ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:16.340627 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514001280}
I20260709 12:24:16.520648 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.521719 16459 leader_election.cc:400] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3.
I20260709 12:24:16.522006 16459 leader_election.cc:403] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:16.521281 15904 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:16.523098 17450 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3.
W20260709 12:24:16.350059 16493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 421) took 2020 ms (client timeout 2333 ms). Trace:
I20260709 12:24:16.524838 15905 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.364567 16488 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Advancing to term 3
I20260709 12:24:16.528159 16486 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:16.330003 17466 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:16.365724 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:16.327493 17410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.004s	sys 0.004s
I20260709 12:24:16.378479 17431 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.531839 17431 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.533814 17431 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.379050 17436 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:16.379693 17328 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.353638 15732 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 2 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:16.534544 17328 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.536744 17328 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.537246 17436 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.361817 17352 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.540220 17494 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.541152 17467 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.540727 17494 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.542200 17467 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:16.541647 17410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.005s	sys 0.005s
I20260709 12:24:16.544523 17467 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.539289 17352 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.541247 17366 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.545955 17366 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:16.546779 15836 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:16.547088 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.548507 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.549067 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.549404 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.550051 15913 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:16.397023 17474 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.398200 17421 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.541916 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:16.177985 17418 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.003s
I20260709 12:24:16.315762 17449 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.402860 17453 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:16.403225 17331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.002s	sys 0.008s
I20260709 12:24:16.408967 17364 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:15.687568 17349 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
W20260709 12:24:16.409579 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:24:16.410149 17457 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:15.698938 17479 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.410477 17470 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.447068 17433 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.451761 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.452849 15847 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-9e271b9d1bc8403ba1c9d3e80c36917c on tablet 9e271b9d1bc8403ba1c9d3e80c36917c with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:16.458448 17483 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.157968 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 845) took 1768 ms. Trace:
I20260709 12:24:16.461373 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:16.157832 17398 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:16.158345 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.465118 15834 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:16.465421 15911 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:15.724885 17275 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.472138 17482 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.475661 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:16.476802 15912 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:16.478790 17489 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.512876 17486 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.516577 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:16.523978 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:16.524511 16493 rpcz_store.cc:269] 0709 12:24:14.329292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.333140 (+  3848us) service_pool.cc:224] Handling call
0709 12:24:16.349869 (+2016729us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54006bec54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:16.350003 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667485056}
I20260709 12:24:16.362154 17389 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.544301 17494 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.550207 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.550314 15836 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
W20260709 12:24:16.398521 15876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.002s	sys 0.009s
I20260709 12:24:16.309726 17344 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.556540 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.552639 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.558797 17468 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:16.547137 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.559372 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.553553 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:15.725131 17337 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:16.791457 15876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.011s	sys 0.025s
W20260709 12:24:16.792083 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 1.21727e+06us
I20260709 12:24:16.793296 15907 raft_consensus.cc:606] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:16.794660 15907 raft_consensus.cc:614] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:16.792505 15910 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:16.795730 15910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2049) took 1926 ms (client timeout 1851 ms). Trace:
I20260709 12:24:16.401342 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2040) took 1615 ms. Trace:
I20260709 12:24:15.725440 16490 rpcz_store.cc:276] 0709 12:24:14.293515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.301056 (+  7541us) service_pool.cc:224] Handling call
0709 12:24:15.681119 (+1380063us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:15.685280 (+  4161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.685505 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:15.685546 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:15.685609 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:15.685656 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.685742 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:15.685873 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13047552}
I20260709 12:24:16.794682 15837 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.793704 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.654666 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.798851 15834 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:16.799944 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.016s	sys 0.000s
I20260709 12:24:16.794301 15831 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:16.799090 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:16.800410 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.10273e+06us
W20260709 12:24:16.796142 15910 rpcz_store.cc:269] 0709 12:24:14.870346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.295868 (+425522us) service_pool.cc:224] Handling call
0709 12:24:15.839717 (+543849us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:16.795637 (+955920us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22168448}
I20260709 12:24:16.796370 15908 rpcz_store.cc:276] 0709 12:24:14.785907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.786035 (+   128us) service_pool.cc:224] Handling call
0709 12:24:15.871832 (+1085797us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001536d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:16.401289 (+529457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498332416}
I20260709 12:24:16.802161 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:16.802982 16494 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:16.803133 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:16.795907 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 242356us
I20260709 12:24:16.804369 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:16.632534 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 75948.6us
I20260709 12:24:16.805148 15986 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:16.806309 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.805231 15913 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:16.389204 17492 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:16.578246 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:16.560474 17462 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:16.854959 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:16.823864 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.584618 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.386878 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:16.836980 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.820636 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:16.824370 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.818364 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:16.804183 15908 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:16.598932 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.808162 16496 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:16.616876 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:16.622784 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:16.809782 15835 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:16.885313 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.921957 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.922940 15835 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:16.863740 15986 raft_consensus.cc:2410] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:16.886041 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:16.823585 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:16.883018 15981 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:16.792189 15909 rpcz_store.cc:276] 0709 12:24:14.389528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.392155 (+  2627us) service_pool.cc:224] Handling call
0709 12:24:15.877427 (+1485272us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b540010ca54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:16.157884 (+280457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16312064}
I20260709 12:24:16.936887 15912 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:16.880574 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.938189 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.937739 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.938794 15834 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
W20260709 12:24:16.906728 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.899843 17487 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:16.944854 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.822222 17350 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.884657 15984 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:16.824050 17453 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.884040 15983 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
W20260709 12:24:16.883478 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 496631us
I20260709 12:24:16.905795 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:16.909848 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 55005.4us
W20260709 12:24:16.791911 17331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.009s	sys 0.019s
I20260709 12:24:16.912782 15837 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
W20260709 12:24:16.903034 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 101325us
I20260709 12:24:16.811439 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:16.896606 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 279835us
I20260709 12:24:16.879405 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:16.940984 15906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.018s
I20260709 12:24:16.942390 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.808526 17421 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:16.943938 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 321257us
I20260709 12:24:16.798218 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:16.696707 17352 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:16.569914 17366 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:16.896751 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 90200.1us
I20260709 12:24:16.775139 17436 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:16.808460 17488 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.560554 17418 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.825443 17468 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:16.808736 17275 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.823872 17482 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.808534 17479 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.822995 17486 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:16.808943 17337 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:16.950074 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:16.952178 17328 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.061565 15908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
W20260709 12:24:16.914849 17509 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:24:17.025318 15834 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:16.746929 15905 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:16.810338 17364 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.808585 17433 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.171069 15830 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:17.171509 15836 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:16.939030 15835 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:17.230944 15831 raft_consensus.cc:2410] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:17.231511 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.232674 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.886237 17492 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:17.138537 15906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.019s	sys 0.022s
I20260709 12:24:16.896641 15980 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:17.172164 15832 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:17.173012 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.173357 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.239646 15837 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
W20260709 12:24:17.186753 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45512.2us
I20260709 12:24:16.808189 17389 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:16.916030 17457 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.191521 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.248862 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:17.192178 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:17.250124 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 98207.1us
I20260709 12:24:17.251184 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:16.627815 17269 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:17.212404 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73989.1us
I20260709 12:24:17.213869 15986 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.260531 15981 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 2: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:24:17.139025 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 327637us
I20260709 12:24:17.260887 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:16.946090 17344 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:17.114996 17461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.011s	sys 0.026s
I20260709 12:24:17.261296 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:17.264895 17510 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:17.265128 15981 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:17.265354 17433 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.261790 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.267020 15830 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:17.267238 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.267807 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.268347 15830 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:16.953850 17487 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:16.945472 17335 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:17.076953 17388 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.140837 17350 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.203280 17312 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:17.214497 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:17.238682 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2045) took 2444 ms (client timeout 2170 ms). Trace:
I20260709 12:24:16.808854 17470 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:17.245862 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 107195us
W20260709 12:24:17.264261 17461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.012s	sys 0.026s
I20260709 12:24:17.260243 17457 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.241585 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:17.314052 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 72552.9us
I20260709 12:24:17.252947 15837 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.317826 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.318193 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:17.217058 17328 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:17.260993 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.319092 17328 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.268466 15988 raft_consensus.cc:2410] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:17.164988 17421 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.320073 17421 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.202673 17366 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:24:17.263989 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.270428 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.263507 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.324666 16496 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:17.217233 15908 raft_consensus.cc:606] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.261461 15836 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:17.324965 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.201488 17488 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.325804 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.326066 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.326871 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.217908 17352 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:24:17.327430 15836 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:17.327107 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.290098 15838 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:17.299062 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:17.233250 15835 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:17.328894 17489 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.329173 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:17.329295 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:17.330171 17475 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.330739 17475 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:17.330920 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:17.331175 17475 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:17.331727 15835 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:17.331990 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:17.300446 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.298607 15987 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.301446 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.333827 15983 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.334611 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.335583 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.336126 15983 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:17.266016 17433 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:17.263013 17349 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.262935 17436 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:17.303579 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.303803 17275 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:17.306311 17482 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:17.344105 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 205714us
I20260709 12:24:17.344813 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.273522 17269 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.308319 17479 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.327026 17488 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.258970 17331 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.288475 17487 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.349889 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.351045 15906 raft_consensus.cc:2368] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:17.337064 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.305073 17486 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.310482 17388 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.358438 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.337011 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.335593 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.339679 17491 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.338279 15985 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.336928 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.362602 15909 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:17.307072 17483 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.288626 17468 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.341791 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.346405 17298 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.368956 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.314962 17312 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:17.348460 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.371345 15908 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:17.348400 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.372612 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:17.244771 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.354526 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.300127 17335 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.352989 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.375708 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.376528 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.356643 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.377153 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.377748 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.378780 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.357659 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.358314 17388 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.349933 17331 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:17.379522 15913 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:17.380076 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.380676 15913 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:17.313544 17350 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.337816 17349 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:17.336747 17494 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.345778 17461 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.369577 15980 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.363296 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.316071 17457 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.430555 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:17.418215 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.366353 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 474) took 1002 ms. Trace:
I20260709 12:24:17.428380 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.347801 17472 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.433728 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.434329 15910 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:17.300655 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.346387 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.435104 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.370229 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.436060 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:17.310822 15905 rpcz_store.cc:269] 0709 12:24:14.791653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.792452 (+   799us) service_pool.cc:224] Handling call
0709 12:24:16.330654 (+1538202us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:17.235560 (+904906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41075584}
I20260709 12:24:17.373373 15834 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:17.373669 15906 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:17.349865 17436 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:17.383473 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.438185 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.438397 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.438807 15913 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:17.439168 15983 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.439596 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.440048 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.383412 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:17.385998 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.440889 15911 raft_consensus.cc:2368] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:17.385651 17431 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.363066 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.388453 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.381170 17418 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.380280 17314 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.351882 17399 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.364182 15909 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.432402 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:17.361903 17352 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.400337 15984 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:17.379128 17454 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.384076 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:17.440780 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 57597.7us
I20260709 12:24:17.370064 17475 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.394757 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.374744 17298 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.369282 17491 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.380517 17331 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:17.426819 17505 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:24:17.443480 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.394996 17405 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:24:17.635143 15985 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:17.393740 17349 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.426184 17461 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:17.422364 17269 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:17.510507 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.477811 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.428933 17335 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:17.644218 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 211883us
W20260709 12:24:17.445219 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 184755us
W20260709 12:24:17.641604 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 253163us
I20260709 12:24:17.668016 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:17.426977 17337 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.431372 16488 rpcz_store.cc:276] 0709 12:24:16.364002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.364126 (+   124us) service_pool.cc:224] Handling call
0709 12:24:16.364421 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.567975 (+203554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:16.568021 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:16.568526 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.029027 (+460501us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.364080 (+335053us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.365512 (+  1432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.366132 (+   620us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.366175 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:17.366189 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.366299 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44309,"prepare.queue_time_us":42162,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":17723,"raft.queue_time_us":36371,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":44084,"thread_start_us":794813,"threads_started":2,"wal-append.queue_time_us":666875}
I20260709 12:24:17.632726 17431 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.673177 17389 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.681154 17269 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.681599 17269 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:17.682042 17269 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.634121 17352 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:17.573344 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.399819 17453 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.662884 15953 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.687968 15906 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
W20260709 12:24:17.690219 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 48713.9us
I20260709 12:24:17.423251 17328 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.670710 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.694293 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.632730 15911 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:17.668040 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:17.559057 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.631875 17364 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.533418 17517 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.680207 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:17.441968 17472 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:17.684509 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.557763 17470 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.401939 17494 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.685216 17431 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.637650 17399 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:17.636519 17314 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.636729 17454 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:17.533319 17483 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.424739 17421 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:17.723465 17513 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:24:17.724325 17421 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.667150 17458 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:17.725100 17458 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.725579 17388 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.675801 17488 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.666610 17398 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:17.726626 17398 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.727452 17269 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.728178 17298 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.671921 17418 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.728632 17398 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.728811 17418 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.729286 17418 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.728615 17331 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.712260 17522 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:17.691718 17352 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.729732 17328 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:17.731431 17331 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.558344 17436 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.733320 17461 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.560738 17312 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.690905 17492 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:17.714016 17472 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.737742 17352 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.738583 17344 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.739009 17344 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.740249 17352 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.690263 17337 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.683866 17520 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.717789 17389 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.741514 17489 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.742007 16496 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.742110 17337 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.742144 17489 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.742722 17337 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.734788 16495 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:17.713970 17494 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.741170 17520 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:17.720234 17399 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.729403 17269 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.813158 15979 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:17.721225 17314 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:17.816131 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 93654.9us
I20260709 12:24:17.819772 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:17.701838 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:17.821462 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 152) took 1253 ms. Trace:
W20260709 12:24:17.821614 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 119682us
I20260709 12:24:17.668678 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:17.827225 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 158387us
I20260709 12:24:17.648897 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.714080 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 185) took 1158 ms. Trace:
I20260709 12:24:17.829869 15980 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:17.706990 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:17.833981 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 142) took 1329 ms. Trace:
I20260709 12:24:17.835376 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.741600 17389 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.836566 17269 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.836846 17389 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.837150 17269 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.837404 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:17.837664 17269 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.838905 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.839385 17515 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.839855 17515 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.775264 17399 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.840296 17515 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.765362 17418 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.842592 17522 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.843094 17522 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.843559 17522 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.844489 17418 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.735419 17454 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.771067 17457 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:17.767397 17458 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:17.735499 17483 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.834520 15907 rpcz_store.cc:276] 0709 12:24:16.504648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.936295 (+431647us) service_pool.cc:224] Handling call
0709 12:24:16.936605 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.439957 (+503352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.439987 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.509344 (+ 69357us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.699221 (+189877us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:17.699256 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.699326 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.833460 (+134134us) raft_consensus.cc:1685] finished
0709 12:24:17.833505 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.833779 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124381,"raft.queue_time_us":191030,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":39232,"spinlock_wait_cycles":36224,"thread_start_us":570633,"threads_started":2,"wal-append.queue_time_us":216444}
I20260709 12:24:17.849704 17483 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.761739 17489 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.895815 17410 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.897431 17410 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:17.897864 17410 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:17.762116 17491 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.898504 17489 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:17.552400 15802 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.643s (SENT) [suppressed 2 similar messages]
I20260709 12:24:17.899178 17410 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.715914 17519 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.900611 17410 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.757838 17520 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.776026 17431 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.932111 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.700101 17334 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:17.933650 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 275266us
I20260709 12:24:17.765367 17487 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.854600 15837 raft_consensus.cc:2368] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:17.938892 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.939746 15837 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:17.939908 17344 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.941448 15980 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:17.943010 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.856355 17399 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.858515 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 205) took 1382 ms. Trace:
I20260709 12:24:17.943666 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:17.943847 15836 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:17.858923 17391 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:17.861795 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.946449 17344 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:17.947130 15830 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:17.947163 17389 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:17.948055 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:17.948346 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:17.948535 15838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 207) took 1401 ms (client timeout 1770 ms). Trace:
I20260709 12:24:17.863679 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1299) took 1309 ms. Trace:
W20260709 12:24:17.948958 15838 rpcz_store.cc:269] 0709 12:24:16.546774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.546884 (+   110us) service_pool.cc:224] Handling call
0709 12:24:17.948218 (+1401334us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540020e254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:17.948382 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664034048}
I20260709 12:24:17.949183 15831 rpcz_store.cc:276] 0709 12:24:16.554076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.885077 (+331001us) service_pool.cc:224] Handling call
0709 12:24:17.863222 (+978145us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400083754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:17.863443 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705654528}
I20260709 12:24:17.950681 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:17.951164 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 66303.4us
I20260709 12:24:17.951568 15838 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:17.829617 15982 rpcz_store.cc:276] 0709 12:24:16.555377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.560674 (+  5297us) service_pool.cc:224] Handling call
0709 12:24:16.885606 (+324932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.164229 (+278623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.197397 (+ 33168us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.262325 (+ 64928us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.548959 (+286634us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:17.560549 (+ 11590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.634284 (+ 73735us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.713876 (+ 79592us) raft_consensus.cc:1685] finished
0709 12:24:17.713894 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.714023 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20174,"raft.queue_time_us":192084,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3987,"spinlock_wait_cycles":4352,"thread_start_us":125718,"threads_started":1,"wal-append.queue_time_us":361456}
I20260709 12:24:17.953217 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.944056 15829 rpcz_store.cc:276] 0709 12:24:16.475943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.476090 (+   147us) service_pool.cc:224] Handling call
0709 12:24:16.476337 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.478714 (+  2377us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:16.949437 (+470723us) log.cc:844] Serialized 14 byte log entry
0709 12:24:17.350133 (+400696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:17.350194 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:17.350234 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.774420 (+424186us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:17.857892 (+ 83472us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b540003b1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:17.857966 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.858251 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2182,"prepare.queue_time_us":29681,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1880,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6532,"spinlock_wait_cycles":12455552,"thread_start_us":870725,"threads_started":2,"wal-append.queue_time_us":444532}
I20260709 12:24:17.954849 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.956924 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.957338 17399 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.957826 15981 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:17.957912 17399 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:17.958554 17399 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.959002 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.960367 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.961601 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
W20260709 12:24:17.963505 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 257316us
I20260709 12:24:17.936753 17487 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.964597 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:17.940819 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:17.966131 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:17.966912 15909 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.973760 17389 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:17.866241 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 46815.1us
I20260709 12:24:17.977842 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:17.866775 15983 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
W20260709 12:24:17.978461 15979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 764) took 1353 ms (client timeout 1664 ms). Trace:
I20260709 12:24:17.977804 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.979238 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.867100 17457 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:17.868654 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:17.822324 15912 rpcz_store.cc:276] 0709 12:24:16.567928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.937535 (+369607us) service_pool.cc:224] Handling call
0709 12:24:16.937802 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.370630 (+432828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.370676 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.378406 (+  7730us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.664650 (+286244us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.664713 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.664808 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.820795 (+155987us) raft_consensus.cc:1685] finished
0709 12:24:17.820839 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.821196 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142094,"raft.queue_time_us":131042,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":40935,"thread_start_us":552324,"threads_started":2,"wal-append.queue_time_us":335688}
I20260709 12:24:17.873865 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.873533 17350 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:17.875124 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:17.877069 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 765) took 1222 ms. Trace:
I20260709 12:24:17.878748 15913 pending_rounds.cc:85] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:24:17.880312 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:17.882510 17436 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.882566 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.996814 17436 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.997946 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.998029 15731 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 3, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.999300 17458 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.999761 15908 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:18.000783 15731 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.004380 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:17.885088 17454 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.886708 17418 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:24:17.887691 17535 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:24:17.890203 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:17.892246 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 767) took 1232 ms. Trace:
I20260709 12:24:17.895153 17312 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.050563 17312 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:18.051021 17312 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.899750 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.053306 17457 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:17.774909 17514 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
W20260709 12:24:17.909960 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 357451us
I20260709 12:24:17.912763 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 198) took 1455 ms. Trace:
I20260709 12:24:17.913306 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:17.914397 17317 raft_consensus.cc:1064] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:18.052376 17269 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:17.914425 17519 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:17.926467 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 773) took 1240 ms. Trace:
I20260709 12:24:18.087014 15984 rpcz_store.cc:276] 0709 12:24:16.685861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.300191 (+614330us) service_pool.cc:224] Handling call
0709 12:24:17.925913 (+625722us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54002f67d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:17.926209 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153784576}
I20260709 12:24:17.928597 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.088537 15832 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.089701 17350 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:18.090433 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 126019us
I20260709 12:24:18.090793 17312 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.091969 17436 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:18.092443 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 94666.8us
I20260709 12:24:18.092876 15732 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 276) took 4923 ms. Trace:
W20260709 12:24:18.093293 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 89085.5us
I20260709 12:24:17.933251 17334 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.849238 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:17.948802 15911 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.944931 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:17.985255 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 89963.3us
I20260709 12:24:17.925956 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:17.985601 15988 rpcz_store.cc:276] 0709 12:24:16.654158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.654395 (+   237us) service_pool.cc:224] Handling call
0709 12:24:17.876557 (+1222162us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400012cd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:17.876836 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077282048}
I20260709 12:24:17.985693 15913 pending_rounds.cc:107] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:17.994328 17337 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:18.106849 17337 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:18.108564 17537 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:24:17.995827 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 776) took 1309 ms. Trace:
I20260709 12:24:18.006013 15909 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:18.109182 15986 rpcz_store.cc:276] 0709 12:24:16.686610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.319496 (+632886us) service_pool.cc:224] Handling call
0709 12:24:17.874748 (+555252us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:17.995744 (+120996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40858496}
I20260709 12:24:18.005141 17486 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.109822 17515 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:18.110395 17486 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:18.110857 17486 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.111109 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1306) took 1164 ms. Trace:
I20260709 12:24:18.111493 15986 rpcz_store.cc:276] 0709 12:24:16.946926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.110058 (+1163132us) service_pool.cc:224] Handling call
0709 12:24:18.110454 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.110786 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.110814 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.110869 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:18.110898 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.110949 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.111042 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:18.112001 17515 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:18.033576 17389 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.996842 17520 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:18.113363 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 189) took 1307 ms. Trace:
I20260709 12:24:18.113790 15980 rpcz_store.cc:276] 0709 12:24:16.806109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.112365 (+1306256us) service_pool.cc:224] Handling call
0709 12:24:18.112769 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.112983 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.113009 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.113076 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:18.113111 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.113169 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.113289 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:18.038087 17349 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.117449 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.118376 15911 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:18.119139 17349 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.119469 15879 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:17.979723 15982 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:18.049815 17418 consensus_queue.cc:1243] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:18.049522 17522 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:18.053937 17457 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.041075 15987 rpcz_store.cc:276] 0709 12:24:16.659925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.660108 (+   183us) service_pool.cc:224] Handling call
0709 12:24:16.823668 (+163560us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:17.891846 (+1068178us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540011a8d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:17.892040 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944826112}
I20260709 12:24:18.049561 15731 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 4, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 4 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.064826 17314 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:17.919922 17483 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:17.978896 15979 rpcz_store.cc:269] 0709 12:24:16.624705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.632782 (+  8077us) service_pool.cc:224] Handling call
0709 12:24:17.337906 (+705124us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917eeee 000000000036eb39 00007f03d11f21e0 00007f03d12bb0c4 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:17.978267 (+640361us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54003156d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:17.978398 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353632384}
I20260709 12:24:17.933269 17431 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:18.102233 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:18.102452 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.104387 17269 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:18.040115 17454 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:18.100510 15913 raft_consensus.cc:2889] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.114866 17520 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:18.037986 17487 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.114919 15984 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.115399 15983 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.116159 15905 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:18.112951 15986 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.121249 17516 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.099881 17312 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:18.132509 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61606.7us
I20260709 12:24:18.138788 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.093266 15732 rpcz_store.cc:276] 0709 12:24:13.169328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.169434 (+   106us) service_pool.cc:224] Handling call
0709 12:24:18.092643 (+4923209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:16.686694 (+     0us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b54001109a8. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d265f9e1 00007f03d265e64c 00007f03cfcedadc 00007f03cfcd90a6 00007f03cfcd8d58 00007f03cfcdd9f1 00007f03cfcdd9a9 00007f03cfcdd939 00007f03cfcdd901 00007f03cfcdcb2d 0000000000388634
0709 12:24:16.686809 (+   115us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:16.687456 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:16.687498 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:24:16.687519 (+    21us) tablet.cc:662] Decoding operations
0709 12:24:16.687888 (+   369us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:16.687970 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:16.688005 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:16.688218 (+   213us) tablet.cc:701] Row locks acquired
0709 12:24:16.688238 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:16.688390 (+   152us) write_op.cc:270] Start()
0709 12:24:16.688603 (+   213us) write_op.cc:276] Timestamp: P: 1783599856688338 usec, L: 0
0709 12:24:16.688624 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:17.068419 (+379795us) log.cc:844] Serialized 533 byte log entry
0709 12:24:17.763191 (+694772us) op_driver.cc:464] REPLICATION: finished
0709 12:24:17.770937 (+  7746us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b540017c854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc29ee28 00007f03cfcd9581 00007f03cfcd8d58 00007f03cfcdd9f1 00007f03cfcdd9a9 00007f03cfcdd939 00007f03cfcdd901 00007f03cfcdcb2d 0000000000388634 0000000000388479
0709 12:24:17.873233 (+102296us) write_op.cc:301] APPLY: starting
0709 12:24:17.873426 (+   193us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:17.873582 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:17.873632 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:17.873973 (+   341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:17.874267 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:17.874331 (+    64us) write_op.cc:312] APPLY: finished
0709 12:24:17.874790 (+   459us) log.cc:844] Serialized 23 byte log entry
0709 12:24:17.875078 (+   288us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.875204 (+   126us) write_op.cc:454] Released schema lock
0709 12:24:17.875267 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:17.875901 (+   634us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.875948 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":400,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":18846,"apply.run_cpu_time_us":2783,"apply.run_wall_time_us":42731,"num_ops":1,"prepare.queue_time_us":19423,"prepare.run_cpu_time_us":21676,"prepare.run_wall_time_us":1212146,"raft.queue_time_us":35892,"raft.run_cpu_time_us":10716,"raft.run_wall_time_us":105535,"replication_time_us":1068589,"spinlock_wait_cycles":161132544,"thread_start_us":377523,"threads_started":4,"wal-append.queue_time_us":604758}]]}
I20260709 12:24:18.144119 16489 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.151620 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1305) took 1336 ms. Trace:
I20260709 12:24:18.141510 16495 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:18.143725 15731 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:18.151863 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.154947 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 770) took 1481 ms. Trace:
I20260709 12:24:18.157121 15984 rpcz_store.cc:276] 0709 12:24:16.667302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.114056 (+1446754us) service_pool.cc:224] Handling call
0709 12:24:18.114485 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.142256 (+ 27771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.148231 (+  5975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:18.155074 15983 rpcz_store.cc:276] 0709 12:24:16.805822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.114954 (+1309132us) service_pool.cc:224] Handling call
0709 12:24:18.115242 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.142337 (+ 27095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.142493 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:18.158356 15981 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:18.158304 17472 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:24:18.159792 17314 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:18.160282 15979 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:18.139791 17399 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.161470 15731 catalog_manager.cc:5697] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.163132 17399 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:18.163306 15731 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 2 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.164557 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:18.174189 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.174397 17522 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:18.169490 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.142192 17487 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:18.178740 17516 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:18.178506 15731 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.174934 17317 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.157965 17515 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:18.184602 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:18.196038 16488 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:18.171736 17457 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.201452 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.202235 15906 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.202937 16490 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.203819 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.204453 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.205102 15984 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:18.205224 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.197461 17269 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:18.206130 17269 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.206530 17269 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.197809 17515 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.195590 17389 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:24:18.209431 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.210194 15984 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 4: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:18.210316 16490 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.210510 17483 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.211184 17483 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.211571 15803 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.209206 17515 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.211789 17483 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:18.140128 17519 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.182919 17487 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.225399 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.230875 15832 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:18.231988 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.234164 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.244002 17364 raft_consensus.cc:2764] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:24:18.244879 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:18.254513 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 66508.2us
I20260709 12:24:18.254865 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.263388 17350 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.071448 15833 rpcz_store.cc:276] 0709 12:24:16.457123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.457251 (+   128us) service_pool.cc:224] Handling call
0709 12:24:16.457556 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.529707 (+ 72151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:16.529743 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:16.530177 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.991693 (+461516us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:17.009553 (+ 17860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.912078 (+902525us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54001360d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:17.912176 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:17.912255 (+    79us) raft_consensus.cc:1685] finished
0709 12:24:17.912271 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:17.912575 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":114,"spinlock_wait_cycles":165125504,"thread_start_us":404748,"threads_started":1,"wal-append.queue_time_us":718180}
I20260709 12:24:18.268728 17483 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:18.270828 17334 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.279053 17520 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:18.293473 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.307631 15906 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:18.313369 15832 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:18.314520 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:18.315088 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 93347us
I20260709 12:24:18.316047 17519 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.316651 15904 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.317983 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.314520 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.318882 15904 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:18.318202 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.319751 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.320434 15912 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.321239 15905 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:18.321650 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:18.322355 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.323132 15909 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:18.306205 17483 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:18.324025 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.324383 17483 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.326911 17483 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.330886 15879 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.333046 17486 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.333576 17458 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.334014 17458 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:18.335225 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.322613 17269 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.341946 17522 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.361325 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:18.363916 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.375108 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.381311 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:18.377678 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.384831 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.441872 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.376379 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.362625 17522 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:18.371162 17516 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.434464 15912 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.368943 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.477593 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.355258 17483 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.383038 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:18.478356 15836 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
W20260709 12:24:18.477645 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 91436.9us
I20260709 12:24:18.479658 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.489396 15911 raft_consensus.cc:2368] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:18.489864 17399 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:18.490365 17399 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:18.491281 15910 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:18.491640 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.491389 17399 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.493319 15836 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.493634 17269 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.493875 15833 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.481670 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.486255 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.511724 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.512203 15912 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:18.482419 17522 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:18.529834 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 288948us
I20260709 12:24:18.532756 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.533385 15835 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.533987 17461 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:24:18.519232 17516 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.538192 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.538806 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:18.541523 15834 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:18.550117 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.550571 15835 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:18.548748 17349 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:18.560407 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:18.560518 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.561122 15986 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.565441 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.566076 15981 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:18.566392 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.566078 15838 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:18.567087 15983 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:18.568075 15987 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:18.569319 15986 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:18.570290 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:18.571228 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1326) took 1014 ms. Trace:
I20260709 12:24:18.571399 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.572014 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.532015 17486 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:18.574363 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.576457 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.578030 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.581693 15981 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.583488 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.586761 15832 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:18.587788 17349 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.590432 17349 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:18.544881 17487 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.594118 15830 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:18.582569 15980 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:18.538914 17314 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:24:18.602232 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.597241 17364 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.607792 16489 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.609601 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:18.611759 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.612345 15830 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.613853 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.599426 17486 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.642616 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.650125 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.609328 17364 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.652994 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:18.654335 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 46425.6us
I20260709 12:24:18.655472 15832 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.636149 17486 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:18.659346 17486 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.661238 17483 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.661652 17483 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:18.661474 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.662103 17483 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.662402 15835 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.665565 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.666384 15834 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.667297 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.668573 17461 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.668960 17461 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:18.669516 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.670452 15831 raft_consensus.cc:2368] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:18.670569 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:18.671768 17487 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:18.642288 17454 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.669955 17461 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:18.680395 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 180572us
W20260709 12:24:18.683853 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 187668us
I20260709 12:24:18.681047 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:18.654044 17364 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.689186 15835 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:18.692359 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.697466 15832 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:18.697634 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.688562 17472 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:18.685802 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.700994 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:18.728021 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.732476 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:18.738029 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 166680us
W20260709 12:24:18.740166 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 508698us
I20260709 12:24:18.701819 17472 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.752048 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:18.752806 16488 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.693441 17317 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:24:18.742802 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.735443 17457 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.770891 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.750023 17472 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.776093 16495 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.756919 17334 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.753543 17389 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:18.771776 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:18.789443 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.789863 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.767957 17431 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:18.791081 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 62118.1us
I20260709 12:24:18.804607 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.817713 15830 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:18.814451 15908 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:18.772468 17457 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:18.823216 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51547.8us
I20260709 12:24:18.824198 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.825632 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:18.826932 15834 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:18.827683 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.757694 17519 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:18.821130 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.832325 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.832641 17559 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:18.833292 15909 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:18.833350 17559 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:18.834666 17559 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:18.837585 15910 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.838670 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:18.840765 17505 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:18.841277 17312 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.841557 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:18.841900 17312 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.843593 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.820150 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.789148 17334 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.837483 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.806684 17337 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:18.802475 17349 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.806550 17431 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:18.861198 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49215.8us
I20260709 12:24:18.871297 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:18.890842 15981 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:18.892098 15912 raft_consensus.cc:2368] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:18.575614 15982 rpcz_store.cc:276] 0709 12:24:17.556936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.137556 (+580620us) service_pool.cc:224] Handling call
0709 12:24:18.143871 (+  6315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.144185 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:18.233008 (+ 88823us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.570874 (+337866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.570930 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:18.570977 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.571053 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.571171 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172838,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":33,"raft.queue_time_us":10649,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":286068,"threads_started":2,"wal-append.queue_time_us":373606}
I20260709 12:24:18.821715 17520 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.843032 17457 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.904240 16488 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
W20260709 12:24:18.903488 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 99425.3us
W20260709 12:24:18.844262 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 153860us
I20260709 12:24:18.915374 15830 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.858342 17334 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.916929 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:18.919564 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44213.2us
I20260709 12:24:18.891765 17349 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.891462 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.902652 17431 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.935124 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:18.928709 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 153874us
W20260709 12:24:18.946389 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 118805us
I20260709 12:24:18.916069 17269 raft_consensus.cc:2764] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:24:18.956458 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:18.933604 17349 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.959368 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:18.935506 17556 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.936259 17520 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:18.983423 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.980012 15830 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:18.993278 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.994079 15913 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:18.993127 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:18.996248 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:18.997131 15904 raft_consensus.cc:2368] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:18.959890 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:18.933830 17486 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.013875 15985 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.969908 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:19.030874 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 102531us
I20260709 12:24:19.014474 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:19.040313 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 118920us
I20260709 12:24:19.027453 15982 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:19.032357 17515 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.004s
I20260709 12:24:19.041780 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.040978 17578 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:19.059736 15979 raft_consensus.cc:2368] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:19.062914 17562 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.063408 17562 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:19.070811 17576 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 12:24:19.072314 17576 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.072651 17576 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:19.074729 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.075445 15911 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:19.076201 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.076304 17483 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.076833 15911 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:19.090871 17516 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.091765 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.112792 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:19.114445 15982 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
W20260709 12:24:19.081351 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 135061us
I20260709 12:24:19.077389 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.073024 17576 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.093392 17520 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.095223 17486 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.064404 17562 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.056524 17578 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.088449 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.084100 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 191) took 2175 ms. Trace:
I20260709 12:24:19.000250 17458 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.077534 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.081437 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:19.084643 15833 consensus_meta.cc:287] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.590s	user 0.004s	sys 0.004s
W20260709 12:24:19.080451 17522 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.002s
I20260709 12:24:19.117839 15909 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:19.133255 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74528.7us
W20260709 12:24:19.192273 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 218635us
I20260709 12:24:19.134202 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:19.117218 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.193184 15913 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:19.112002 17516 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.060930 17515 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.135160 17557 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:19.203692 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 86590.9us
I20260709 12:24:19.205119 15910 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:19.206085 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 304504us
I20260709 12:24:19.211359 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.212646 17559 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.213368 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.213225 17559 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:19.214259 17579 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:24:19.214358 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.214948 17569 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.215479 17559 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.215603 17569 raft_consensus.cc:2764] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:19.216055 17587 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:19.216519 17587 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:19.216892 17587 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.197346 17522 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.219172 17522 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.219132 17349 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.135114 17457 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.223120 17457 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:19.225780 17563 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:24:19.225498 17587 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.227217 15980 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:19.227560 17587 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.227744 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.228220 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.229203 15906 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:19.229382 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.230548 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.229214 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.232606 15910 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:19.234130 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.234402 17483 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.234977 17483 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:19.235361 17483 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.235446 17569 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.235806 17483 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.236196 17569 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:19.236562 17569 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.236904 17569 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:19.237890 17568 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
I20260709 12:24:19.237797 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.228883 17389 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.238430 17389 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:19.239415 17389 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.241062 17389 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:19.245710 17564 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:24:19.248342 17578 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:19.248838 17578 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:19.249220 17578 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.249286 17557 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:19.249687 17458 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.252579 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.252969 17582 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:19.253808 17586 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:19.254477 17580 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.250411 17557 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.254825 17580 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:19.255645 17580 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.256748 17580 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.253994 17582 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:19.235812 15802 leader_election.cc:400] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:19.261070 15802 leader_election.cc:403] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:19.257793 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47548.5us
I20260709 12:24:19.189026 15988 rpcz_store.cc:276] 0709 12:24:16.908233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.109695 (+1201462us) service_pool.cc:224] Handling call
0709 12:24:18.110084 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:18.241523 (+131439us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:18.479684 (+238161us) log.cc:844] Serialized 14 byte log entry
0709 12:24:18.708107 (+228423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:18.708174 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:18.708226 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.082199 (+373973us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800419620. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419
0709 12:24:19.083833 (+  1634us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400206a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:19.083885 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.084014 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75751,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":8662,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":26226,"spinlock_wait_cycles":314774144,"thread_start_us":371793,"threads_started":2,"wal-append.queue_time_us":250470}
I20260709 12:24:19.262625 15909 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:19.194541 15833 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:19.268352 15907 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:19.249712 17578 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.279270 15838 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:19.293969 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:19.272974 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:19.301059 17574 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:19.300961 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 43552.6us
W20260709 12:24:19.305866 17566 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 12:24:19.305703 17461 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.273947 17587 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.274104 17582 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:19.278237 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.333593 17570 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.334229 17570 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.334735 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.336133 15952 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.336318 17570 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:19.337321 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.337220 17586 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:19.337419 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 61305.6us
I20260709 12:24:19.338922 17583 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.339314 17583 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:19.340138 17583 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.341384 17583 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.337244 17269 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.339308 17586 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.300102 17349 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:19.345894 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 67738.7us
I20260709 12:24:19.346637 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.302132 17486 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:19.357307 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 80872.1us
W20260709 12:24:19.362825 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 148532us
I20260709 12:24:19.363051 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.293540 17573 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:19.364990 15879 leader_election.cc:400] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:19.365473 15879 leader_election.cc:403] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:19.321784 17337 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:19.374653 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.374972 17337 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.377738 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.379626 15952 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.380338 17349 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.381187 15988 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:19.381273 17588 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.380699 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:19.385576 17588 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.387861 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.388554 17588 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.390625 15952 leader_election.cc:400] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:19.391390 17476 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.392118 17476 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:19.393558 17486 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.393373 17476 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.395681 17486 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.380986 17592 raft_consensus.cc:2764] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:19.385023 17587 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
W20260709 12:24:19.402194 17472 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 12:24:19.391429 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:19.402680 17472 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.403995 15905 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:19.404502 17583 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:19.406121 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49296.1us
I20260709 12:24:19.380977 17349 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:19.409348 17589 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:24:19.344947 17516 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.413542 17582 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.414610 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.435171 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2064) took 1116 ms. Trace:
I20260709 12:24:19.414516 17431 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.415001 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:19.415779 17571 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
W20260709 12:24:19.419610 17364 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.727s	user 0.004s	sys 0.005s
I20260709 12:24:19.419569 17578 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.422055 17569 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.423432 15879 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.423918 17350 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:19.424418 17573 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:24:19.428580 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 54442.3us
I20260709 12:24:19.435626 15907 rpcz_store.cc:276] 0709 12:24:18.314358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.323780 (+  9422us) service_pool.cc:224] Handling call
0709 12:24:19.429708 (+1105928us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54001522d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:19.431125 (+  1417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169900416}
I20260709 12:24:19.441720 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:19.379977 17334 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.385589 17515 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:19.460042 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 89473.3us
I20260709 12:24:19.454375 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.459242 16495 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:19.450109 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.461480 16490 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.461947 17350 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:19.462471 16489 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.435371 17574 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:19.466339 17578 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.469895 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:19.440346 17457 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.473853 15910 raft_consensus.cc:2410] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:19.469846 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.446283 17389 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.437984 17556 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:19.474519 17350 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.564669 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.564576 17350 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.565899 17350 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.566905 17457 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.567315 17457 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.567050 17556 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.567701 17457 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.475251 17516 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.476855 15980 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:19.460731 17520 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:24:19.574674 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 104933us
I20260709 12:24:19.574934 17583 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:19.575343 17585 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.576690 17569 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.577189 17476 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:19.578146 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.578613 15908 raft_consensus.cc:2368] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:19.579214 17334 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.579988 17569 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:19.580371 17569 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.507001 15904 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:19.580861 15904 pending_rounds.cc:85] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 4
I20260709 12:24:19.582276 15904 pending_rounds.cc:107] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:19.470786 17592 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:19.558557 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 51376.5us
I20260709 12:24:19.583825 17592 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.559422 15909 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:24:19.561678 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 91835.4us
I20260709 12:24:19.574911 17457 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:19.556025 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 106055us
I20260709 12:24:19.573660 17515 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.574442 17458 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.580713 17569 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.582422 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.584815 17592 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:19.555298 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73658.3us
I20260709 12:24:19.553653 17562 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.588450 15988 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:19.592319 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:19.586073 15904 raft_consensus.cc:2889] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:19.454980 17399 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:24:19.618784 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.597329 15982 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.587738 17349 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.580696 17431 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:19.600056 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.600256 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:19.601231 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:19.557885 17570 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:19.453989 17364 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.625771 17472 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.626819 17364 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.627401 16488 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:19.626852 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.629750 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:19.622155 17571 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:24:19.635066 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:19.636042 15986 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:24:19.643891 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45658.6us
I20260709 12:24:19.620394 15802 leader_election.cc:400] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:19.645061 15802 leader_election.cc:403] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:19.600696 17515 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.589205 17483 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.656523 16488 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.657213 17581 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:19.657491 17571 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.658053 17475 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:19.658922 15832 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.672749 15832 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:19.673398 15909 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.673518 15832 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.665238 17364 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:19.674666 15832 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.600926 17458 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:19.660667 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.619592 17574 raft_consensus.cc:2764] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:19.664047 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.636365 17580 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.634979 17570 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.683043 16488 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.685449 16495 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.689647 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.690392 15908 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:19.691313 15802 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.691412 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:19.692615 15910 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:19.697881 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 141013us
I20260709 12:24:19.664995 17349 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:19.704105 15832 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.647902 17522 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:24:19.667703 17571 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.712958 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:19.690654 16490 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:19.722796 17334 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:19.725819 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:19.729465 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.692886 17461 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:19.713881 17574 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.743957 17556 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.744215 17593 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:19.745185 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.745438 17573 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.744545 17334 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:19.746132 17349 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:19.749495 17350 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:19.750396 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:19.750692 17472 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:19.751746 17586 raft_consensus.cc:1064] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:19.711932 17562 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.756829 15802 leader_election.cc:400] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:19.716868 17458 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:19.738518 17578 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:19.771641 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54789.9us
W20260709 12:24:19.817198 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 66377.8us
I20260709 12:24:19.817459 15802 leader_election.cc:403] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:19.764777 17593 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:19.806305 15950 leader_election.cc:336] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.545s (SENT)
I20260709 12:24:19.767880 17573 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.768674 17574 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:19.854154 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.818082 17457 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:19.757355 17600 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:24:19.865403 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:19.819331 17458 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.817107 17578 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:19.881002 17557 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:19.881603 17557 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:19.881908 17604 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:24:19.883826 17607 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:24:19.805503 17571 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.855749 17364 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:19.857569 17593 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.891475 17578 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.914968 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.875873 17269 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:19.915774 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 141648us
I20260709 12:24:19.894510 17317 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:19.915804 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 159281us
W20260709 12:24:19.909188 17576 consensus_meta.cc:287] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.002s
I20260709 12:24:19.810623 17515 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.806900 17570 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:19.907945 17457 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:19.925155 17571 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.950955 15802 leader_election.cc:400] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:19.954658 15802 leader_election.cc:403] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:19.894034 17458 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:19.924337 17582 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.937254 17317 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:19.976317 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:19.941373 17587 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.952740 17457 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:19.981381 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:19.985924 15832 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:19.986928 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:19.992527 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.998028 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:19.998242 15830 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:19.995926 15838 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.999222 15835 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:19.990010 17457 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.944341 17576 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:20.004135 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.982925 17619 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.990283 17364 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.982743 17583 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.009706 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:20.010946 15910 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:20.012980 15830 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.011219 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:19.957823 17269 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.015259 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:20.022845 15908 raft_consensus.cc:2368] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:20.032482 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:20.002128 17570 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.996536 17587 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.941521 17573 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:20.052628 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 71334.2us
I20260709 12:24:20.054765 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:20.057726 17483 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.058324 17483 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.058758 17483 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.062705 17317 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.064601 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.012576 17557 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.071421 15985 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.071623 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:20.073933 17603 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:24:20.081254 15831 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:20.081875 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:20.084443 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.084513 17583 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:20.086175 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:20.086876 17612 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:24:20.087246 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:20.088272 17624 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:24:20.088333 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.089354 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.090014 15906 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:20.093184 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.083163 17613 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:24:20.071853 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.099855 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.100822 15908 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:20.101817 17610 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:24:19.995880 17574 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:20.105949 15913 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.102128 17635 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:20.102936 17576 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.114059 17633 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:20.114588 17633 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.094097 17583 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:20.022179 17619 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.097225 17587 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:20.126101 17638 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:24:20.143293 15908 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:20.145900 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 65485.8us
W20260709 12:24:20.146821 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 135757us
I20260709 12:24:20.148662 15910 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:20.139361 17587 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.153286 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:20.159235 15832 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.164192 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:20.167265 15906 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:20.149567 17458 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:20.155284 17587 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:20.153409 17633 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:20.176816 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 138571us
I20260709 12:24:20.181187 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:20.181773 15912 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:20.183333 15802 leader_election.cc:400] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
W20260709 12:24:20.184446 17602 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.446s	user 0.000s	sys 0.003s
I20260709 12:24:20.188215 17631 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:24:20.188809 17627 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.189581 17619 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:20.190872 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:20.192953 17621 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:20.194178 17621 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:20.194661 17453 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.194707 15905 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:20.187322 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.200172 17632 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:20.176362 17269 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:20.179499 17582 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:20.207832 17639 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:20.208462 17364 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
W20260709 12:24:20.216876 17569 consensus_meta.cc:287] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.002s
I20260709 12:24:20.226181 17569 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.228125 17569 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.229188 17601 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:24:20.232446 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.238320 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:20.246137 17569 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:20.246784 17569 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:20.247648 17569 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.245260 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:20.249745 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:20.251729 15984 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.223030 17632 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:20.255581 17364 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:20.230515 17457 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:20.256254 17364 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:20.257426 17364 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.258875 17597 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:20.262049 17350 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.262432 17350 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:20.263185 17350 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:20.250802 17580 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 12:24:20.186111 17583 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.233708 17582 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:20.256280 17632 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.264570 15979 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:20.286381 17593 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.277514 17580 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:20.280773 17350 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:20.292738 17556 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:24:20.306969 17618 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:20.307543 17618 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.309688 17618 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:20.294422 17475 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.315474 17556 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:20.318204 17457 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.323073 17475 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.330840 17628 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:20.332684 17475 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.338375 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:20.339047 15983 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:20.339855 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:20.340452 15832 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:20.344588 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:20.324184 17578 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.355676 17586 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:20.359548 17615 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.395s	user 0.001s	sys 0.001s
I20260709 12:24:20.364950 17637 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:20.365398 17617 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.295s	user 0.003s	sys 0.001s
I20260709 12:24:20.341681 17582 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.382077 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.350256 17585 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:20.350418 17593 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.375909 15829 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:20.379022 15912 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.391759 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.403275 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:20.404547 17616 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.527s	user 0.003s	sys 0.000s
I20260709 12:24:20.364333 17587 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.399823 17637 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.412242 17637 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.393963 17585 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.413512 17585 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.455493 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.456552 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:20.457317 16495 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:20.478408 17483 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.479411 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:20.480528 17483 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:20.480999 17483 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:20.481446 17483 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.490257 17635 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:20.490648 17635 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:20.491460 17635 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.492488 17635 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:20.495716 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.518291 15910 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:20.520028 17317 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:20.525693 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.527212 17628 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:20.472914 17573 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.549790 16488 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.555869 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:20.558835 16489 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.582192 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:20.548188 17578 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.588307 16496 raft_consensus.cc:2393] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:20.529788 17637 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.598531 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:20.599524 17587 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:20.601137 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.603741 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.605629 15911 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:20.607925 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.621734 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.638029 15803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.020s	sys 0.032s
W20260709 12:24:20.638348 15803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.020s	sys 0.033s
W20260709 12:24:20.641577 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 577537us
W20260709 12:24:20.642757 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.661916 17637 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.661717 17483 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.663178 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.663779 15910 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.636988 17585 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.670359 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:20.671452 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.669483 16490 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:24:20.674315 17515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.011s
W20260709 12:24:20.674659 17515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.011s
I20260709 12:24:20.675370 15913 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:20.679162 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:20.695689 15838 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:20.700212 17562 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:20.701144 17562 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:20.701485 17562 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:20.702490 17562 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.703852 17562 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:20.708192 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.713287 17631 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.713847 17631 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:20.716738 17648 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:20.717592 17648 consensus_queue.cc:1243] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:20.718104 17648 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.718459 17648 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:20.719295 17648 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.720566 17648 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.722090 17631 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:20.722947 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:20.726022 15913 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:20.728144 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:20.729647 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:20.733553 15910 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:20.666267 17483 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:20.734735 15908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.021s	sys 0.039s
I20260709 12:24:20.735203 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:20.740339 15950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.021s	sys 0.025s
W20260709 12:24:20.740741 15950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.021s	sys 0.025s
W20260709 12:24:20.741166 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 574831us
W20260709 12:24:20.735381 15908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.021s	sys 0.039s
I20260709 12:24:20.668228 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:20.762434 15906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.023s
W20260709 12:24:20.762769 15906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.023s
I20260709 12:24:20.728749 17349 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:24:20.780011 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 114291us
I20260709 12:24:20.761744 17635 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:20.759562 17631 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:20.765005 17269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.001s	sys 0.017s
W20260709 12:24:20.807617 15876 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.794s (SENT)
W20260709 12:24:20.838016 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45652.6us
I20260709 12:24:20.842175 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:20.840816 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:20.843804 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:20.844707 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:20.851325 17580 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:20.851914 17580 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:20.769910 17578 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:20.846130 17612 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:20.856453 15835 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:20.854435 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:20.857633 15829 raft_consensus.cc:2376] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3. Re-sending same reply.
I20260709 12:24:20.861995 15832 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:20.865327 15837 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.776531 17642 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:24:20.783692 17431 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:24:20.841539 17631 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.859484 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:20.841101 17635 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:20.840206 17618 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:20.852864 17585 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:20.870286 17593 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:20.842877 17269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.002s	sys 0.017s
W20260709 12:24:20.873863 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 83985.6us
I20260709 12:24:20.857177 17591 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.855396 17634 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:20.888053 15952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.023s
W20260709 12:24:20.889597 15952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.008s	sys 0.023s
I20260709 12:24:20.846814 17350 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:20.871748 17515 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:20.842741 17632 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:24:20.874863 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 67282us
I20260709 12:24:20.874989 15986 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:20.875226 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:20.875901 15803 leader_election.cc:400] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:20.878773 17631 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:20.895509 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.892349 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 660284us
I20260709 12:24:20.910823 15910 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.888484 17583 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:20.894212 17600 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.914243 15913 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:20.901932 17588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.017s	sys 0.034s
W20260709 12:24:20.917649 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.925427 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:20.926023 15833 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.902503 17582 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.876809 17618 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:20.931782 15876 leader_election.cc:336] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.878s (SENT)
W20260709 12:24:20.921541 17588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.017s	sys 0.034s
I20260709 12:24:20.915098 17583 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:20.938669 15906 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:20.876525 17635 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.878505 17580 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.929435 17486 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.917583 17593 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:24:20.904682 17591 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.053637 15837 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:20.915517 17350 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:21.053742 15833 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:24:20.977741 17364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.004s	sys 0.026s
I20260709 12:24:20.932004 17582 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:20.925689 17600 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.087008 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:21.081779 17364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.004s	sys 0.026s
I20260709 12:24:21.096818 17350 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:21.097497 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 145850us
I20260709 12:24:21.120431 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:21.098291 15905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.057s	sys 0.073s
I20260709 12:24:21.052273 17486 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.128615 15836 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:21.093724 17578 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:21.130118 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.130704 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.131263 15876 leader_election.cc:336] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.901s (SENT)
I20260709 12:24:21.131783 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:21.083560 17588 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:24:21.125967 15905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.057s	sys 0.074s
I20260709 12:24:21.133162 17578 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:21.132588 17454 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:21.157793 17454 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:21.156144 17642 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:21.147086 15803 connection.cc:256] RPC call timeout handler was delayed by -1.7693696780002028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 12:24:21.165800 15803 connection.cc:256] RPC call timeout handler was delayed by -1.5697899400001916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 12:24:21.144768 17570 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.176478 15831 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:21.137580 17633 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:24:21.100502 17583 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:21.178033 15984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.014s	sys 0.027s
W20260709 12:24:21.198203 15984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.014s	sys 0.028s
I20260709 12:24:21.199579 15837 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:21.197721 17454 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:21.208052 17658 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:21.209120 17649 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:24:21.213179 17578 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.214287 17578 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.214346 17486 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:21.175590 17642 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.216408 17618 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:21.221971 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.202261 17623 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.225364 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.200836 17350 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:21.223649 17583 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:21.256170 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.221304 17618 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.224519 17642 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:21.249804 17586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.015s	sys 0.046s
W20260709 12:24:21.268651 17586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.015s	sys 0.046s
I20260709 12:24:21.282123 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:21.282485 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 359783us
I20260709 12:24:21.288033 15829 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:21.271957 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.291045 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:21.240466 17623 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.561474 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:21.444192 15876 leader_election.cc:336] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.230s (SENT)
W20260709 12:24:21.522346 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.456945 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 320036us
I20260709 12:24:21.599339 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:21.457194 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.379585 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:21.319350 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:21.477188 15980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.009s	sys 0.022s
I20260709 12:24:21.603459 15829 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:21.293001 17269 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.604568 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.561918 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.605406 15835 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:21.605890 15837 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:21.561733 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.319293 17600 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:21.604296 17269 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.619477 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.869987 15835 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:21.614073 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.727952 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.872295 15981 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:21.657611 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.868186 15833 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:21.705459 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:21.704749 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.529538 15831 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:21.717851 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.705119 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.704155 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:21.878732 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 434553us
W20260709 12:24:21.679008 15952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.020s	sys 0.036s
W20260709 12:24:21.879736 15952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.024s	sys 0.044s
I20260709 12:24:21.609757 15829 raft_consensus.cc:2410] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:24:21.765002 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.708545 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.319681 17668 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:21.883942 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:21.497980 17663 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.375s	user 0.003s	sys 0.000s
I20260709 12:24:21.318043 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:21.894207 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 576180us
W20260709 12:24:21.880580 15876 leader_election.cc:336] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.517s (SENT)
I20260709 12:24:21.895221 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:21.896449 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.896886 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.897379 15876 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.600s (SENT)
W20260709 12:24:21.897527 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.897761 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:21.301501 17634 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:21.441187 17665 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:24:21.894076 17588 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:21.898877 17317 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:21.907866 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 265) took 1394 ms. Trace:
I20260709 12:24:21.908113 17317 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.890561 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.909451 15986 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:21.909380 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:21.910022 15912 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:21.910308 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.911206 17628 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:21.908232 15834 rpcz_store.cc:276] 0709 12:24:20.512977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.513158 (+   181us) service_pool.cc:224] Handling call
0709 12:24:20.513469 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.513819 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.513843 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.514274 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.929578 (+415304us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.929620 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.929681 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.907691 (+978010us) raft_consensus.cc:1685] finished
0709 12:24:21.907712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.907814 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":634,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":414964,"threads_started":1,"wal-append.queue_time_us":686852}
I20260709 12:24:21.912001 17628 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.913331 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.914466 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.915479 15834 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:21.916402 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:21.745489 17631 consensus_meta.cc:287] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.829s	user 0.007s	sys 0.004s
I20260709 12:24:21.917870 17588 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.918114 17631 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.918601 17587 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.918437 17588 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:21.919099 17587 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.920276 17631 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:21.920568 17588 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:21.899637 17635 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:21.921550 17635 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.923988 17635 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:21.816668 17666 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
W20260709 12:24:21.926395 17578 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:24:21.290089 17591 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:21.619203 17648 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:21.857566 17623 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:21.929960 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 499) took 1048 ms. Trace:
I20260709 12:24:21.930617 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 194) took 1706 ms. Trace:
I20260709 12:24:21.895509 17586 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:24:21.932392 17583 consensus_meta.cc:287] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.662s	user 0.000s	sys 0.009s
I20260709 12:24:21.931035 16490 rpcz_store.cc:276] 0709 12:24:20.881864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.883039 (+  1175us) service_pool.cc:224] Handling call
0709 12:24:20.931369 (+ 48330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.154759 (+223390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.154806 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.155401 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.464561 (+309160us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.477432 (+ 12871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.929517 (+452085us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400660154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:21.929569 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.929617 (+    48us) raft_consensus.cc:1685] finished
0709 12:24:21.929632 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.929890 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519,"raft.queue_time_us":6723,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4990,"spinlock_wait_cycles":489219840,"thread_start_us":237345,"threads_started":1,"wal-append.queue_time_us":700102}
I20260709 12:24:21.892490 17600 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.934437 17600 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.931799 15907 rpcz_store.cc:276] 0709 12:24:20.224586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.404748 (+180162us) service_pool.cc:224] Handling call
0709 12:24:20.405231 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.405820 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.405860 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.406374 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.781101 (+374727us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:20.781137 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.781207 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.497395 (+716188us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:21.928279 (+430884us) raft_consensus.cc:1685] finished
0709 12:24:21.928299 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.928510 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":4628224,"thread_start_us":374336,"threads_started":1,"wal-append.queue_time_us":536466}
W20260709 12:24:21.817516 17662 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.689s	user 0.003s	sys 0.000s
I20260709 12:24:21.936568 17600 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:21.937577 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:21.938432 15909 raft_consensus.cc:2410] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:21.938961 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 191) took 1745 ms. Trace:
I20260709 12:24:21.940680 15831 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:21.433135 17619 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.941318 17619 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.943388 17619 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:21.268191 17350 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.790728 17582 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:21.945482 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.946481 17269 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:21.946794 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 236) took 1203 ms. Trace:
I20260709 12:24:21.948318 15829 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:21.947228 15980 rpcz_store.cc:276] 0709 12:24:20.743290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.760061 (+ 16771us) service_pool.cc:224] Handling call
0709 12:24:20.843540 (+ 83479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.883873 (+ 40333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.893499 (+  9626us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.937243 (+ 43744us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.603582 (+666339us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.603631 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.603717 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.946556 (+342839us) raft_consensus.cc:1685] finished
0709 12:24:21.946584 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.946708 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9747,"raft.queue_time_us":13634,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":13219,"thread_start_us":636366,"threads_started":1,"wal-append.queue_time_us":948280}
I20260709 12:24:21.766932 17334 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.949323 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.742770 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.950168 15829 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:21.950807 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.951103 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.320111 17642 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:21.899003 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.899150 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.899008 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.955391 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.955911 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.956386 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.956820 15981 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:21.957247 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:21.957448 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:21.957595 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:21.899456 15876 leader_election.cc:336] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.411s (SENT)
I20260709 12:24:21.958491 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:21.958851 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:21.959012 15981 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:21.959591 17334 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:21.960007 15981 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.960388 15981 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:21.960515 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61069.6us
I20260709 12:24:21.530700 17516 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:21.286949 17570 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.964608 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:21.965267 15911 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:21.966348 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:21.901330 15832 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:21.902289 15835 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:21.433053 17515 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.568284 17475 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.384534 17483 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.009s
I20260709 12:24:21.904467 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:21.889442 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 258) took 1684 ms. Trace:
I20260709 12:24:21.905947 17634 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.911290 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:21.732806 17562 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.028s	user 0.015s	sys 0.000s
I20260709 12:24:21.721915 17633 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:21.928457 17648 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:21.393355 17573 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.511s
I20260709 12:24:21.929390 17587 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:21.380210 17520 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.524s
I20260709 12:24:21.500051 17349 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:21.890705 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:21.983670 17483 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.011s	sys 0.015s
I20260709 12:24:21.951851 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.889405 15833 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:21.998159 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.998725 15833 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:21.978729 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:21.892225 15837 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:21.951408 15979 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.953358 15834 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:21.944816 15731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 274) took 5478 ms. Trace:
I20260709 12:24:21.953966 15982 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:21.954509 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.978856 17475 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.286819 17618 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:21.947628 17660 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:24:21.968434 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:21.969096 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:21.949782 17350 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:21.966387 17586 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:21.954471 17597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.007s	sys 0.008s
I20260709 12:24:21.961324 15981 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.966909 16496 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:21.972381 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.973830 15909 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:21.954491 17642 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:21.931380 17628 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:21.969946 15732 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.977752 17591 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:24:21.939414 15905 rpcz_store.cc:276] 0709 12:24:20.193963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.195646 (+  1683us) service_pool.cc:224] Handling call
0709 12:24:20.468393 (+272747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.547261 (+ 78868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.547298 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.547736 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.160191 (+612455us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:21.215311 (+ 55120us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.215517 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.215597 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.816064 (+600467us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:21.936103 (+120039us) raft_consensus.cc:1685] finished
0709 12:24:21.936216 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.938762 (+  2546us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400305550. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:21.938894 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75441,"prepare.queue_time_us":40491,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":78848,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":141,"spinlock_wait_cycles":669629568,"thread_start_us":595304,"threads_started":1,"wal-append.queue_time_us":719105}
I20260709 12:24:21.984333 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.978181 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.965159 17399 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:21.984222 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:21.988883 17334 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:21.984848 15830 rpcz_store.cc:276] 0709 12:24:20.204950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.205091 (+   141us) service_pool.cc:224] Handling call
0709 12:24:20.205436 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.205722 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.205750 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.560369 (+354619us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b2c00057528. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:24:20.590278 (+ 29909us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.908445 (+318167us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.908497 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.908564 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.529112 (+620548us) raft_consensus.cc:1685] finished
0709 12:24:21.529140 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.889361 (+360221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22940,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":3456384,"thread_start_us":308574,"threads_started":1,"wal-append.queue_time_us":654087}
I20260709 12:24:21.989001 17680 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:21.994608 15983 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:21.949527 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:21.996883 16487 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Advancing to term 3
I20260709 12:24:22.000212 17588 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:22.000568 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:21.977248 17431 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:21.972059 17570 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:21.963865 15829 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:21.977278 17516 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:21.978919 17515 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.000258 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:21.991029 17633 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.151520 15832 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:22.152346 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.152621 17516 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:22.153194 17633 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:21.991207 17636 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:22.154704 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.154659 17515 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:22.156244 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.123015 17655 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:22.157838 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:22.158631 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 174532us
I20260709 12:24:22.158918 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.159293 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:22.110766 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.159900 15836 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.155956 15831 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:22.123952 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 227945us
W20260709 12:24:22.160982 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 191980us
I20260709 12:24:22.161247 15833 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3.
I20260709 12:24:22.161793 15911 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:22.162981 15835 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.152779 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.200430 15832 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.200352 16460 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:22.201969 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.157506 17655 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.202785 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.205744 15837 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:22.207593 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.208287 15833 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:22.196063 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.197352 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:22.199630 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.200639 15913 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.209203 15908 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:22.210597 15835 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:22.212604 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:22.163306 17597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.008s	sys 0.012s
I20260709 12:24:22.203078 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.164731 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.216075 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:22.216084 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.054332 17520 consensus_queue.cc:1243] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:22.164259 15732 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 4, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 4 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:22.048326 15876 leader_election.cc:336] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.682s (SENT)
I20260709 12:24:22.224987 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:22.166226 17516 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:22.219225 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.194643 17317 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.154398 17636 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.165288 17587 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:22.221665 15838 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.204085 15983 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.100783 17269 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:22.227823 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.255812 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.218804 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.228835 15909 raft_consensus.cc:2393] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:22.257275 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.050328 17695 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:22.038640 17685 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:21.998654 17349 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:22.232098 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.039193 16490 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:22.268316 17681 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.233197 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.243498 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.165433 17680 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.269620 15834 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:22.270428 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.244709 15833 raft_consensus.cc:2410] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:22.270946 15834 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:22.271035 17680 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.244027 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.271793 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.272027 15836 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.272493 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.272985 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.273150 16490 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:22.273514 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:22.269224 15831 raft_consensus.cc:2410] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:22.274153 15980 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 1.
I20260709 12:24:22.274845 17349 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.275348 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:22.275830 17349 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.253722 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.276249 15980 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.277182 15953 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:22.277494 15829 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:22.165076 17337 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:24:22.282658 15908 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:22.257802 15837 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:22.280144 15834 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:22.281575 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:22.193327 15731 rpcz_store.cc:276] 0709 12:24:16.466599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.467189 (+   590us) service_pool.cc:224] Handling call
0709 12:24:21.944759 (+5477570us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:19.015322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:19.276726 (+261404us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:19.290846 (+ 14120us) write_op.cc:435] Acquired schema lock
0709 12:24:19.294966 (+  4120us) tablet.cc:662] Decoding operations
0709 12:24:19.389640 (+ 94674us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:19.389756 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:19.389781 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:24:19.390481 (+   700us) tablet.cc:701] Row locks acquired
0709 12:24:19.390544 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:24:19.390709 (+   165us) write_op.cc:270] Start()
0709 12:24:19.390847 (+   138us) write_op.cc:276] Timestamp: P: 1783599859390638 usec, L: 0
0709 12:24:19.390869 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:19.391561 (+   692us) log.cc:844] Serialized 2887 byte log entry
0709 12:24:20.183339 (+791778us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:20.680524 (+497185us) op_driver.cc:464] REPLICATION: finished
0709 12:24:20.686799 (+  6275us) write_op.cc:301] APPLY: starting
0709 12:24:20.686898 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:20.687148 (+   250us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:20.687180 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:20.688426 (+  1246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:20.688682 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:24:20.688748 (+    66us) write_op.cc:312] APPLY: finished
0709 12:24:20.689067 (+   319us) log.cc:844] Serialized 59 byte log entry
0709 12:24:20.763330 (+ 74263us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.777926 (+ 14596us) write_op.cc:454] Released schema lock
0709 12:24:20.784316 (+  6390us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:20.846402 (+ 62086us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.853263 (+  6861us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46161,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":6017,"apply.run_cpu_time_us":3281,"apply.run_wall_time_us":149816,"num_ops":7,"prepare.queue_time_us":372762,"prepare.run_cpu_time_us":34305,"prepare.run_wall_time_us":648399,"raft.queue_time_us":494478,"raft.run_cpu_time_us":1051,"raft.run_wall_time_us":11814,"replication_time_us":1289474,"spinlock_wait_cycles":32768896,"thread_start_us":685804,"threads_started":4,"wal-append.queue_time_us":311390,"wal-append.run_cpu_time_us":19325,"wal-append.run_wall_time_us":1988405}]]}
I20260709 12:24:22.265146 17695 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.265873 17685 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.266150 15803 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:22.266232 17655 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.267019 17642 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.269192 17475 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:22.273744 15836 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.225405 15732 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:22.278714 15829 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:22.279047 17635 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:22.262403 15907 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:24:22.260668 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 228) took 1995 ms. Trace:
I20260709 12:24:22.271816 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.283805 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.280745 15838 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.280805 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:22.284572 15987 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:22.256492 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:22.285200 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:22.274042 17688 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:22.228792 17633 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:22.254083 17587 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.228919 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.165637 17334 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.165544 17588 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.177477 17399 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.229022 17684 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:22.165091 17586 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.243043 17431 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:22.350802 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.327167 15907 pending_rounds.cc:85] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 4
I20260709 12:24:22.327049 15831 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:22.330487 15905 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:22.329165 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.244812 17682 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:22.330103 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:22.336944 17337 consensus_queue.cc:1243] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:22.330511 15833 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:22.279562 17520 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:24:22.338601 17702 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:22.282670 17619 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.222231 17632 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:24:22.279624 17687 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.327764 15984 rpcz_store.cc:276] 0709 12:24:20.264962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.265090 (+   128us) service_pool.cc:224] Handling call
0709 12:24:20.265390 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.265665 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.265697 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.275587 (+  9890us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.198676 (+923089us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.198732 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.198824 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.947051 (+748227us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:22.244954 (+297903us) raft_consensus.cc:1685] finished
0709 12:24:22.244974 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.260596 (+ 15622us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48425,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4493,"spinlock_wait_cycles":300866816,"thread_start_us":909255,"threads_started":1,"wal-append.queue_time_us":1178390}
I20260709 12:24:22.268783 17681 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.346177 15834 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:22.348405 15838 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:22.327765 15908 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:22.352030 15907 pending_rounds.cc:107] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:24:22.286721 17350 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.353502 15904 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:22.326258 17633 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:22.333541 17694 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:22.335156 17587 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.378921 17628 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.359275 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:22.314082 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:22.410336 15988 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:22.413502 15838 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:22.392252 17687 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.361917 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.329334 15837 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.360100 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.371085 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.421131 16496 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:22.421370 15911 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.365931 17431 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.374864 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.259351 17317 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:22.331748 15732 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 3 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:22.260277 17516 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.380482 15983 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:22.430580 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.431412 15838 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 1.
I20260709 12:24:22.333165 17680 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:22.344491 17684 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.287415 17269 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.345521 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.367774 17682 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.395890 15907 raft_consensus.cc:2889] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:22.337374 17635 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.343292 16486 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:22.366250 17648 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:22.406195 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.428131 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:22.400440 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 196432us
I20260709 12:24:22.356688 15835 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:22.395581 17642 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.331120 15987 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:22.409839 17696 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:24:22.408547 17632 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.408212 17694 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:22.428179 15837 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:22.432796 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.429497 15732 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:22.471987 17570 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.392603 17619 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.423938 17687 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.483346 15912 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:22.359140 15836 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.465109 17684 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.497231 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.497380 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:22.498029 15835 pending_rounds.cc:85] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 1
W20260709 12:24:22.503895 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.530454 16496 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:22.530773 15835 pending_rounds.cc:107] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 12:24:22.530939 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.531118 15835 raft_consensus.cc:2889] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:22.501955 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 453659us
W20260709 12:24:22.513963 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 247883us
I20260709 12:24:22.470220 15911 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:22.516301 15732 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:22.537324 15732 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 4, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 4 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:22.473621 17520 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:22.482136 17682 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.392791 17702 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.466209 17680 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.540508 16494 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:22.541293 15732 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:22.551453 15732 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:22.552765 15732 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:22.554157 15732 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 5, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 5 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:22.545181 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.505170 17350 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:22.547657 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 266905us
I20260709 12:24:22.520630 17694 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.556578 17350 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.558650 17586 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.558743 17350 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.559720 15910 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:22.560422 17688 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:22.560875 17688 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.561286 15910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:22.562598 15910 raft_consensus.cc:606] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:22.567016 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.566803 15910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:22.568109 15910 raft_consensus.cc:606] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:22.568451 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.568807 15910 raft_consensus.cc:614] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:22.572355 17688 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.572535 15910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:22.572420 17694 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.573845 15910 raft_consensus.cc:606] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:22.574607 15910 raft_consensus.cc:614] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:22.576561 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:22.578841 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:22.578086 17694 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.580643 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.584867 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.585500 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:22.585641 15904 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:22.586047 15907 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.542515 17520 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:22.592300 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 55902.8us
W20260709 12:24:22.594298 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 97013.4us
I20260709 12:24:22.657965 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:22.677263 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:22.679736 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.538729 17695 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.543473 17716 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.654908 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:22.690405 15911 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:22.470991 17633 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.365367 17623 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:24:22.697322 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.689100 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 152382us
I20260709 12:24:22.670463 17685 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.706496 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:22.703032 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 167513us
W20260709 12:24:22.708566 15876 leader_election.cc:336] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.844s (SENT)
I20260709 12:24:22.709002 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:22.700892 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:24:22.713019 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 166335us
W20260709 12:24:22.721002 15876 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.915s (SENT)
W20260709 12:24:22.721907 15876 leader_election.cc:336] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.942s (SENT)
I20260709 12:24:22.722389 17431 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:22.722647 15876 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.950s (SENT) [suppressed 30 similar messages]
W20260709 12:24:22.723318 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.689010 17588 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.729576 15835 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:22.693397 17350 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.693588 17717 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:22.693744 17399 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:22.693897 17334 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.700700 17708 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:22.726763 17698 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 12:24:22.725239 17597 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.720671 17570 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:22.725802 17695 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.700876 17583 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:22.737151 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:22.744661 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 60590.7us
W20260709 12:24:22.744689 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 65920us
W20260709 12:24:22.751995 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44342.9us
I20260709 12:24:22.698165 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.701076 17655 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:24:22.762724 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:22.780584 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.787959 15837 raft_consensus.cc:2393] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 2: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:22.705814 17475 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:22.767498 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.752820 17704 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 12:24:22.780102 15835 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.789009 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:22.730491 17685 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:22.753968 17708 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.763965 17597 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.800866 15831 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.786332 17516 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.768275 17695 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:22.892832 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.876982 17707 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 12:24:22.870267 15952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.026s	sys 0.013s
I20260709 12:24:22.860831 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:22.860091 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 116022us
W20260709 12:24:22.897773 15952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.028s	sys 0.013s
W20260709 12:24:22.897387 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 127472us
I20260709 12:24:22.790946 17681 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:22.803241 17475 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.880505 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:22.885279 17269 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.736308 17520 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.871629 17597 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.861943 17317 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:22.731208 17716 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:24:22.871090 17708 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.880069 17719 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:22.879935 17431 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:22.879639 17515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.020s	sys 0.033s
I20260709 12:24:22.743047 17717 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:22.799036 17454 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:24:22.856792 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:22.921903 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:22.895639 17695 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.923919 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:22.891299 17635 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:22.900447 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:22.926462 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:22.928165 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.910099 17723 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:24:22.937784 17520 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.923130 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.858072 17732 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:24:22.942740 17719 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:22.947623 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:22.949587 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.947397 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.958870 15952 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:22.935328 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.936471 17730 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:22.964561 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 107896us
I20260709 12:24:22.960198 17269 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:22.938843 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 402780us
I20260709 12:24:22.968115 17702 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:22.974792 17709 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:24:22.962575 17583 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:22.928838 17735 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:24:22.956512 17515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.020s	sys 0.033s
W20260709 12:24:22.967751 17721 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:24:22.982661 15803 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:22.938308 17680 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:22.993134 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.034372 16489 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:22.970599 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:22.985729 17269 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:22.956758 17431 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:22.975013 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:22.972078 17619 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.026548 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:22.968961 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 63048.5us
I20260709 12:24:22.973939 17719 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.984820 17588 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 12:24:23.051185 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 68634us
I20260709 12:24:22.985957 17718 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.996384 17487 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:23.058522 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.062621 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 504) took 1085 ms. Trace:
W20260709 12:24:23.051119 17720 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:24:23.063687 16495 rpcz_store.cc:276] 0709 12:24:21.972794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.972914 (+   120us) service_pool.cc:224] Handling call
0709 12:24:21.977512 (+  4598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.380076 (+402564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.380108 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.380144 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:22.380172 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.057494 (+677322us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400494154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.057551 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.057697 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925389568}
I20260709 12:24:23.069414 17487 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.042398 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.042773 17269 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:23.055511 17715 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:24:23.060891 16486 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 2: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:23.076890 17487 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.078179 17588 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:23.078224 17591 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:23.090708 16492 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:23.105533 17431 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.106890 17269 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:23.081910 17349 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 12:24:23.082738 17475 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.111358 17269 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:23.113582 17642 consensus_meta.cc:287] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 12:24:23.122617 17597 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.123255 17718 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.123520 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1376) took 1123 ms. Trace:
I20260709 12:24:23.081444 17708 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.126765 17708 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.131088 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 240) took 1190 ms. Trace:
W20260709 12:24:23.084239 17739 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:24:23.139743 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 141018us
I20260709 12:24:23.086680 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:23.058226 17702 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:23.076169 17734 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:24:23.051434 17680 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:22.992009 17730 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.108332 17487 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.124038 15984 rpcz_store.cc:276] 0709 12:24:22.000360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.393188 (+392828us) service_pool.cc:224] Handling call
0709 12:24:22.393494 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.502163 (+108669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.502200 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.502243 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:22.502275 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.123258 (+620983us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400206054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.123300 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.123449 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249511168}
W20260709 12:24:23.083634 16487 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.906s	user 0.008s	sys 0.000s
I20260709 12:24:23.086747 15907 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:23.093686 16488 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 1 LEARNER]: Advancing to term 3
I20260709 12:24:23.098366 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2223) took 1201 ms. Trace:
I20260709 12:24:23.131580 15985 rpcz_store.cc:276] 0709 12:24:21.941018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.994644 (+ 53626us) service_pool.cc:224] Handling call
0709 12:24:22.011762 (+ 17118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.366618 (+354856us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:22.391878 (+ 25260us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.524358 (+132480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.524404 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:22.524438 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.130808 (+606370us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54003147d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.130862 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.131020 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28068,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":10514,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5913,"spinlock_wait_cycles":815581056,"thread_start_us":132175,"threads_started":1,"wal-append.queue_time_us":301518}
W20260709 12:24:23.147054 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 165772us
W20260709 12:24:23.151031 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 64430.2us
I20260709 12:24:23.094098 17618 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:23.100896 17587 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.003s
W20260709 12:24:23.152956 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.104182 17684 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.002s
W20260709 12:24:23.100824 15979 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.869s	user 0.003s	sys 0.003s
I20260709 12:24:23.159216 15984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43658
I20260709 12:24:23.166461 15984 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:23.156270 15832 rpcz_store.cc:276] 0709 12:24:21.896607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.217591 (+320984us) service_pool.cc:224] Handling call
0709 12:24:22.218121 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.218617 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.218659 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.231688 (+ 13029us) log.cc:844] Serialized 26 byte log entry
0709 12:24:22.457053 (+225365us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:22.457093 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.457156 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.098162 (+641006us) raft_consensus.cc:1685] finished
0709 12:24:23.098183 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.098311 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4997,"raft.queue_time_us":100,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":188909,"threads_started":1,"wal-append.queue_time_us":431202}
I20260709 12:24:23.092348 17717 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:23.164294 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.169011 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.169418 17730 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.170570 17587 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.171953 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.173285 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:23.160533 17687 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.000s
I20260709 12:24:23.151137 17680 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:23.159462 17349 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:23.177959 17349 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:23.178385 17487 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.178561 17719 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.178354 17349 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.093055 17588 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.180590 17719 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.180771 17588 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.094334 17591 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.182189 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1377) took 1181 ms. Trace:
I20260709 12:24:23.182551 15982 rpcz_store.cc:276] 0709 12:24:22.000608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.393755 (+393147us) service_pool.cc:224] Handling call
0709 12:24:22.394075 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.695011 (+300936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.695038 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.695076 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:22.695106 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.181602 (+486496us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54003160d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.181643 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.182137 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691668352}
I20260709 12:24:23.183545 17591 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.166067 15979 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:23.184549 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 815) took 1245 ms. Trace:
I20260709 12:24:23.184861 15979 rpcz_store.cc:276] 0709 12:24:21.939578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.950564 (+ 10986us) service_pool.cc:224] Handling call
0709 12:24:23.184492 (+1233928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.185217 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1375) took 1185 ms. Trace:
I20260709 12:24:23.185930 17684 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.188102 17684 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:22.379734 17582 consensus_queue.cc:1175] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "761f08e40cdf4af396105d67949c0afc" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 1 index: 1 } }
I20260709 12:24:23.188211 17349 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.188773 15983 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:23.088092 17648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.018s
I20260709 12:24:23.173532 15830 raft_consensus.cc:2368] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:23.176522 17687 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.153065 17635 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.172744 17587 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.167660 16487 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:23.164851 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 115068us
I20260709 12:24:23.151609 17597 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.185693 15986 rpcz_store.cc:276] 0709 12:24:21.999904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.369245 (+369341us) service_pool.cc:224] Handling call
0709 12:24:22.369536 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.466359 (+ 96823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.466404 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.466464 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:22.466507 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.184935 (+718428us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b54000933d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.184974 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.185133 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222104448}
W20260709 12:24:23.189267 17648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.003s	sys 0.018s
I20260709 12:24:23.149089 17461 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:23.195022 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43658 (request call id 80) took 1279 ms. Trace:
I20260709 12:24:23.193800 16486 raft_consensus.cc:2368] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
W20260709 12:24:23.198526 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.199677 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:23.253264 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60421.9us
I20260709 12:24:23.252426 15984 rpcz_store.cc:276] 0709 12:24:21.921355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.152709 (+1231354us) service_pool.cc:224] Handling call
0709 12:24:23.166857 (+ 14148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.255892 15952 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.255725 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.259755 16494 raft_consensus.cc:2368] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:23.259312 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 505) took 1267 ms. Trace:
W20260709 12:24:23.261368 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.270844 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.276160 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.194334 17680 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:24:23.281404 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.278172 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:23.223908 17684 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:23.258742 17735 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.279381 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2122) took 1020 ms. Trace:
I20260709 12:24:23.290566 17648 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.289443 15909 rpcz_store.cc:276] 0709 12:24:22.259000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.259111 (+   111us) service_pool.cc:224] Handling call
0709 12:24:22.325565 (+ 66454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.482576 (+157011us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:22.672634 (+190058us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.938448 (+265814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.938501 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:22.938560 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.279170 (+340610us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001536d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.279223 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.279331 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18357,"prepare.queue_time_us":55551,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":124,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12887,"spinlock_wait_cycles":360533376,"thread_start_us":421618,"threads_started":2,"wal-append.queue_time_us":366542}
I20260709 12:24:23.282552 15832 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.293221 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.294137 17648 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.259544 17591 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.283689 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:23.284343 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.295616 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.296519 17648 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.258361 17702 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:23.297323 17702 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.298537 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.299206 17702 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.258590 17730 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.299469 17648 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.299727 15832 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:23.299983 17730 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.260568 17717 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:24:23.283524 15876 leader_election.cc:336] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.502s (SENT)
I20260709 12:24:23.302525 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.260941 17716 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.260269 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:23.260149 17588 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.276480 16495 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:23.301806 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:23.304807 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44617.9us
I20260709 12:24:23.288172 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.260776 17636 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:23.307466 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.305747 15912 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:23.312718 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.261852 17685 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:23.300642 17597 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:23.314177 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.334900 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.336148 15803 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.313824 17636 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:23.316465 17763 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.315074 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:23.303107 17735 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:23.322597 17682 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.000s
I20260709 12:24:23.324316 17687 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.314392 17520 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:23.314389 15876 leader_election.cc:336] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.090s (SENT)
I20260709 12:24:23.327483 17349 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.271272 16487 rpcz_store.cc:276] 0709 12:24:21.987520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.996293 (+  8773us) service_pool.cc:224] Handling call
0709 12:24:21.996628 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.193850 (+1197222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.255062 (+ 61212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.344846 17636 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.368557 17636 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.310747 17716 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.345899 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:23.346396 17648 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.369290 16488 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.347421 17730 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.347536 17487 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:23.373756 17487 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:23.374883 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.374938 17487 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.377192 17685 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.348515 15803 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.376753 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.359879 17520 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:23.349354 17587 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.347419 17763 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.350948 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:23.370425 17350 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:23.348984 17695 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.385905 17350 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.387528 17695 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.387859 17350 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.388411 17520 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.360037 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:23.389433 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 79769.3us
W20260709 12:24:23.390290 15876 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.779s (SENT)
I20260709 12:24:23.312814 17708 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.352654 17682 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.394315 17708 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.394898 17708 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:23.395536 17682 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.363417 15984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43658
I20260709 12:24:23.396204 15984 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:23.364058 17349 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:23.360387 17756 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:23.360694 17597 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:23.366962 17735 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.373073 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.405369 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.378952 17685 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.380115 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:23.348532 17722 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.381198 17636 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.379344 17717 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:24:23.412631 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:23.383545 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1381) took 1159 ms. Trace:
I20260709 12:24:23.413708 15912 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:23.414095 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:23.414644 15907 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.414525 17350 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.415505 17350 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.412771 17597 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.415962 17350 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:23.418428 17688 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.418696 17724 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.419219 17724 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:23.419651 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:23.420325 16486 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.409149 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:23.421826 15908 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:23.410265 15953 leader_election.cc:400] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:23.428061 15953 leader_election.cc:403] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:23.412659 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:23.413558 15983 rpcz_store.cc:276] 0709 12:24:22.224245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.430464 (+206219us) service_pool.cc:224] Handling call
0709 12:24:22.430829 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.189181 (+758352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.383315 (+194134us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400165b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:23.383487 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742560640}
I20260709 12:24:23.383631 17716 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.429307 17716 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:23.429768 17716 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:23.429813 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.431125 17762 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.432029 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.432700 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.433250 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.456257 15829 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:23.455353 15837 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:23.384229 17730 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.442420 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.430730 17716 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.455305 15835 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:23.457157 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.457461 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.461438 17681 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.454334 17350 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.462451 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.462647 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.458590 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.463824 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:23.464200 15829 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:23.465001 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.465085 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:23.465943 17619 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.456477 17695 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:24:23.467338 17619 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.467562 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.467684 17619 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:23.468029 17695 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:23.461699 17708 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:23.463941 17694 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:23.469723 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:23.475216 15953 leader_election.cc:400] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:23.475620 15953 leader_election.cc:403] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:23.477717 15836 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:23.441622 16488 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:23.480867 15835 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:23.482734 15907 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:23.486927 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:23.486980 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.456874 17717 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.491568 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.468618 17695 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:23.420254 17724 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.489540 15836 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:23.488579 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:23.494269 15831 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:23.498029 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:23.498458 15836 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.475240 17694 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:23.501863 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.504863 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.504738 15834 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:23.506364 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.468699 17619 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.493422 17632 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.469334 17349 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:24:23.496816 17680 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:23.513689 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:23.519953 15835 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.518064 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:23.521624 15832 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:23.521852 15831 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:23.502812 17515 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:23.532845 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 65844.8us
I20260709 12:24:23.534015 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.515266 17687 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:23.509999 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 251) took 1283 ms. Trace:
W20260709 12:24:23.545861 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.556314 15980 rpcz_store.cc:276] 0709 12:24:22.227058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.100610 (+873552us) service_pool.cc:224] Handling call
0709 12:24:23.100973 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.106348 (+  5375us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:23.189089 (+ 82741us) log.cc:844] Serialized 14 byte log entry
0709 12:24:23.483825 (+294736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.485246 (+  1421us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:23.497522 (+ 12276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.501359 (+  3837us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.508223 (+  6864us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86590,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":45748,"raft.queue_time_us":5879,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":5149,"thread_start_us":323569,"threads_started":2,"wal-append.queue_time_us":271292}
I20260709 12:24:23.532265 16493 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.528816 17349 consensus_queue.cc:1243] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:23.525671 17515 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:23.564062 15835 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:23.566198 15950 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:23.566469 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1340) took 1624 ms. Trace:
I20260709 12:24:23.534478 17722 raft_consensus.cc:2764] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:24:23.568049 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.572175 15830 rpcz_store.cc:276] 0709 12:24:21.942367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.207240 (+264873us) service_pool.cc:224] Handling call
0709 12:24:23.566335 (+1359095us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540033ccd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:23.566425 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081563904}
I20260709 12:24:23.572991 17694 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.541478 17708 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.577921 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.580016 15836 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:23.539366 17680 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:23.621594 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82551.7us
I20260709 12:24:23.622288 17680 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:23.623186 17772 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:23.534446 17755 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:23.558806 17687 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:23.626983 17349 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.628338 17583 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:23.568095 17619 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.572057 17515 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.601653 17636 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:23.643028 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 168824us
I20260709 12:24:23.569511 17681 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:24:23.639871 17687 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.643035 17636 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:23.703166 17775 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 12:24:23.686355 17695 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.689364 17636 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:23.711007 17711 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 1.026s	user 0.005s	sys 0.003s
I20260709 12:24:23.709347 17755 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:23.710150 17776 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.712890 17685 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.707768 16486 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:23.704093 17778 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:23.736310 17773 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:23.711658 17520 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.738353 17520 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.738408 17633 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.740566 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:23.724238 17431 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.722886 17695 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:23.725266 17755 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:23.748062 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.749080 17714 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.061s	user 0.002s	sys 0.003s
I20260709 12:24:23.756335 15981 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.757524 15835 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:23.755801 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:23.772915 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 817) took 1832 ms. Trace:
I20260709 12:24:23.733300 17778 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:23.773300 15981 rpcz_store.cc:276] 0709 12:24:21.940128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.959599 (+ 19471us) service_pool.cc:224] Handling call
0709 12:24:21.959876 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.525477 (+565601us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000e54a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc218a1d 00007f03cc1ff1a4 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419
0709 12:24:23.749876 (+1224399us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54000e54a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc218a1d 00007f03cc1ff1a4 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419
0709 12:24:23.766200 (+ 16324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.766227 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.772634 (+  6407us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:23.772683 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.772753 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.772865 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8782,"spinlock_wait_cycles":1971562624}
I20260709 12:24:23.772850 17591 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:23.790506 17591 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.751238 17431 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.766904 17583 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:23.793479 17583 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:23.794397 17727 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.702s	user 0.005s	sys 0.005s
I20260709 12:24:23.763751 17708 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:23.813536 17708 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.815531 17708 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.815994 17708 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:23.816416 17708 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.817291 17588 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.817773 17588 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.819511 17694 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.820484 17588 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.775668 17778 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.828981 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.832257 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.832964 15910 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:23.833900 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.761240 17695 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:23.835639 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 270815us
I20260709 12:24:23.801261 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.804548 17619 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.800758 17431 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.806304 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2134) took 1391 ms. Trace:
I20260709 12:24:23.838703 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.839123 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.806944 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.841095 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.810986 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.812191 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.812846 17642 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:23.817821 17636 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.849469 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:23.852032 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.852303 15988 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:23.852677 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.854069 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.794416 17583 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.733685 17776 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.836478 15908 raft_consensus.cc:2368] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:23.842432 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.842469 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:23.843415 15981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43658
I20260709 12:24:23.838187 15906 rpcz_store.cc:276] 0709 12:24:22.414545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.425319 (+ 10774us) service_pool.cc:224] Handling call
0709 12:24:22.425674 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.426074 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.426112 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.469077 (+ 42965us) log.cc:844] Serialized 26 byte log entry
0709 12:24:22.589954 (+120877us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:22.589989 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.590059 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.793880 (+1203821us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:23.806015 (+ 12135us) raft_consensus.cc:1685] finished
0709 12:24:23.806038 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.806244 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2627,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":13123,"spinlock_wait_cycles":29403904,"thread_start_us":67434,"threads_started":1,"wal-append.queue_time_us":553760}
I20260709 12:24:23.820971 17588 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.863315 15909 raft_consensus.cc:2368] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:23.865988 17588 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.856500 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:23.866824 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.867370 16492 raft_consensus.cc:2376] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4. Re-sending same reply.
I20260709 12:24:23.835489 17684 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:23.854987 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:23.871369 15984 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:23.875116 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.876027 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.877395 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.854048 17632 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:23.879081 15910 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:23.877954 15908 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:23.881124 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:23.881789 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:23.882504 15985 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 2: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:23.864564 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:23.863638 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.847360 17582 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:24:23.840123 17763 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:24:23.891072 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.887495 17755 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:23.845642 17619 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.893563 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.900226 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:23.901258 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.903704 15985 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:23.853878 17642 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.904978 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.883587 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:23.888547 17736 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:23.908481 17718 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:23.893589 17789 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.878296 17684 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.914970 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:23.895210 17588 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:23.922608 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.923996 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.925642 15803 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:23.925907 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.926833 17735 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.929098 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:23.930599 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:23.930685 17768 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:24:23.932507 15986 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.913352 17718 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:23.942116 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.942178 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.919247 17736 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:23.939983 15987 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.943569 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:23.939072 17780 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:23.946619 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:23.947443 15987 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.933990 17790 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.950601 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.943639 17783 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.951143 15908 pending_rounds.cc:85] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 2
I20260709 12:24:23.952601 17783 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.953869 17783 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:23.954244 17783 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.954449 17619 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.944890 17717 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:23.952098 15908 pending_rounds.cc:107] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:23.959520 15908 raft_consensus.cc:2889] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.951385 17334 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.961139 17334 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:23.951465 17791 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:24:23.961925 17792 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.963096 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:23.968720 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:23.969772 15986 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:23.969540 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.970633 17776 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:23.970841 17736 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:23.971194 17776 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:23.972575 17776 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.974951 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.980500 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.956233 17789 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.973930 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.977871 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:23.981956 16460 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.969394 15985 raft_consensus.cc:2376] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4. Re-sending same reply.
I20260709 12:24:24.016678 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:23.953019 17708 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.017613 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:24.019140 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:24.021183 17717 raft_consensus.cc:2764] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:24:24.022729 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48890.1us
I20260709 12:24:24.023286 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.023584 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:24.011627 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:23.998581 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.982776 17744 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.982848 17776 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:23.982487 17735 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.982712 17757 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.024745 17399 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.982990 17718 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:23.962762 17619 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.028398 15952 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:23.973105 17695 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:24.036407 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72370.6us
I20260709 12:24:24.041002 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.031203 17776 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.029731 17722 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:23.961963 17334 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.043306 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.043880 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:23.983575 17636 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.053136 17682 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.031626 17717 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:24.057621 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.059366 15952 leader_election.cc:400] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:24.059720 15986 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:24.039646 17684 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:24.056519 17619 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.084198 15952 leader_election.cc:400] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:24.089972 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:24.123225 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 311104us
W20260709 12:24:24.126022 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 68464.4us
I20260709 12:24:24.126832 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.061503 17722 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:24.060798 17588 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.126818 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:24.064752 17718 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:24.131480 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.131255 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.123420 17642 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:24.133814 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.067909 17334 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.127156 17684 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:24.139066 15802 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.140753 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.141450 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.142532 15837 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:24.142611 17793 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:24:24.142807 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.143545 15834 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:24.144337 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.144932 15906 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 1.
I20260709 12:24:24.145982 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.146572 15906 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:24.147365 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:24.148285 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.150640 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:24.151710 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.155768 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.147907 17515 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.157119 15834 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.157239 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.161665 15836 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:24.161921 15837 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:24.160380 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.129083 17623 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.160219 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.161005 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.131904 17682 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.170380 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.163185 15829 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:24.159055 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.134251 17795 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.133688 17708 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:24.137348 17790 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.165845 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.167729 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.175837 15830 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:24.169281 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:24.127939 17461 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:24.140795 17792 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.179391 15904 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:24.140713 17684 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:24.163425 17621 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.186401 15952 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.144917 17591 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.159555 17736 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.184701 17783 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:24.175415 17680 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.194828 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:24.188113 17684 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.145028 17722 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.198128 17797 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:24.194701 17736 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:24.201171 15912 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:24.174067 17795 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:24.185813 17695 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:24.211941 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.213945 17755 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:24.191237 17708 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.229214 17795 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.220489 17724 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.232784 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:24.245539 15905 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:24.173767 17794 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:24:24.246925 17794 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:24.247238 17794 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:24.247790 17790 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.248005 17794 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.249495 17776 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.251199 17684 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.251813 15986 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.254082 15980 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:24.254163 15988 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:24.256870 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.206308 17591 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:24.260279 15986 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.200822 15979 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:24.194417 17682 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:24.233906 17580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:24:24.224490 17736 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.278113 17642 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:24.270701 17803 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.070s	user 0.004s	sys 0.000s
I20260709 12:24:24.235383 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 816) took 2287 ms. Trace:
I20260709 12:24:24.285526 15987 rpcz_store.cc:276] 0709 12:24:21.939861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.958378 (+ 18517us) service_pool.cc:224] Handling call
0709 12:24:21.958709 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.284469 (+325760us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000e3ba0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc21adc0 00007f03cc2a51c0 00007f03cc2a6231 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c
0709 12:24:23.561771 (+1277302us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b54000e3ba0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc22106f 00007f03cc299f60 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62
0709 12:24:23.939676 (+377905us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b54000e3ba0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc220520 00007f03cc299f70 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62
0709 12:24:24.226902 (+287226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:24.226936 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:24.226970 (+    34us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:24.226997 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.227149 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.227240 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17824,"raft.queue_time_us":18167,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":5411,"spinlock_wait_cycles":638752384}
I20260709 12:24:24.283326 17642 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:24.262804 17591 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:24.284653 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.276358 17776 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.263526 17794 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.271365 17682 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.225970 17680 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.274634 17431 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:24.316604 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 122893us
I20260709 12:24:24.290154 17483 raft_consensus.cc:3055] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.272650 17778 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.349349 15985 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:24.349834 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.359838 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.290337 17783 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.315340 17591 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.317591 17515 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:24.317879 17682 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.367657 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.378659 15907 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.379438 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:24.367336 17768 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:24.354163 17483 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:24.365691 17796 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:24.392863 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.389699 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.397698 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:24.398310 15987 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:24.399375 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:24.401911 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.353873 17431 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.407352 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.382515 17802 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.414358 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.428954 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.429661 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.396051 17783 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.435736 17520 raft_consensus.cc:1064] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:24.413125 17642 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.396358 17334 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.437884 17778 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.439919 15981 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:24.440874 17783 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:24.441162 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:24.441836 15981 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:24.442883 15981 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.444392 15833 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.430809 17805 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:24.431509 17801 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:24:24.432344 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:24.438128 17520 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.456310 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.394109 17515 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.399057 17684 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.457762 17515 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:24.458196 17515 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.460479 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.461652 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.462570 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:24.453388 17806 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:24:24.476302 15909 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:24.417572 17796 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.417582 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:24.490317 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73104.6us
I20260709 12:24:24.490049 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.508858 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.512837 15833 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:24.515384 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.516989 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.500469 17805 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.494890 17796 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:24.487650 17515 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:24.561687 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.554487 17716 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.557752 17722 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:24.554843 17763 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.563766 17796 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.591681 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:24.595738 15909 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:24.583618 16486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.018s	sys 0.028s
I20260709 12:24:24.558779 17680 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.597400 15986 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:24.609113 17754 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:24.600447 16486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.018s	sys 0.028s
I20260709 12:24:24.501003 17483 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.585516 17805 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:24.615576 17483 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.625360 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.623890 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:24.628764 17791 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.633939 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:24.637866 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.587646 17802 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:24:24.640702 17802 consensus_queue.cc:1243] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:24.641407 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.599365 17722 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:24.622174 17805 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.644711 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.644763 15982 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:24.637573 17783 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.632725 17791 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:24.648898 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.652087 15837 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:24.653008 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.653618 15837 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:24.654994 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.656725 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.659452 17722 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.666085 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.667793 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.668941 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.672093 15837 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:24.672212 15904 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:24.673554 15904 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:24.675876 15909 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:24.677335 15904 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:24.645726 17716 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:24.678634 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:24.679436 17718 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.542s	user 0.005s	sys 0.005s
I20260709 12:24:24.672102 17783 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:24.686141 17269 raft_consensus.cc:993] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:24.646229 17805 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.648450 17763 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.632884 17736 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.697424 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.699656 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.700690 15837 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:24.702673 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.692878 17792 consensus_meta.cc:287] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.507s	user 0.004s	sys 0.002s
I20260709 12:24:24.705904 17269 raft_consensus.cc:1081] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:24.706466 17783 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.707095 17591 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.707509 17791 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.719440 17791 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:24.708087 17789 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.678s	user 0.004s	sys 0.005s
I20260709 12:24:24.711483 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:24.713095 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.717724 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.724483 15837 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
W20260709 12:24:24.726370 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.753436 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.737862 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.738013 17682 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.758054 17682 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.759661 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.760689 17586 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:24.737525 17580 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.761206 17586 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.761747 17586 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.720914 17792 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.722182 17811 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.763301 17483 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.769325 15980 raft_consensus.cc:2368] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:24.736269 17789 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.775199 15906 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:24.774586 17736 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:24.779951 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:24.780381 17588 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.001s
I20260709 12:24:24.789743 15908 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:24.784301 17588 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.792613 15909 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:24.798636 15732 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 278) took 4783 ms. Trace:
I20260709 12:24:24.799649 17796 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.802469 15909 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.801882 15908 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 3. Ops: []
I20260709 12:24:24.722939 17718 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:24.801203 15732 rpcz_store.cc:276] 0709 12:24:20.021348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.052103 (+ 30755us) service_pool.cc:224] Handling call
0709 12:24:24.798574 (+4746471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:22.875995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:22.992775 (+116780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:22.994875 (+  2100us) write_op.cc:435] Acquired schema lock
0709 12:24:23.023021 (+ 28146us) tablet.cc:662] Decoding operations
0709 12:24:23.114395 (+ 91374us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:23.114481 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:23.114521 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:24:23.115828 (+  1307us) tablet.cc:701] Row locks acquired
0709 12:24:23.115849 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:24:23.116026 (+   177us) write_op.cc:270] Start()
0709 12:24:23.116163 (+   137us) write_op.cc:276] Timestamp: P: 1783599863115975 usec, L: 0
0709 12:24:23.116187 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:23.117019 (+   832us) log.cc:844] Serialized 4369 byte log entry
0709 12:24:23.712950 (+595931us) op_driver.cc:464] REPLICATION: finished
0709 12:24:23.777100 (+ 64150us) write_op.cc:301] APPLY: starting
0709 12:24:23.777193 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:23.777462 (+   269us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:23.777575 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:23.778831 (+  1256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:23.779062 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:24:23.779112 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:23.781238 (+  2126us) log.cc:844] Serialized 83 byte log entry
0709 12:24:23.781421 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.781555 (+   134us) write_op.cc:454] Released schema lock
0709 12:24:23.781605 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.848936 (+ 67331us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.850230 (+  1294us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12584,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":56909,"apply.run_cpu_time_us":3341,"apply.run_wall_time_us":59780,"num_ops":11,"prepare.queue_time_us":197945,"prepare.run_cpu_time_us":8834,"prepare.run_wall_time_us":396409,"raft.queue_time_us":270823,"raft.run_cpu_time_us":13177,"raft.run_wall_time_us":129321,"replication_time_us":569865,"thread_start_us":414662,"threads_started":4,"wal-append.queue_time_us":156805,"wal-append.run_cpu_time_us":16561,"wal-append.run_wall_time_us":1478120}]]}
I20260709 12:24:24.807726 17591 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.809754 17789 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.810487 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2135) took 1010 ms. Trace:
I20260709 12:24:24.810974 15907 rpcz_store.cc:276] 0709 12:24:23.800184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.800328 (+   144us) service_pool.cc:224] Handling call
0709 12:24:23.800705 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:24.379198 (+578493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.810278 (+431080us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400112e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:24.810431 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328626944}
I20260709 12:24:24.810532 17789 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:24.813238 17789 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:24.814024 17789 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.815192 17789 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.817847 15912 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:24.820257 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.821805 17623 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.822170 17623 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.822491 17623 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.825058 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.825515 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:24.826920 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.827876 17792 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.828392 15986 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:24.828444 17805 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.830085 15904 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:24:24.830729 17805 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.832307 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.832828 15838 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:24.833137 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.838232 17623 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.839579 17453 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:24.840060 17453 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:24.841061 17453 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.841794 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.842439 15979 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.842533 17453 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.843737 17623 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.825613 15836 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:24.846552 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.848878 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.848212 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.864553 15838 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:24.866252 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.878295 15836 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:24.879900 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.898371 15912 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:24.884069 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:24.902108 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.903497 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.904619 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:24.909658 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2143) took 1078 ms. Trace:
I20260709 12:24:24.871547 17736 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:24.896852 17722 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:24.907546 17687 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:24.904755 17724 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:24:24.877444 17475 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:24.923399 17475 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.926185 17475 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.927380 16492 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.880254 17588 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.919497 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.921763 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:24.927234 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:24.910122 15910 rpcz_store.cc:276] 0709 12:24:23.830783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.854637 (+ 23854us) service_pool.cc:224] Handling call
0709 12:24:23.854893 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.880687 (+ 25794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.909454 (+1028767us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b540010cf54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:24.909598 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54948224}
I20260709 12:24:24.877699 17483 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:24.903913 17754 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:24:24.911000 17583 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:24.935050 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:24.897989 17735 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:24.934756 17588 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:24.944962 17583 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:24.927565 17796 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:24.927956 17736 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.939841 16486 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.943706 17483 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:24.953603 16492 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:24.980849 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.954560 17431 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:24.943831 15986 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:24.870023 17586 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.965592 17834 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.965379 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 63791.8us
W20260709 12:24:24.984560 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 75045.6us
I20260709 12:24:24.957007 17695 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:24.960383 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:24.977248 17735 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.983083 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.988819 15834 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:24.976224 17636 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.979496 17483 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:24.991539 15834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:24:24.997761 15834 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.998144 15834 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.993212 17724 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.994199 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.975618 15979 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:24.987129 17695 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.001418 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:24.989547 17735 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.006340 17483 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:25.010893 17724 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:25.022167 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.989674 17796 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.024717 16459 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:25.016290 15834 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.035468 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:24.996613 17580 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:24:25.038985 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.042857 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.047129 17591 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:25.034570 17687 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.050575 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.059464 15834 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.059825 15910 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:24.997418 17636 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:24.989391 17834 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:25.056957 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 71661.2us
I20260709 12:24:25.050031 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.060595 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.064949 15910 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.064240 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.060350 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.069094 15907 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:25.069844 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.070232 17562 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.070361 15907 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:25.070781 17562 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.071177 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.071777 15907 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:25.072599 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.064354 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:25.073051 17562 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:25.073416 15979 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:24:25.074312 17789 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.074970 16486 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:25.074262 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:25.075248 17834 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.076581 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:25.076913 17789 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.079895 17783 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.076917 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:25.077307 17636 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:25.086889 15907 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.091039 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:25.091562 15986 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:25.091928 15986 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:25.092509 17789 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:25.092648 15986 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.093087 17789 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.093902 15986 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.096283 17789 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.096412 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:25.091310 15904 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:25.098618 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.099261 15904 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:25.032107 17796 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:25.100605 15986 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:25.102337 15907 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:25.103514 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.104190 15907 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:25.101557 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.119930 15912 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:25.131721 15830 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.134366 15908 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:25.041005 17791 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:25.134994 15912 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.145640 15912 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:25.140832 15952 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.143496 15910 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:25.041651 17269 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.145576 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:25.048390 17591 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:24:25.147545 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.139758 17834 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.099805 17633 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.150579 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:25.154546 15986 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:25.059276 17836 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.022796 17588 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.146486 15912 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:25.158814 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 131099us
I20260709 12:24:25.159284 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.025835 17583 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.159673 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.160260 15908 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:25.161108 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.161773 15904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:25.166020 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:25.150090 17838 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.149544 17716 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.153573 17791 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:25.173653 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.154289 17633 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:25.175344 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.178660 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.179476 17843 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.180267 17755 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:25.181152 17831 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:24:25.181746 17681 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.181849 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2164) took 1209 ms. Trace:
I20260709 12:24:25.182912 17839 raft_consensus.cc:1064] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:24:25.153985 17269 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.156313 17834 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.194826 15906 rpcz_store.cc:276] 0709 12:24:23.971994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.148086 (+176092us) service_pool.cc:224] Handling call
0709 12:24:25.181649 (+1033563us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54001c4b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:25.181785 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440466176}
I20260709 12:24:25.171232 17580 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.176611 17520 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.175199 17431 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.199723 15904 raft_consensus.cc:606] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.201802 15907 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:25.201957 15904 raft_consensus.cc:614] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:25.189486 17736 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.192859 17682 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:25.192504 17755 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:25.197186 17681 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:25.192623 17684 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 12:24:25.242101 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.194381 17811 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:25.251214 17811 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:25.251663 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.251672 17811 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:25.191602 17796 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:25.254547 17694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.004s	sys 0.010s
I20260709 12:24:25.240191 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:25.246635 17681 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.240765 17755 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:25.318511 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 167558us
I20260709 12:24:25.160837 17836 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.252831 17811 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.240278 17431 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:25.173520 17838 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:25.249230 17724 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.249158 17735 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.334127 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.334769 15906 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:25.248941 17682 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:25.314134 17694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.004s	sys 0.010s
I20260709 12:24:25.327732 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:25.387445 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.246366 17633 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:25.414505 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82970.2us
W20260709 12:24:25.416144 17844 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:24:25.418236 17845 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:24:25.419866 17636 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.420379 17636 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.471752 17834 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.471943 16494 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:25.473371 17838 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.473528 17636 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.336691 17724 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.474661 17724 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.475507 16490 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:25.424463 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:25.446301 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.314693 17791 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.413523 17811 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.481020 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:25.481643 16490 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:25.483559 17695 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.484627 17591 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:25.485560 15907 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:25.485275 17636 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:25.450276 17431 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.466094 17520 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.336169 17843 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:25.470758 16495 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.476531 17724 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:25.509296 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 316449us
W20260709 12:24:25.510185 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 182442us
I20260709 12:24:25.447208 17836 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.513363 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:25.469233 15783 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:24:25.428336 17755 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.502372 15836 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:25.518138 16495 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.507156 17695 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.515712 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:25.551141 15986 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:25.552250 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:25.515717 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.514530 15783 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 9e271b9d1bc8403ba1c9d3e80c36917c already in progress
W20260709 12:24:25.554386 15783 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9e271b9d1bc8403ba1c9d3e80c36917c already in progress
I20260709 12:24:25.563597 15986 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:24:25.577867 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.487088 17839 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.508157 17843 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:25.592089 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.594977 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.532457 17591 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:24:25.517169 17855 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.511620 17520 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.604205 17736 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.606485 17631 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.618017 17855 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.617746 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:25.622557 17269 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:25.626523 17694 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.635987 17694 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.637991 17694 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:25.619130 17838 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:24:25.628749 17855 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.648228 17795 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.652912 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1396) took 1257 ms. Trace:
I20260709 12:24:25.653354 15980 rpcz_store.cc:276] 0709 12:24:24.395413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.397438 (+  2025us) service_pool.cc:224] Handling call
0709 12:24:25.649730 (+1252292us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400186ad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:25.652846 (+  3116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576835456}
I20260709 12:24:25.654893 16487 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:25.661193 17836 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.661801 17836 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.663154 17681 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.664443 17836 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.667927 17520 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.620508 17682 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.669584 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:25.670643 16492 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:25.671895 15953 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:25.673424 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.674391 15907 raft_consensus.cc:2410] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:25.675486 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.676159 15907 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:25.678246 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.679775 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.681593 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.739408 17797 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.741539 17797 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.743723 17797 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.756321 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:25.757715 17866 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:24:25.759466 17515 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.638761 15979 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:25.627852 17736 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.763386 17736 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.628367 17631 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.759483 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.766156 15906 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:25.766549 17631 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:25.783761 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.785862 17586 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:25.796742 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 318) took 1579 ms. Trace:
I20260709 12:24:25.797242 15833 rpcz_store.cc:276] 0709 12:24:24.217516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.388697 (+171181us) service_pool.cc:224] Handling call
0709 12:24:24.388996 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:24.515636 (+126640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.796465 (+1280829us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b5400083254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:25.796672 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127049984}
I20260709 12:24:25.740947 17681 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:25.810686 17747 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:25.811209 17747 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:24:25.821003 15982 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 262) took 1973 ms (client timeout 1701 ms). Trace:
I20260709 12:24:25.821352 15981 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:25.821573 15982 rpcz_store.cc:269] 0709 12:24:23.847545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.848237 (+   692us) service_pool.cc:224] Handling call
0709 12:24:24.256713 (+408476us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:25.820722 (+1564009us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400119ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:25.820891 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833456256}
I20260709 12:24:25.823995 15907 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:25.825881 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2152) took 1946 ms. Trace:
I20260709 12:24:25.826401 15905 rpcz_store.cc:276] 0709 12:24:23.879030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.952728 (+ 73698us) service_pool.cc:224] Handling call
0709 12:24:23.953280 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.245963 (+292683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.800672 (+1554709us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400073854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:25.801030 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650288384}
I20260709 12:24:25.828823 16487 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:25.867589 15910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:25.868364 15910 raft_consensus.cc:606] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.868772 15910 raft_consensus.cc:614] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:25.868943 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 933) took 1491 ms. Trace:
I20260709 12:24:25.869483 15909 rpcz_store.cc:276] 0709 12:24:24.377274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.803211 (+425937us) service_pool.cc:224] Handling call
0709 12:24:25.181809 (+378598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.182089 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.182117 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:25.182156 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:25.182183 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.182235 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.868730 (+686495us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001c4b50. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:25.868870 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":377,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":869621504}
W20260709 12:24:25.873026 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.812244 17747 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.875754 17747 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.875128 17350 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.877779 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:25.891355 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 271) took 1483 ms. Trace:
I20260709 12:24:25.891742 15981 rpcz_store.cc:276] 0709 12:24:24.407566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.453592 (+ 46026us) service_pool.cc:224] Handling call
0709 12:24:25.820887 (+1367295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.821894 (+  1007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.891183 (+ 69289us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400119ed0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:25.891303 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3143526144}
W20260709 12:24:25.896250 17810 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.485s	user 0.001s	sys 0.002s
I20260709 12:24:25.898723 17722 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:25.899086 17722 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:25.899865 17722 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.901141 17855 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.902273 17843 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.903225 17843 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.906656 17736 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:25.906809 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.907378 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 235572us
I20260709 12:24:25.907274 17736 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.909217 17740 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.909566 17740 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.909703 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2284) took 1237 ms. Trace:
I20260709 12:24:25.910069 15838 rpcz_store.cc:276] 0709 12:24:24.674273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.873431 (+199158us) service_pool.cc:224] Handling call
0709 12:24:24.873766 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:24.873991 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:25.292641 (+418650us) log.cc:844] Serialized 14 byte log entry
0709 12:24:25.909198 (+616557us) log.cc:844] Serialized 14 byte log entry
0709 12:24:25.909385 (+   187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:25.909431 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:25.909480 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.909541 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.909651 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454178,"prepare.queue_time_us":905327,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":22,"raft.queue_time_us":831,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5616,"thread_start_us":517741,"threads_started":2}
I20260709 12:24:25.912257 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 835) took 1948 ms. Trace:
I20260709 12:24:25.912599 15988 rpcz_store.cc:276] 0709 12:24:23.964215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.254793 (+290578us) service_pool.cc:224] Handling call
0709 12:24:24.255368 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:24.255545 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:24.255569 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:24.255999 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.386352 (+130353us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:24.474627 (+ 88275us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.474827 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.474909 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.895733 (+1420824us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:25.903811 (+  8078us) raft_consensus.cc:1685] finished
0709 12:24:25.912069 (+  8258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.912202 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140005,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":10736,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12564,"spinlock_wait_cycles":3552384,"thread_start_us":207870,"threads_started":2,"wal-append.queue_time_us":154333}
W20260709 12:24:25.907612 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.916673 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.919813 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.920486 15908 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.921625 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.922257 15910 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.930182 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.904593 17722 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.937439 17836 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.937930 17836 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.938723 15879 leader_election.cc:400] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:25.939327 17834 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:25.932178 17795 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.940565 15838 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:25.949621 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:25.939059 15879 leader_election.cc:403] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.917321 17735 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.949107 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:25.954356 15829 raft_consensus.cc:2368] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5.
I20260709 12:24:25.916153 17740 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:25.952507 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 68185.1us
I20260709 12:24:25.956621 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:25.956459 15952 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.951938 17838 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:25.932649 17635 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.933218 17783 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:25.931571 17794 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.941143 17855 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:25.951084 17724 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.955564 17805 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:25.968964 15910 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:25.965400 17635 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.969888 17862 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.956908 17836 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:25.973502 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.975282 15908 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:25.977169 15988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:25.950946 17619 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:25.979842 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:25.966579 17483 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.983058 15986 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:24:25.953306 17834 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.959237 17853 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.971385 17694 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:25.963236 17588 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.963101 17860 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.995896 15988 raft_consensus.cc:606] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.962363 17735 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.014396 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:25.968720 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:25.981243 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:26.015424 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46782.8us
I20260709 12:24:26.005379 17635 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.956281 17795 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:25.969308 17851 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.016409 17851 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.016777 17851 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.010813 16457 leader_election.cc:400] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5.
I20260709 12:24:25.967034 17838 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:25.987404 17453 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:24:26.005697 17755 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:25.973258 17794 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.003372 15909 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:26.020522 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.037626 15952 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.038938 15952 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.013463 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:25.989858 17631 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:25.997800 17736 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:25.989725 17724 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.039755 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.017709 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:26.051723 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2286) took 1298 ms. Trace:
I20260709 12:24:26.052112 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 272) took 1597 ms. Trace:
I20260709 12:24:26.052593 15987 rpcz_store.cc:276] 0709 12:24:24.455013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.457124 (+  2111us) service_pool.cc:224] Handling call
0709 12:24:24.457379 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.469262 (+1011883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.469296 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:25.469345 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:25.469375 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.051908 (+582533us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003147d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:26.051947 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.052065 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326623104}
I20260709 12:24:26.052079 15836 rpcz_store.cc:276] 0709 12:24:24.754897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.944640 (+189743us) service_pool.cc:224] Handling call
0709 12:24:25.501981 (+557341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.517447 (+ 15466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.051518 (+534071us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400082850. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:26.051662 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281078656}
I20260709 12:24:26.026430 17805 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.026216 17591 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.054050 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.063581 15987 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:26.014951 17783 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:26.055296 15911 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:26.008490 17483 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.015738 17487 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:24:26.058787 17838 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.059542 17724 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.025516 17795 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.016817 17853 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.080600 15730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 174) took 9577 ms. Trace:
I20260709 12:24:26.080963 17853 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.045812 15980 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:26.014664 17694 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.081073 15730 rpcz_store.cc:276] 0709 12:24:16.502669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.502842 (+   173us) service_pool.cc:224] Handling call
0709 12:24:26.080378 (+9577536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3419,"reported_tablets":8}
I20260709 12:24:26.067332 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.050107 17755 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:26.025871 17681 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:24:25.995680 17862 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.031997 17580 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:26.072508 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.073570 17684 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.074491 17872 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:26.074815 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.076730 17718 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.017853 17860 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.063162 17591 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:26.093974 17483 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.115738 17591 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.065393 17805 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.078442 17735 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.086382 15985 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:24:26.086843 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:26.088919 17619 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:24:26.089465 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:26.118551 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.083132 17694 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.086274 17795 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.121534 15909 raft_consensus.cc:606] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.089612 17684 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.127872 17684 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.091300 17872 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.093772 17834 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.120790 17811 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:26.126343 17871 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:26.131819 17795 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.153915 15904 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:26.133903 17872 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:26.156792 15802 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.004s	sys 0.030s
W20260709 12:24:26.158126 15802 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.030s
W20260709 12:24:26.158387 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 642512us
I20260709 12:24:26.159439 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.160161 15829 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:26.161226 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.161937 15833 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:26.138163 17811 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:26.138439 17718 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:26.156878 16490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.014s
I20260709 12:24:26.144526 17871 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:26.153291 17795 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.188658 15907 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:26.182937 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.195953 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.196395 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:26.197176 16493 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.197796 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:26.184652 16490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.007s	sys 0.014s
I20260709 12:24:26.200687 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.210012 15829 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:26.218545 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:26.231655 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.206888 17636 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.026s	sys 0.037s
I20260709 12:24:26.253540 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2292) took 1418 ms. Trace:
I20260709 12:24:26.247539 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:26.250684 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:26.252136 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:26.215670 17431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.043s
I20260709 12:24:26.253962 15832 rpcz_store.cc:276] 0709 12:24:24.835207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.040559 (+205352us) service_pool.cc:224] Handling call
0709 12:24:25.102376 (+ 61817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.102598 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:25.779996 (+677398us) log.cc:844] Serialized 14 byte log entry
0709 12:24:26.253223 (+473227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:26.253275 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:26.253315 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.253390 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.253490 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":859207,"prepare.queue_time_us":677586,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":208695,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4777,"thread_start_us":290834,"threads_started":1}
I20260709 12:24:26.279667 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.280323 16492 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:26.281105 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:26.283680 15835 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:26.284547 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:26.257385 17636 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.026s	sys 0.037s
I20260709 12:24:26.286065 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:26.286602 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.286839 15832 raft_consensus.cc:2368] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
W20260709 12:24:26.276978 17431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.000s	sys 0.043s
I20260709 12:24:26.289471 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:26.253829 17783 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:26.298385 15832 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:26.300328 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.257561 17475 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.215047 17591 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:26.302294 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 262587us
I20260709 12:24:26.302580 15829 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:26.286703 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.332921 15904 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:26.336444 15834 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:26.278312 17640 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:24:26.335688 15913 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:26.301339 17862 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.283949 17811 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.304610 17475 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.342101 15988 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:26.343369 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:26.344069 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.332384 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.345634 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:26.346065 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.360643 15904 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.335168 17805 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.307077 15835 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:26.347802 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.348824 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.363252 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.363827 15835 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:26.349921 15832 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:26.333061 17633 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.279398 17718 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.304850 17783 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.364741 15802 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.363950 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.365300 15832 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:26.366333 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.362879 15913 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:26.285422 17871 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.367343 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.374198 15831 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:26.368319 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.371245 15913 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:26.372303 15906 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:26.358383 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.377547 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.359858 17475 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.375066 15907 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:26.384815 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.414132 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.414562 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.467844 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.503486 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 116078us
I20260709 12:24:26.516306 15904 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:26.355051 17681 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:26.384370 17860 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.386065 17805 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.390657 17350 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.398554 17716 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:26.528035 17857 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.527134 17790 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.559695 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 307907us
I20260709 12:24:26.549088 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:26.614511 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47320.7us
I20260709 12:24:26.561546 17580 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:24:26.626875 17783 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:26.629429 17740 consensus_meta.cc:287] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.666s	user 0.002s	sys 0.007s
I20260709 12:24:26.629835 17740 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.631938 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:26.635965 17881 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.302s	user 0.000s	sys 0.000s
W20260709 12:24:26.637130 17877 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 12:24:26.638017 17876 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 12:24:26.641001 15911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2157) took 2735 ms (client timeout 1605 ms). Trace:
W20260709 12:24:26.641644 17875 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.280s	user 0.000s	sys 0.000s
I20260709 12:24:26.642858 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 536) took 1155 ms. Trace:
I20260709 12:24:26.643795 17591 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:26.645236 17591 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.645705 17591 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.647955 17591 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.648712 17269 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:26.641479 15911 rpcz_store.cc:269] 0709 12:24:23.905835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.920660 (+ 14825us) service_pool.cc:224] Handling call
0709 12:24:26.640777 (+2720117us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54001c4654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:26.640886 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4857923968}
I20260709 12:24:26.643654 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.663784 15981 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:26.651571 17794 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:26.652822 17883 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:24:26.665961 17843 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
W20260709 12:24:26.666929 17588 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.000s
I20260709 12:24:26.667308 17588 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.668035 15983 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.671809 17763 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:26.673388 15837 raft_consensus.cc:2410] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:26.673836 16493 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:26.660008 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:26.655627 17684 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.001s
I20260709 12:24:26.556869 17862 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.551811 17884 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:26.677538 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 131461us
I20260709 12:24:26.678562 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:26.679755 17763 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.695552 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.696883 15802 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.541240 17755 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:26.686694 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:26.680310 17878 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.394s	user 0.001s	sys 0.001s
I20260709 12:24:26.547544 17836 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:26.554605 17882 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 12:24:26.699051 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.700151 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.689953 17350 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:26.700501 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:26.701098 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.702682 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.550495 17839 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 12:24:26.676373 17783 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:26.715782 17783 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.701545 17755 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.716746 17350 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.717132 17623 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.717727 17623 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.718168 17623 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.718827 17350 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.719993 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 537) took 1231 ms. Trace:
I20260709 12:24:26.720350 16494 rpcz_store.cc:276] 0709 12:24:25.488201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.488383 (+   182us) service_pool.cc:224] Handling call
0709 12:24:25.512489 (+ 24106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:25.532496 (+ 20007us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:25.532534 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:25.594416 (+ 61882us) log.cc:844] Serialized 556 byte log entry
0709 12:24:26.093391 (+498975us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:26.093445 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.093526 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.719797 (+626271us) raft_consensus.cc:1685] finished
0709 12:24:26.719817 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.719939 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":498697,"threads_started":1,"wal-append.queue_time_us":619232}
I20260709 12:24:26.680896 17790 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.722892 17790 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.723505 17853 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.643235 16490 rpcz_store.cc:276] 0709 12:24:25.487346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.487482 (+   136us) service_pool.cc:224] Handling call
0709 12:24:25.487808 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:25.588664 (+100856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.593873 (+  5209us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:25.630217 (+ 36344us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.214790 (+584573us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:26.218799 (+  4009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.253524 (+ 34725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.642628 (+389104us) raft_consensus.cc:1685] finished
0709 12:24:26.642659 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.642802 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":426,"raft.queue_time_us":60813,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15438,"thread_start_us":571353,"threads_started":1,"wal-append.queue_time_us":676447}
I20260709 12:24:26.561093 17716 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.706948 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:26.690317 17684 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.702364 17884 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:26.726929 15802 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.727490 17716 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.708770 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:26.701700 17635 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.728025 17716 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.682710 17843 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.728235 17884 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.728863 17635 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.694202 17862 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.725792 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.729370 17740 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.681277 17794 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:26.730378 17794 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.731098 17862 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.682420 17269 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:26.732283 17794 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.732378 17269 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.732964 17475 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.734237 17783 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.735956 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.736567 16494 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
W20260709 12:24:26.725741 17795 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 12:24:26.737282 17795 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.738209 17475 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:24:26.738714 15908 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:26.738739 17836 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.739868 17783 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:26.728919 17843 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.740995 17735 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.740356 17783 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.740979 17836 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.741124 17843 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:26.744171 17887 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:24:26.746665 17880 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 12:24:26.746707 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.749022 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.749776 15832 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:26.751258 17843 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.727684 17684 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:26.705773 17747 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.757468 17795 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.758551 17783 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.760388 17755 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:26.767273 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 58686.4us
I20260709 12:24:26.703833 17860 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.769825 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:26.703702 17619 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:26.770527 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 409319us
I20260709 12:24:26.772200 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:26.771695 17619 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.783126 17619 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.783442 15950 leader_election.cc:400] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:26.783736 15950 leader_election.cc:403] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:26.771865 17635 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.785496 17635 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.785905 17635 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.787526 17586 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:26.769586 17722 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.004s
I20260709 12:24:26.797786 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:26.798679 17882 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.799304 17834 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.799934 17834 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:26.801142 17834 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.802681 17882 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:26.803254 17882 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.805927 17882 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.810060 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.810366 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.811599 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.812265 16490 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:26.795938 17886 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.813413 17886 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.770670 17860 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:26.833701 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.833619 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:26.834324 16486 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.837445 17681 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:26.837738 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:26.837929 17886 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:26.838068 17633 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:26.838598 17633 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.839308 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.840610 17896 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:26.840899 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.841136 17896 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.842311 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.842875 16492 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:26.843364 17633 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.820001 17860 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.845472 16492 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:26.846860 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.848419 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:26.850978 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.853292 15984 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:26.815395 17684 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:26.857947 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:26.859906 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 228063us
W20260709 12:24:26.832131 17851 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.001s
I20260709 12:24:26.861958 16492 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:26.856729 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:26.863196 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 136321us
I20260709 12:24:26.865324 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.868541 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.869104 15985 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:26.843587 17896 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.874387 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.875269 15986 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:26.860881 17843 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.880455 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:26.884492 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.886333 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.887055 15985 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
W20260709 12:24:26.892030 17872 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.002s
I20260709 12:24:26.892948 17716 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.892568 17872 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.869128 17735 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:26.896386 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:26.901176 17763 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.901597 15905 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.901329 17735 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:26.902122 17763 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:26.902493 17763 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:26.906684 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.893402 17716 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:26.837952 17681 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.864131 17684 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:26.925884 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:26.926683 15908 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.889164 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.863833 17851 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:26.912840 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 212414us
I20260709 12:24:26.933961 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.935317 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:26.921941 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.893474 17896 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.929450 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.941383 15907 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:26.942620 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:26.943423 15907 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:26.930286 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:26.945024 15906 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.938028 15905 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:26.947645 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.928274 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:26.938546 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.949087 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.949879 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.950073 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:26.936810 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:26.939651 15985 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:26.903884 17735 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:26.948060 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:26.953699 15984 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:26.925235 17716 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.955519 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:26.956079 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.956175 15907 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:26.958925 15908 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:26.954169 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.904093 17722 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:24:26.994789 15835 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:26.995031 15912 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.996446 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 538) took 1356 ms. Trace:
I20260709 12:24:26.997478 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:26.897622 17862 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:26.998612 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:26.996829 16495 rpcz_store.cc:276] 0709 12:24:25.640060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.640228 (+   168us) service_pool.cc:224] Handling call
0709 12:24:25.640601 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:25.767299 (+126698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.767327 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:25.767726 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.156578 (+388852us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:26.156618 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.968540 (+811922us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54007044d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:26.968604 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.968663 (+    59us) raft_consensus.cc:1685] finished
0709 12:24:26.968683 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.996380 (+ 27697us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125366,"raft.queue_time_us":6676,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4967,"spinlock_wait_cycles":290569984,"thread_start_us":388481,"threads_started":1,"wal-append.queue_time_us":610716}
I20260709 12:24:26.922310 17857 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:26.972491 17884 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.000471 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.004616 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:26.944319 17843 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.941779 17778 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.001539 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:27.001938 15906 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:26.974030 15830 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:24:27.000730 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.951959 17896 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.010632 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:26.925752 17885 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:24:26.926383 17835 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:24:26.999341 17633 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:27.019459 15830 pending_rounds.cc:85] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 1
I20260709 12:24:26.903349 17763 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.023747 17896 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:26.941959 17695 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.033746 17811 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.036015 17635 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.036906 17900 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.038424 17851 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:27.039558 15983 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:27.041131 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.081627 15985 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.041777 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.082943 15986 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:27.083930 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.041994 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.043345 17871 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.960476 17899 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:27.009963 17790 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.013729 17735 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:24:27.046303 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.999607 17754 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.063228 15830 pending_rounds.cc:107] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:24:27.114684 15830 raft_consensus.cc:2889] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:26.944638 17783 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:24:27.066529 15912 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:27.115880 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2175) took 2063 ms. Trace:
I20260709 12:24:27.116262 15912 rpcz_store.cc:276] 0709 12:24:25.052285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.121395 (+ 69110us) service_pool.cc:224] Handling call
0709 12:24:25.121660 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.800185 (+678525us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b58000581d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc1ff0aa 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4
0709 12:24:26.964905 (+1164720us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b58000584d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc1ff0aa 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4
0709 12:24:27.115571 (+150666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.115814 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623432320}
I20260709 12:24:27.011929 17884 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.007352 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:26.974148 17794 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.073549 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:27.073920 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:27.046077 17586 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3.
I20260709 12:24:27.077868 15907 raft_consensus.cc:606] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:27.133225 15907 raft_consensus.cc:614] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:27.126052 17884 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.062839 17633 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:27.126976 17334 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:24:27.019594 17857 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.082214 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.084561 15986 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:27.019006 15982 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:27.148813 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.097204 17790 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:27.068799 17778 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:27.107386 17716 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.109292 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.068353 17904 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:27.121732 17687 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:27.021093 17873 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:27.089291 17899 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.132839 17794 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:27.135423 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.085767 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.176160 15987 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:27.087733 17900 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:27.188212 17900 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.189255 17681 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.193610 17872 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.193775 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.194545 15988 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:27.126772 17722 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.195668 17722 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.198124 17722 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.159375 17790 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.205026 17899 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.151074 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.156724 15981 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:27.162395 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:27.134070 17754 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:27.169345 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:27.169854 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 172433us
W20260709 12:24:27.207787 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45492us
I20260709 12:24:27.141242 17633 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.172757 15985 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:27.142915 17695 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.177121 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.177546 17619 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.194469 17716 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.209492 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.209815 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.210808 15912 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:27.211355 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.211606 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.211023 17754 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.223021 15906 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.136029 17623 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.217183 15986 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:27.149238 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 199228us
I20260709 12:24:27.228281 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.228823 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:27.213392 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.229451 15906 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:27.230021 15908 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.172525 17904 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.175614 17687 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:27.242282 15952 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:27.243726 15913 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:27.206063 17794 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.238761 15908 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:27.247917 17925 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.250232 17924 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.250732 17924 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:27.251802 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.251541 17924 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.252450 15979 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:27.240280 17882 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:24:27.253775 16486 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:27.253849 17882 consensus_queue.cc:1243] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:27.248781 17925 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.254675 17882 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:27.255100 17882 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:27.254880 17884 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.256096 17882 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.258010 17586 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:27.258500 17882 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:27.261180 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 87752.3us
I20260709 12:24:27.261615 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:27.207216 17857 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.267378 17857 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.267746 17857 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:27.268124 17857 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.221904 17805 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.264891 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.266150 17839 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.266420 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.222385 17681 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:27.269264 15953 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:27.272701 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.273542 15908 raft_consensus.cc:2376] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6. Re-sending same reply.
I20260709 12:24:27.172081 17778 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.278132 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.223842 17695 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.269235 17795 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.245428 17904 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.272136 17805 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:27.274587 17716 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:27.280014 17681 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:27.281595 15911 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:27.281953 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.299099 15906 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:27.305174 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.305819 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.306519 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.279834 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.308218 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.308913 15912 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:27.312954 15906 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:27.314213 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.314580 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:27.316992 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.317545 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.317879 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.318252 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:27.319676 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.273612 17694 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.320303 17916 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.320459 17694 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:27.320875 17916 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:27.321475 17694 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.322161 17623 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:27.322973 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50182.1us
I20260709 12:24:27.323621 15952 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:27.324848 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:27.212450 17873 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.325420 17872 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:27.326714 17682 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.327200 17873 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.327212 17682 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:27.279000 17918 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:24:27.330660 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.330287 17682 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.331619 15835 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:27.334347 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.334782 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.334993 17860 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.335764 15911 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 2: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:27.293473 17805 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.338444 17860 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.338747 15911 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:27.321769 17916 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.294373 17619 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.343111 15835 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:27.343341 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:27.343822 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:27.348206 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:27.305902 15910 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:27.351238 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:27.351868 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:27.351958 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.352460 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:27.352936 15910 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:27.352463 15833 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:27.353931 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.354976 15910 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:27.350643 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:27.360558 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.365120 15833 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.369824 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.370839 15910 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:27.371594 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.372175 15837 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.282043 17925 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:27.287446 17778 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.342485 17783 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.347337 17716 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.356035 17872 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.394776 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.368311 17885 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.392975 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.404057 15910 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.416747 15910 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:27.382627 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:27.356540 17860 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:24:27.434507 15833 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:27.409516 17904 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:27.436388 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 78687.6us
I20260709 12:24:27.385758 17623 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.441179 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.444895 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:27.445648 16492 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.447474 15833 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.456506 15833 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:27.458082 15833 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:27.460520 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1407) took 1112 ms. Trace:
I20260709 12:24:27.460891 15830 rpcz_store.cc:276] 0709 12:24:26.347975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.373889 (+ 25914us) service_pool.cc:224] Handling call
0709 12:24:26.967374 (+593485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.115108 (+147734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.460275 (+345167us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400250650. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:27.460446 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310340352}
I20260709 12:24:27.463259 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:27.464946 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:27.465199 17684 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.465803 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:27.468288 17915 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:27.468662 17915 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:27.379325 17900 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:27.408264 17839 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:27.478319 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 127740us
I20260709 12:24:27.479234 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:27.480288 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.482487 15834 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:27.495031 16492 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:27.440378 17681 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:27.501889 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.502444 15988 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.503135 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:27.507805 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 67198.7us
I20260709 12:24:27.444414 17922 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:27.476922 17839 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:27.402859 17783 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:27.509240 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:27.537555 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:27.519767 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:27.506428 17937 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:24:27.546612 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 43568.9us
I20260709 12:24:27.507534 17623 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.561295 17269 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.532428 17839 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.562543 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:27.564052 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.497812 17935 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:27.564980 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:27.529928 17836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.007s
W20260709 12:24:27.568892 17836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.010s	sys 0.008s
I20260709 12:24:27.569167 17811 raft_consensus.cc:993] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:27.569612 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:27.569898 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.570235 17811 raft_consensus.cc:1081] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:24:27.571202 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:27.571250 17811 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:27.574214 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.528028 17922 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.499164 17717 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:24:27.575484 17899 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.584214 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.584756 15833 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:27.585580 17899 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.586973 15982 raft_consensus.cc:2368] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:27.589138 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:27.588881 17642 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:27.590517 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:27.591413 15830 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:27.591593 15833 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:27.595649 17573 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.597203 17938 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:27.597723 17938 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:27.598625 17938 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:27.554104 17924 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.520413 17879 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:24:27.565140 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.572206 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:27.609428 16493 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:27.523612 17735 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:24:27.566701 17580 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.627991 17861 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:27.603468 15837 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:27.576076 17918 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.605672 17790 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.574559 17935 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:27.575256 17917 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:24:27.612663 17926 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:24:27.602010 17687 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.641332 17687 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.618294 17904 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.645272 17755 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:27.619434 17794 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.623366 17633 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.634827 17935 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.607489 17684 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.529897 17934 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.620478 15986 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:27.581691 17921 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:24:27.629351 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.628635 17580 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:27.635522 17945 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:24:27.638839 17884 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.650708 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.664176 17633 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:27.664448 17922 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.664654 17684 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.644425 17857 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.666869 15988 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:27.667582 17619 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.628527 17861 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.679704 17763 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.691560 15984 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:27.685387 17836 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.685866 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:27.690337 17619 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.674674 15980 raft_consensus.cc:2368] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:27.684973 17790 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.707103 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.739200 15908 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:27.740147 15909 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:27.721522 17805 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.740463 17871 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:27.709184 15905 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:27.741134 17871 consensus_queue.cc:1243] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:27.710397 15913 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:27.741652 17871 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:27.742004 17871 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:27.713368 16486 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:27.714257 17857 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.714953 17783 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.716396 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.718178 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:27.722864 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:27.749271 16494 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.684870 17684 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.689703 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.752794 15987 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:27.670105 17580 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.728843 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:27.754685 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 373395us
I20260709 12:24:27.755126 16488 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:27.742151 17805 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.743520 15911 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.744160 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:27.746666 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.693691 17839 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.742866 17871 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:27.779934 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:27.764946 17836 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.786682 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.792943 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.793299 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.795182 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.797894 15832 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.779000 17871 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:27.809458 17783 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:27.817315 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:27.817917 15905 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.817713 17783 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:27.818898 17942 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:27.826776 15905 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:27.811167 17836 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:27.824759 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:27.832963 15987 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.833616 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:27.834658 15988 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:27.836483 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:27.837299 15905 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:27.822057 17794 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:27.868127 15988 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.840653 17790 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:27.958613 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.865607 15986 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 880) took 1302 ms (client timeout 1723 ms). Trace:
W20260709 12:24:28.906324 15986 rpcz_store.cc:269] 0709 12:24:27.562936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.563834 (+   898us) service_pool.cc:224] Handling call
0709 12:24:28.865399 (+1301565us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b54002f67d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:28.865530 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128209664}
W20260709 12:24:28.908372 15987 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.075s	user 0.012s	sys 0.022s
I20260709 12:24:28.908946 15987 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
W20260709 12:24:27.890429 15906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.029s
W20260709 12:24:28.909593 15906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.545s	user 0.041s	sys 0.083s
I20260709 12:24:27.868119 16494 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:27.942981 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 399891us
W20260709 12:24:28.734217 15983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1426) took 1654 ms (client timeout 1559 ms). Trace:
W20260709 12:24:28.345608 15907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.026s	sys 0.045s
W20260709 12:24:28.913625 15907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.031s	sys 0.097s
W20260709 12:24:28.212599 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.066478 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.983057 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.010s	sys 0.012s
W20260709 12:24:28.916927 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.521s	user 0.028s	sys 0.065s
W20260709 12:24:28.917469 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.52265e+06us
I20260709 12:24:28.919086 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:28.919819 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1438) took 1088 ms. Trace:
I20260709 12:24:28.904723 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 888) took 1037 ms. Trace:
I20260709 12:24:28.921048 15988 rpcz_store.cc:276] 0709 12:24:27.867192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.867376 (+   184us) service_pool.cc:224] Handling call
0709 12:24:27.867724 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.868648 (+   924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.904647 (+1035999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.920336 15987 rpcz_store.cc:276] 0709 12:24:27.820695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.824550 (+  3855us) service_pool.cc:224] Handling call
0709 12:24:28.909417 (+1084867us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:28.912091 15983 rpcz_store.cc:269] 0709 12:24:27.079744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.081922 (+  2178us) service_pool.cc:224] Handling call
0709 12:24:28.733958 (+1652036us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002c6854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:28.734133 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480623488}
I20260709 12:24:28.929245 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 558) took 1188 ms. Trace:
I20260709 12:24:28.929663 16494 rpcz_store.cc:276] 0709 12:24:27.722422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.722578 (+   156us) service_pool.cc:224] Handling call
0709 12:24:28.910426 (+1187848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:28.930249 15905 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:28.931025 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2229) took 1036 ms. Trace:
I20260709 12:24:28.931404 15905 rpcz_store.cc:276] 0709 12:24:27.894416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.929465 (+1035049us) service_pool.cc:224] Handling call
0709 12:24:28.929846 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.930743 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.930963 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:28.637313 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2314) took 1317 ms (client timeout 1557 ms). Trace:
W20260709 12:24:28.946184 15834 rpcz_store.cc:269] 0709 12:24:27.319413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.319473 (+    60us) service_pool.cc:224] Handling call
0709 12:24:28.637006 (+1317533us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540003b6d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:28.637231 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372674816}
W20260709 12:24:28.251832 17642 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.003s
W20260709 12:24:28.332214 17687 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.004s
W20260709 12:24:28.249854 17938 consensus_meta.cc:287] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.007s
W20260709 12:24:28.964323 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.966298 16495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.022s	sys 0.070s
W20260709 12:24:28.968360 16495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.023s	sys 0.071s
W20260709 12:24:28.416110 17948 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:24:28.861368 17834 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:28.733642 17862 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.945384 17635 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.879542 17619 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:28.063006 17839 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:27.874840 17924 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:28.711915 17917 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:28.976521 17580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.008s	sys 0.022s
I20260709 12:24:28.971659 16495 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:28.700152 17925 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:28.095242 17935 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:28.933813 17790 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:28.973169 17834 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:28.063364 17836 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:28.981714 17684 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.973460 17862 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:28.973789 17861 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:28.991494 17580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.009s	sys 0.022s
I20260709 12:24:28.983647 17619 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.004274 15913 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.976868 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:28.988737 17857 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.049300 17915 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:28.972155 17938 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.010582 15953 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:28.993377 17916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.051s	sys 0.074s
I20260709 12:24:28.998392 17635 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:29.036389 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 553) took 1587 ms. Trace:
I20260709 12:24:29.047695 16495 rpcz_store.cc:276] 0709 12:24:27.449046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.449194 (+   148us) service_pool.cc:224] Handling call
0709 12:24:27.449451 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.449633 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:27.745528 (+295895us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.035657 (+1290129us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.035974 (+   317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:29.036036 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:29.036103 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.036179 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.036316 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":420018,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":32603,"raft.queue_time_us":7479,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2217,"thread_start_us":1518495,"threads_started":2}
W20260709 12:24:29.004251 17763 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.301s	user 0.012s	sys 0.001s
I20260709 12:24:28.991786 17917 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.052377 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.059s	sys 0.051s
W20260709 12:24:29.052800 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.059s	sys 0.051s
W20260709 12:24:29.053278 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 1.23592e+06us
I20260709 12:24:28.995977 17925 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.049417 17916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.052s	sys 0.074s
I20260709 12:24:29.011637 17520 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.052825 17924 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.002954 17684 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.062752 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.064708 16494 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:29.194830 15836 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:29.063661 17520 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.011703 17619 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.060078 17635 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.292718 17965 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:29.293205 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 350809us
I20260709 12:24:29.293942 17635 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.296288 15832 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:29.076074 17695 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.075081 17790 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.052903 17811 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:29.058805 17839 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.299054 17811 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:29.299362 17839 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.047196 17857 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.301968 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:29.303917 17857 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.056581 17862 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:29.124733 17871 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.304s	user 0.012s	sys 0.001s
I20260709 12:24:29.057183 17915 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.306294 17619 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.306407 17862 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.307587 17811 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.121448 17925 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.108937 17935 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.115561 17938 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.316000 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.063850 17949 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.317106 15987 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:29.317658 17949 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.126958 17966 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.321154 17971 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.321394 17966 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.322160 17971 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.237592 17963 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:29.323906 17963 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.324855 17968 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.250821 15878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.004s
W20260709 12:24:29.255674 17717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.473s	user 0.017s	sys 0.000s
W20260709 12:24:29.326169 15878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.005s
W20260709 12:24:29.269259 16493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.006s	sys 0.013s
W20260709 12:24:29.326797 16493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.492s	user 0.007s	sys 0.013s
I20260709 12:24:29.327661 17925 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.328054 16493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 363) took 1639 ms. Trace:
W20260709 12:24:29.269850 15979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 889) took 1326 ms (client timeout 1587 ms). Trace:
W20260709 12:24:29.273183 17588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.007s	sys 0.012s
W20260709 12:24:29.329274 17588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.008s	sys 0.012s
I20260709 12:24:29.328569 17925 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.278707 17684 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:29.326347 17717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.018s	sys 0.000s
I20260709 12:24:29.331441 17938 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:29.328722 15979 rpcz_store.cc:269] 0709 12:24:27.927282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.945135 (+1017853us) service_pool.cc:224] Handling call
0709 12:24:29.251383 (+306248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:29.056064 17843 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.334838 17843 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.328578 16493 rpcz_store.cc:276] 0709 12:24:27.688570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.691598 (+  3028us) service_pool.cc:224] Handling call
0709 12:24:27.778850 (+ 87252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.816627 (+ 37777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.819360 (+  2733us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.834166 (+ 14806us) log.cc:844] Serialized 556 byte log entry
0709 12:24:29.327491 (+1493325us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:29.327584 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.327722 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.327776 (+    54us) raft_consensus.cc:1685] finished
0709 12:24:29.327791 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.327958 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1492721,"threads_started":1,"wal-append.queue_time_us":1295106}
I20260709 12:24:29.336998 15838 raft_consensus.cc:2410] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:29.103539 17917 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:29.297919 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 234181us
I20260709 12:24:29.339543 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:29.340634 15834 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.343497 17748 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:29.343957 17748 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:29.344599 17520 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.345736 17861 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:29.346606 17861 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.311070 17681 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:29.349524 17681 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.350347 17783 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.350636 17971 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.349546 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:29.351613 17839 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.352108 17681 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:29.269644 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 885) took 1606 ms. Trace:
I20260709 12:24:29.313175 17916 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.309695 17871 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:29.353336 17975 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.353277 17916 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.353940 17871 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.354220 17834 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.354398 17975 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.355746 17834 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.356408 17871 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:29.357003 17975 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.352799 15985 rpcz_store.cc:276] 0709 12:24:27.648356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.648513 (+   157us) service_pool.cc:224] Handling call
0709 12:24:27.648983 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.649419 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.649456 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.661305 (+ 11849us) log.cc:844] Serialized 556 byte log entry
0709 12:24:27.922722 (+261417us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:27.922771 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.922843 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.247064 (+1324221us) raft_consensus.cc:1685] finished
0709 12:24:29.247104 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.254766 (+  7662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052032,"thread_start_us":261124,"threads_started":1,"wal-append.queue_time_us":1412927}
I20260709 12:24:29.358139 17973 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.359010 17973 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:29.313529 15950 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.553s (SENT) [suppressed 10 similar messages]
I20260709 12:24:29.293773 17965 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.329062 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:29.312186 17969 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:29.351262 17974 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.325699 17968 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.332635 17938 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.314397 17635 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.352133 15829 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.366323 17748 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.375932 17979 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.378384 17778 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.370612 17984 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.356401 17916 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.344954 17966 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.359630 17949 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.356731 17695 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.390400 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:29.395817 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 85547.9us
W20260709 12:24:29.399266 16492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.324s	user 0.000s	sys 0.012s
I20260709 12:24:29.398980 17974 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.399641 16492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.000s	sys 0.013s
I20260709 12:24:29.403069 17925 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.403537 17790 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.404517 17790 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.406278 17973 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.376821 17979 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.407413 17790 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.408552 17979 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.409132 17969 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.409999 17783 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.410589 17783 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.411772 17969 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:29.412629 17783 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:29.414008 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 65186us
I20260709 12:24:29.414523 17938 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.414604 17935 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.415604 17861 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.415503 17935 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.390825 17778 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.418936 17778 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.386233 17681 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.421083 17935 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.421470 17681 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.422870 17949 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.423941 17681 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:29.428632 17969 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.440111 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.441572 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.395009 17717 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:29.442919 17958 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.328s	user 0.000s	sys 0.000s
I20260709 12:24:29.393689 17975 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.443787 17975 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.442633 17717 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.423641 17949 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.447260 17979 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.391021 17619 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.447889 17979 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:29.450999 17955 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.337s	user 0.004s	sys 0.000s
I20260709 12:24:29.428520 17873 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.456526 17873 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.457597 17979 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.458793 17873 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.400211 17963 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.454388 17778 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.459223 17969 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.459836 17778 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.461766 17969 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:29.462083 15838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 345) took 2160 ms (client timeout 1621 ms). Trace:
W20260709 12:24:29.462584 15838 rpcz_store.cc:269] 0709 12:24:27.301900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.305541 (+  3641us) service_pool.cc:224] Handling call
0709 12:24:29.461840 (+2156299us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54001252d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:29.461999 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4667683584}
I20260709 12:24:29.455338 17973 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:29.455591 17935 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.462199 17778 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.455191 17783 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.466864 17695 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:29.467952 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2222) took 1734 ms. Trace:
I20260709 12:24:29.468034 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.468052 15835 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:29.468853 15879 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.468497 17790 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:29.469694 17975 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.445205 17965 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.470937 17974 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.473522 15834 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:29.463748 17973 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.468654 17968 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.485105 17935 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.486135 17783 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.487073 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.486940 17619 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.487721 17963 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:29.498533 15913 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:29.504274 17963 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:29.505587 17963 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.488001 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:29.489012 17695 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.489423 17790 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:29.509773 17790 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:29.489291 17984 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.480273 15835 pending_rounds.cc:85] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 5
I20260709 12:24:29.465478 17862 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.448904 17916 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.503600 15879 leader_election.cc:400] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:29.459123 17843 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.511758 15835 pending_rounds.cc:107] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:29.515590 15835 raft_consensus.cc:2889] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:29.500595 17935 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:29.516876 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.517913 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.518563 17984 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.503847 17974 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:29.519302 17974 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.516980 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.486972 17717 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:29.517328 17941 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.380s	user 0.005s	sys 0.010s
I20260709 12:24:29.502678 17783 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.518859 17949 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.517323 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.522670 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.523253 17973 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.523970 17973 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:29.524510 17973 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:24:29.517936 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 50063.8us
I20260709 12:24:29.519866 17790 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.526320 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:29.541294 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 264537us
I20260709 12:24:29.519918 17974 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:29.544392 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.514353 17965 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:29.550590 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 152306us
I20260709 12:24:29.479593 15907 rpcz_store.cc:276] 0709 12:24:27.733882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.734072 (+   190us) service_pool.cc:224] Handling call
0709 12:24:27.734424 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.734804 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.734844 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.735274 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:24:28.914109 (+1178835us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:28.914167 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.914237 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.440854 (+526617us) spinlock_profiling.cc:243] Waited 884 us on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:29.467440 (+ 26586us) raft_consensus.cc:1685] finished
0709 12:24:29.467460 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.467747 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":851,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":6620,"spinlock_wait_cycles":2033024,"thread_start_us":1178521,"threads_started":1,"wal-append.queue_time_us":1318351}
I20260709 12:24:29.552558 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.551306 15832 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:29.550177 17783 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:29.559213 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.560063 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.587081 17915 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:29.587384 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.588052 17965 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:29.561683 17986 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:29.589604 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.589977 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.590989 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.590869 17834 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:29.591331 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.592885 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.593719 15982 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:29.562367 17687 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.594141 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.594959 15988 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:29.594568 17687 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.557406 17916 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.596690 17619 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.565049 17935 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:29.596916 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2212) took 2267 ms. Trace:
I20260709 12:24:29.570632 17790 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.597350 15906 rpcz_store.cc:276] 0709 12:24:27.329080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.345298 (+ 16218us) service_pool.cc:224] Handling call
0709 12:24:27.355794 (+ 10496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.362163 (+  6369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.362191 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.364786 (+  2595us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.413468 (+ 48682us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b48000030d8. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d11ccaa1 00007f03d11c3b37 00007f03d11c39ca 00007f03d12bb26f 00007f03d12baf37 00007f03d12cf55c 00007f03d12cf508 00007f03d12cf488 00007f03d12cf443 00007f03d12ce6ec 00007f03d01f8a96
0709 12:24:28.910004 (+1496536us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:28.910046 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.910111 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.253492 (+343381us) raft_consensus.cc:1685] finished
0709 12:24:29.255192 (+  1700us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.596623 (+341431us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400420ed0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:29.596744 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4546,"raft.queue_time_us":9301,"raft.run_cpu_time_us":2327,"raft.run_wall_time_us":46711,"spinlock_wait_cycles":26685696,"thread_start_us":1544914,"threads_started":1,"wal-append.queue_time_us":1701433}
I20260709 12:24:29.598704 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:29.599856 15906 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:29.601533 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1415) took 2023 ms. Trace:
I20260709 12:24:29.602327 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:29.603552 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 102798us
I20260709 12:24:29.589910 17986 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:29.606087 17986 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:29.607239 17986 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.608559 17986 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.564296 17949 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.609551 17988 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.554191 17862 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.610215 17988 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.611001 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.010s	sys 0.017s
W20260709 12:24:29.611317 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.010s	sys 0.017s
I20260709 12:24:29.612160 17862 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.582557 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.613359 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.613533 15987 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:29.597374 17935 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:29.614984 17935 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.616264 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.617780 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.617949 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.618818 15981 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:29.581713 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.619247 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.619621 15983 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:29.615787 15988 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:29.621217 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2224) took 1874 ms. Trace:
I20260709 12:24:29.621577 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.601949 15836 rpcz_store.cc:276] 0709 12:24:27.578119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.578260 (+   141us) service_pool.cc:224] Handling call
0709 12:24:27.581706 (+  3446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.304246 (+1722540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.601184 (+296938us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400083754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:29.601422 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707391744}
I20260709 12:24:29.589850 17965 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:29.623793 17965 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.624166 17965 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.560750 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.621598 15913 rpcz_store.cc:276] 0709 12:24:27.746280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.746402 (+   122us) service_pool.cc:224] Handling call
0709 12:24:29.620935 (+1874533us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400074254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:29.621113 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862253440}
W20260709 12:24:29.625635 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 73191.3us
I20260709 12:24:29.625909 17893 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:29.625981 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:29.626453 17893 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:29.626722 17783 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.626943 17893 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.627312 17783 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.629582 15879 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.590538 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.629647 17783 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.630926 17987 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:29.631354 17987 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.631738 17987 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.633374 17974 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.577661 15904 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:29.636561 15907 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:29.583976 17748 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.587486 17915 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.561779 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 556) took 1872 ms. Trace:
I20260709 12:24:29.590610 17973 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.609359 17949 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.583398 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:29.653791 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.635623 17974 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.566642 15912 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:24:29.612156 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 693114us
W20260709 12:24:29.642895 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 82859.6us
I20260709 12:24:29.646528 15829 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:29.652755 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:29.666491 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.706055 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.626951 17778 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:29.650059 17915 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.716615 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.708896 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:29.722671 15913 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:29.656523 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.665987 17963 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.719249 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:29.718791 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 61216.4us
I20260709 12:24:29.725970 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.735639 17949 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.665782 17969 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.736464 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.647238 16492 rpcz_store.cc:276] 0709 12:24:27.689196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.689314 (+   118us) service_pool.cc:224] Handling call
0709 12:24:27.690614 (+  1300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.690805 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:27.941271 (+250466us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.550835 (+1609564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:29.556595 (+  5760us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:29.561457 (+  4862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.561574 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.561718 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17436,"prepare.queue_time_us":254243,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":49606,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":1613,"thread_start_us":1854648,"threads_started":3,"wal-append.queue_time_us":1367570}
I20260709 12:24:29.736816 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.728523 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.739670 17938 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.740562 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.742224 17573 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.742828 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:29.743453 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.751267 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.721320 17916 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.720429 17778 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.757925 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.787250 15986 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:29.758265 17956 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:29.724128 17988 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.765349 17938 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.766201 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.753468 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.771548 15987 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:29.774686 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.774875 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:29.753409 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:29.785413 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.772505 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:29.832864 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 258637us
W20260709 12:24:29.837471 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 116478us
W20260709 12:24:29.787927 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 62414.6us
W20260709 12:24:29.788658 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63985.3us
I20260709 12:24:29.771528 17969 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.839898 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.803012 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.816049 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.788151 17949 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:29.791332 17778 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.787762 17790 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:29.830771 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.785300 17573 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.847283 17836 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:29.849128 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.850117 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.804710 17811 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.773232 17963 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.862438 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 109703us
W20260709 12:24:29.868964 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 128505us
I20260709 12:24:29.784973 17893 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.879047 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:29.879467 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.857831 17790 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.878816 15911 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:29.862557 17988 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:29.883597 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:29.884781 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2218) took 2179 ms. Trace:
I20260709 12:24:29.868465 17974 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:29.889673 17974 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:29.890082 17974 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.893251 17805 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:29.887507 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 104332us
I20260709 12:24:29.895943 16459 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.897357 17942 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.898054 17965 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.899055 17969 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:29.883545 17949 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.900333 17965 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.901777 17949 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.902360 17998 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:29.902779 17998 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.903141 17998 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.881345 17835 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:29.907016 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.907371 17976 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:29.908228 17873 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:29.908635 17976 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:29.909791 15913 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:29.909943 17681 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:29.910188 17976 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:29.910414 17681 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:29.910617 17976 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:29.910804 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:29.911329 17681 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.911475 17976 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.912029 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:29.913640 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:29.915920 17938 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:29.888190 15980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 868) took 2946 ms (client timeout 2070 ms). Trace:
W20260709 12:24:29.918318 15980 rpcz_store.cc:269] 0709 12:24:26.941378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.944580 (+  3202us) service_pool.cc:224] Handling call
0709 12:24:29.887787 (+2943207us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54000136d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:29.887978 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209501440}
W20260709 12:24:29.889331 17995 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:24:29.912705 15913 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:29.912745 17976 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.885104 15912 rpcz_store.cc:276] 0709 12:24:27.705881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.707763 (+  1882us) service_pool.cc:224] Handling call
0709 12:24:27.708134 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.708378 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:27.727519 (+ 19141us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.447867 (+1720348us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b1800320380. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe4323a 00007f03cc2ada2a
0709 12:24:29.852269 (+404402us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.859899 (+  7630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:29.867731 (+  7832us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:29.873248 (+  5517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.880949 (+  7701us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.884738 (+  3789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7227,"prepare.queue_time_us":18929,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1780,"raft.queue_time_us":31250,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":3686,"spinlock_wait_cycles":6278016,"thread_start_us":104194,"threads_started":1,"wal-append.queue_time_us":2039078}
W20260709 12:24:29.929137 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49404us
I20260709 12:24:29.932650 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.884231 17790 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.937616 15904 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:29.940068 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.941552 17681 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.944741 17963 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:29.946141 17893 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.920132 17987 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.948495 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.949512 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.951856 17916 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.952216 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:29.952337 17916 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.954466 17916 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:29.868614 17811 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:29.956588 15906 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:29.909803 17873 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:29.957963 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:29.958545 17949 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:29.957772 17963 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.959013 17871 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.959441 17965 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:29.942869 17915 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:29.948772 17987 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:29.971951 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.005013 15913 raft_consensus.cc:2410] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:29.956784 17974 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:29.981933 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48001.7us
I20260709 12:24:29.982034 17520 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:29.982707 17903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.899s	user 0.014s	sys 0.037s
I20260709 12:24:29.983558 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:29.984741 17873 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:29.985226 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:29.986167 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.987056 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.988600 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:29.989358 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:29.990384 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.998461 17949 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:30.003561 17915 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:30.007071 16495 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:29.975522 17573 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:30.016328 15908 raft_consensus.cc:2393] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:30.020942 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.018541 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:30.018744 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:29.996316 17965 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.027468 17965 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.935602 17989 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:24:30.030448 17989 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:30.030861 17989 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:30.031878 17989 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:30.020001 15912 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:30.024901 17873 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:30.014678 17903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.067s	user 0.014s	sys 0.037s
I20260709 12:24:30.034343 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.035264 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:30.009408 17938 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.038734 16490 raft_consensus.cc:2410] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:24:30.034076 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 81955.8us
I20260709 12:24:30.043464 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.051039 15829 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:30.055807 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:29.995096 17790 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.057273 15910 raft_consensus.cc:2393] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:30.056653 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.007969 17871 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.034802 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:30.065796 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:30.039791 17862 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:30.068872 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.044370 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.071660 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:30.072631 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.078225 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:30.069691 17520 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:24:30.097007 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.086920 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.087939 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.059898 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:30.089239 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.090287 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:30.090952 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.090792 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.053829 18005 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.063681 17588 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:30.088179 17965 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.066356 17684 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.129444 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.153970 15984 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:30.057132 17778 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:30.130007 16486 raft_consensus.cc:2368] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:30.129252 17640 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.132537 17580 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.207682 17580 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:30.207795 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.208140 17580 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.208171 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.209867 17790 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:30.129631 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.161339 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.211411 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:30.098912 17989 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.101940 17938 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:30.099519 17862 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:30.197047 18001 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:24:30.197911 17974 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:30.205026 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:30.207151 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.163888 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.216853 17862 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:30.215087 17938 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:30.194463 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 132252us
I20260709 12:24:30.223531 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.207865 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.224376 15832 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:30.227672 15835 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
W20260709 12:24:30.224750 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 146563us
I20260709 12:24:30.204593 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:30.199494 17915 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.241334 15802 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:30.245865 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.248239 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.236687 17861 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.261229 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.275875 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.218545 17949 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.229318 17640 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:30.281028 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.279918 17862 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:30.287377 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.274502 17861 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:30.292891 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.293773 15834 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
W20260709 12:24:30.296804 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45955us
I20260709 12:24:30.300012 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.300861 15837 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:30.300971 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.301924 15838 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:30.301996 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.303146 15836 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:30.306622 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:30.314666 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 96371.6us
I20260709 12:24:30.317055 18011 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:30.320288 17861 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:30.321025 17684 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.321568 17684 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.323612 17684 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:30.328693 17640 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:30.330385 15832 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:30.333503 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:30.314782 17862 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:30.335188 17862 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.336498 17588 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:30.336961 17588 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.289710 17580 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.338892 17580 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:30.341708 17998 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:30.349180 17915 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:30.351444 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:30.351987 15913 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.352341 15908 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:30.350756 17811 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:30.331282 18012 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:24:30.355979 17778 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:30.357404 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.356356 17998 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:30.358632 17965 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:30.360001 18015 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:30.358160 15911 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:30.368623 15913 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:30.283978 17938 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.369385 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.388288 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.391733 15908 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:24:30.369086 18012 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:30.406930 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.412768 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.421665 15908 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:30.422684 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:30.423411 15908 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:30.423820 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.424068 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.430100 15832 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:30.430150 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.457837 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.457837 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.458881 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:30.459964 15906 raft_consensus.cc:2368] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:30.458060 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.465118 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.463960 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.465754 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.466583 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.467211 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.468325 15838 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:30.465922 15910 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:30.470490 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.471055 15913 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:30.472148 15837 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:30.473268 15909 raft_consensus.cc:1217] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:24:30.474092 15836 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:30.475920 15909 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:30.476572 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:30.479943 17942 consensus_meta.cc:287] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:24:30.479669 17588 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:30.480356 17942 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.481264 16490 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:30.482684 18026 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:30.483338 18026 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.485838 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:30.486223 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.487488 15913 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:30.488597 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.489625 15906 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:24:30.487419 15831 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:30.490098 15906 pending_rounds.cc:85] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 3
I20260709 12:24:30.551362 15906 pending_rounds.cc:107] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:30.551775 15906 raft_consensus.cc:2889] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:30.561609 15911 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:30.485461 17871 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:30.483783 17969 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:24:30.569597 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:30.635934 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.819191 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:30.752240 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:30.835281 15913 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 1.
I20260709 12:24:30.823094 15831 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
W20260709 12:24:30.820104 18021 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:24:30.849788 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:30.850425 15911 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:30.719043 18020 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:24:30.811746 17915 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:30.796085 17873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.013s	sys 0.020s
I20260709 12:24:30.868474 15911 raft_consensus.cc:2410] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:30.835583 18026 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:30.857877 17873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.013s	sys 0.024s
I20260709 12:24:30.924330 15836 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:24:30.924434 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:30.930307 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.938189 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:30.917837 18026 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:30.869675 17915 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:30.975041 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:30.971558 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:30.957335 18014 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:30.998518 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:30.999459 18023 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:24:31.000555 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:30.983834 18024 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:24:30.973989 18026 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:31.005646 16488 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.004s
I20260709 12:24:31.013550 16488 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:31.006336 18014 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.049731 18014 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:31.050741 18026 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:31.051548 18026 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.052438 18026 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.056975 17915 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.121696 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.122336 15913 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:31.123975 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 303) took 1035 ms. Trace:
I20260709 12:24:31.085495 18028 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.132404 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:31.133949 15910 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:31.124560 15904 rpcz_store.cc:276] 0709 12:24:30.083874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.116159 (+1032285us) service_pool.cc:224] Handling call
0709 12:24:31.116524 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.116734 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.116767 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.116818 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:31.116855 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.116916 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.117029 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:31.137359 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 136858us
I20260709 12:24:31.139410 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.140146 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.141794 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.140316 15906 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:31.113936 17986 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.150348 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 162980us
I20260709 12:24:31.111436 15730 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 4, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.137050 17562 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:31.145023 18026 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.150825 18029 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.162093 15730 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 3, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 3 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.167536 17778 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.168074 17778 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.169170 17562 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.170078 17778 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.160343 17986 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.176404 17986 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:31.153486 17942 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.176136 15730 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.176999 17942 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.178005 15730 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:31.179183 17942 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.180260 16496 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:31.182500 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1425) took 1022 ms. Trace:
I20260709 12:24:31.182893 15829 rpcz_store.cc:276] 0709 12:24:30.160431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.160579 (+   148us) service_pool.cc:224] Handling call
0709 12:24:31.182301 (+1021722us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54000901d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:31.182421 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176541056}
I20260709 12:24:31.183923 15730 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.185545 15730 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 4, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 4 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.187285 15730 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 4, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 4 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.189188 17562 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.163525 16459 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:24:31.200380 16495 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 365) took 1600 ms (client timeout 1587 ms). Trace:
W20260709 12:24:31.200800 16495 rpcz_store.cc:269] 0709 12:24:29.600191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.602028 (+  1837us) service_pool.cc:224] Handling call
0709 12:24:31.200190 (+1598162us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:31.200290 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685411072}
I20260709 12:24:31.205191 17562 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:31.205646 17562 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:31.206065 17562 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.206781 17778 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.207329 17778 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.210953 17811 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:31.212255 17916 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:31.215142 17562 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.230413 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:31.231978 15910 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:31.228669 15730 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 4, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 4 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:24:31.235744 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.236123 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.237982 16495 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:31.237195 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.243681 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.246416 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.244287 15730 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to <none>, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:24:31.248551 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 96980.4us
I20260709 12:24:31.252502 17862 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:31.241909 17965 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.259943 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:31.260780 15835 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:31.262774 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:31.262816 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:31.263784 15835 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:31.265412 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 492) took 1106 ms. Trace:
I20260709 12:24:31.265249 17965 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.265801 16488 rpcz_store.cc:276] 0709 12:24:30.159119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.192984 (+ 33865us) service_pool.cc:224] Handling call
0709 12:24:31.265250 (+1072266us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540039c1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:31.265354 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618163584}
I20260709 12:24:31.267056 16486 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:31.267622 17965 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:31.268460 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.248054 17836 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:31.278191 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:31.256508 17987 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.271250 15730 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.248086 17778 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.279572 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:31.282131 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.284989 17778 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.280936 17836 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:31.286401 17778 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:31.286609 17836 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.289413 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:31.290807 17987 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.286993 17778 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.291505 16489 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:31.293766 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:31.257530 17862 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:31.295195 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:31.295758 15904 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.296361 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:31.295548 15730 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:24:31.297995 18032 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:24:31.298594 18022 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:31.299002 18030 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.285s	user 0.002s	sys 0.008s
I20260709 12:24:31.299189 18022 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.298094 15730 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:31.295360 18026 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:24:31.304441 15986 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:31.305497 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.305400 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.306697 15910 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:31.307937 15907 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:31.308529 15986 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 905) took 1288 ms (client timeout 1521 ms). Trace:
I20260709 12:24:31.308456 15730 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.279441 17562 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:31.309091 15986 rpcz_store.cc:269] 0709 12:24:30.017754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.017882 (+   128us) service_pool.cc:224] Handling call
0709 12:24:31.268305 (+1250423us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:31.306113 (+ 37808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24247040}
W20260709 12:24:31.300967 18035 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 12:24:31.295491 18039 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:31.313954 15904 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:31.314697 15911 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:31.313483 15905 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:31.316849 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.319721 15730 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 6, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.322731 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.323438 15910 raft_consensus.cc:2368] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:31.315804 18046 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:31.328467 15835 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:31.330552 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:31.331048 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:31.326675 17987 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.331809 17778 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.332316 18014 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.332767 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:31.333278 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 301) took 1367 ms. Trace:
I20260709 12:24:31.333484 15837 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:31.333797 15912 rpcz_store.cc:276] 0709 12:24:29.966280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.973516 (+  7236us) service_pool.cc:224] Handling call
0709 12:24:29.973793 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.033331 (+ 59538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.333025 (+1299694us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b5400430654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:31.333223 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105894784}
I20260709 12:24:31.334594 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:31.335155 15911 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.335459 18046 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:31.328117 17965 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:24:31.337751 18046 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.340372 17588 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:31.352038 17687 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.298627 17862 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.354979 15829 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:31.327955 18050 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:31.343200 15911 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:31.345840 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.354707 15730 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.365912 15905 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:31.351154 17778 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:31.351576 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:31.318790 18039 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.368431 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.369489 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.370134 18039 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.370445 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:31.371193 16488 raft_consensus.cc:2410] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:31.371376 15831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:24:31.372136 15831 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:31.372217 17862 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.375682 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:31.376895 18050 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.379379 17588 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:31.379971 18050 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:31.379886 17588 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:31.381562 18022 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:31.381708 15730 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 5, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:31.382519 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:31.383143 15730 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:31.372485 15831 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.384198 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.385020 15985 raft_consensus.cc:2410] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:31.385262 18029 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:31.385936 18029 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:31.383579 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.386909 15986 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.387310 15981 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:31.387934 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 904) took 1374 ms. Trace:
I20260709 12:24:31.387109 18029 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.388213 15981 rpcz_store.cc:276] 0709 12:24:30.013224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.013384 (+   160us) service_pool.cc:224] Handling call
0709 12:24:31.386975 (+1373591us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:31.387154 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.387721 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.387884 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30224640}
I20260709 12:24:31.392064 15987 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:31.393020 15950 leader_election.cc:336] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.553s (SENT)
I20260709 12:24:31.393476 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:31.394608 17916 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.366904 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:31.398679 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:31.399327 15950 leader_election.cc:336] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.557s (SENT)
I20260709 12:24:31.342267 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:31.399911 15986 raft_consensus.cc:2410] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:31.403000 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.405507 17987 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:31.405920 17987 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:31.409409 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.409510 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.411332 15986 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.413530 15987 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:31.415320 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.416060 15981 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.416908 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.417526 15982 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:31.417644 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.418473 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.332777 18014 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.431106 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 974) took 1080 ms. Trace:
I20260709 12:24:31.406306 17987 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:31.411810 15831 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:31.434712 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.435160 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:31.432860 15909 rpcz_store.cc:276] 0709 12:24:30.350749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.350867 (+   118us) service_pool.cc:224] Handling call
0709 12:24:30.425679 (+ 74812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.486403 (+ 60724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.430847 (+944444us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54001c4b50. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:31.431026 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171226496}
I20260709 12:24:31.443243 15986 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:31.453751 18014 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:31.473995 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74680.7us
I20260709 12:24:31.433120 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.419396 18047 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.458171 15982 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:32.284221 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:31.434262 18050 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.285099 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 494) took 1019 ms. Trace:
I20260709 12:24:32.285523 16495 rpcz_store.cc:276] 0709 12:24:31.265399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.273094 (+  7695us) service_pool.cc:224] Handling call
0709 12:24:32.284058 (+1010964us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:32.285027 (+   969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7284480}
I20260709 12:24:32.286144 18047 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.286834 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:32.286801 18047 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:32.287653 16495 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:31.660946 18026 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.259390 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:32.288573 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:32.288494 18026 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:32.289485 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:32.289991 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 383) took 1837 ms. Trace:
I20260709 12:24:32.290351 15832 rpcz_store.cc:276] 0709 12:24:30.452800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.289291 (+1836491us) service_pool.cc:224] Handling call
0709 12:24:32.289555 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.289708 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.289731 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.289768 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:32.289796 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.289848 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.289942 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.291108 18026 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:31.697836 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.661082 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.320320 15836 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
W20260709 12:24:32.176622 15912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.008s	sys 0.021s
W20260709 12:24:32.321748 15912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.009s	sys 0.025s
I20260709 12:24:32.322675 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 317) took 1016 ms. Trace:
I20260709 12:24:32.323112 15912 rpcz_store.cc:276] 0709 12:24:31.306572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.334725 (+ 28153us) service_pool.cc:224] Handling call
0709 12:24:31.335019 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.335204 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:31.456589 (+121385us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.322306 (+865717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.322373 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:32.322434 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.322517 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.322629 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116212,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":33,"thread_start_us":964683,"threads_started":2}
I20260709 12:24:32.324220 17640 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.475075 17778 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.324919 17640 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:32.327616 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:32.328209 15909 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:31.719158 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:31.456275 17949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.007s	sys 0.049s
I20260709 12:24:32.175401 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:31.714680 17588 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:32.292973 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:31.766070 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.338053 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.293870 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:32.268601 15985 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.865s	user 0.007s	sys 0.000s
I20260709 12:24:32.338924 15985 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:32.340929 16457 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:32.294267 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:32.295080 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.614992 17687 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.614965 18051 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.433310 18049 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.296868 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:31.530169 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:31.585386 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:31.619092 15834 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:24:32.298306 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:32.365177 15834 pending_rounds.cc:85] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 3
I20260709 12:24:32.365540 15834 pending_rounds.cc:107] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 12:24:32.217456 16492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.000s	sys 0.017s
I20260709 12:24:32.365938 15834 raft_consensus.cc:2889] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:31.690879 18038 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.309458 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:32.310235 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:32.369999 15907 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.370800 15911 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:32.311116 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:32.312183 15905 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:32.316164 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:32.373138 15913 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:32.327769 16493 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:31.711354 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 276254us
I20260709 12:24:32.379557 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.381743 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:32.330051 15988 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:31.713312 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 371092us
I20260709 12:24:32.385571 15879 leader_election.cc:400] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:32.385900 15879 leader_election.cc:403] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:32.332324 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.333348 16495 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:32.334663 15829 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.334391 15831 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:32.342036 15984 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:24:32.334537 17949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.010s	user 0.013s	sys 0.076s
I20260709 12:24:32.328511 17640 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:32.364480 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:32.365404 15987 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
W20260709 12:24:32.217226 17836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.013s	sys 0.014s
W20260709 12:24:32.366077 16492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.000s	sys 0.020s
I20260709 12:24:31.736835 18045 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:32.366911 15981 consensus_meta.cc:287] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.947s	user 0.009s	sys 0.001s
I20260709 12:24:32.358006 17687 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:32.357172 15980 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.329739 16459 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:24:32.403757 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74095.1us
W20260709 12:24:32.386416 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.390077 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:32.355432 18049 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.392151 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2334) took 1023 ms. Trace:
I20260709 12:24:32.409240 15832 rpcz_store.cc:276] 0709 12:24:31.368852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.332038 (+963186us) service_pool.cc:224] Handling call
0709 12:24:32.392055 (+ 60017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.410209 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:32.394809 16460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.014s
W20260709 12:24:32.411007 16460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.014s
I20260709 12:24:32.396601 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:32.396697 15981 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:32.398555 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2326) took 1943 ms. Trace:
I20260709 12:24:32.413967 15986 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:32.400538 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:32.401530 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57462 (request call id 2328) took 1025 ms. Trace:
I20260709 12:24:32.414961 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1469) took 1019 ms. Trace:
W20260709 12:24:32.397715 17836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.015s	sys 0.016s
I20260709 12:24:32.413787 15834 rpcz_store.cc:276] 0709 12:24:30.455377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.441260 (+985883us) service_pool.cc:224] Handling call
0709 12:24:31.585542 (+144282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.398264 (+812722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.398478 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.417155 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.433444 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.421510 17938 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.434548 17938 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:32.436529 17938 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:32.430593 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 45199.2us
I20260709 12:24:32.402669 17861 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.440961 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:32.395092 16487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 580) took 1991 ms (client timeout 1626 ms). Trace:
I20260709 12:24:32.415138 15831 rpcz_store.cc:276] 0709 12:24:31.367227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.371228 (+  4001us) service_pool.cc:224] Handling call
0709 12:24:32.388051 (+1016823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.438951 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.415467 15981 rpcz_store.cc:276] 0709 12:24:31.395757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.398092 (+  2335us) service_pool.cc:224] Handling call
0709 12:24:32.414889 (+1016797us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.429100 15910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.015s	sys 0.013s
I20260709 12:24:32.412117 18049 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.458153 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:32.458669 15987 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.458755 15838 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:32.456085 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.456591 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.460326 15831 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:32.446305 17747 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:32.457001 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:32.463557 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2329) took 1096 ms. Trace:
I20260709 12:24:32.464047 15838 rpcz_store.cc:276] 0709 12:24:31.367564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.458207 (+1090643us) service_pool.cc:224] Handling call
0709 12:24:32.458491 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.463229 (+  4738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.463487 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.395709 18038 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:32.430339 18046 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.473519 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.430918 17949 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
W20260709 12:24:32.457290 15910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.015s	sys 0.013s
I20260709 12:24:32.438869 18061 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:32.471303 15904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.008s	sys 0.022s
W20260709 12:24:32.512508 15904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.008s	sys 0.022s
W20260709 12:24:32.480324 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 189581us
I20260709 12:24:32.512771 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.513392 15831 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:24:32.513650 15950 leader_election.cc:336] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.649s (SENT)
I20260709 12:24:32.509784 15838 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:32.515473 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2336) took 1146 ms. Trace:
I20260709 12:24:32.523168 15829 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:32.526199 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2332) took 1157 ms. Trace:
I20260709 12:24:32.409595 18045 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:32.528745 15950 leader_election.cc:336] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.639s (SENT)
I20260709 12:24:32.529381 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:32.515899 15838 rpcz_store.cc:276] 0709 12:24:31.369676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.464964 (+1095288us) service_pool.cc:224] Handling call
0709 12:24:32.474789 (+  9825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.515186 (+ 40397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.515412 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.421828 17640 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:24:32.526428 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.531148 15834 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:32.526525 15829 rpcz_store.cc:276] 0709 12:24:31.368341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.165160 (+796819us) service_pool.cc:224] Handling call
0709 12:24:32.526142 (+360982us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.510865 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.470709 18062 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.534756 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:32.535347 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 119435us
I20260709 12:24:32.512259 18050 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:32.532842 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.537350 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 103991us
W20260709 12:24:32.533438 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 114961us
I20260709 12:24:32.472906 17747 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:32.473156 18046 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.515753 17965 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:32.550290 15834 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:32.556339 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2337) took 1186 ms. Trace:
I20260709 12:24:32.556704 15834 rpcz_store.cc:276] 0709 12:24:31.370054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.531834 (+1161780us) service_pool.cc:224] Handling call
0709 12:24:32.549978 (+ 18144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.556117 (+  6139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.556288 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.529547 17949 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.550488 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:32.448231 16487 rpcz_store.cc:269] 0709 12:24:30.399209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.404765 (+  5556us) service_pool.cc:224] Handling call
0709 12:24:32.292837 (+1888072us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:32.383026 (+ 90189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12350208}
I20260709 12:24:32.552347 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.562323 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.553392 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2338) took 1183 ms. Trace:
I20260709 12:24:32.563069 15829 rpcz_store.cc:276] 0709 12:24:31.370427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.532101 (+1161674us) service_pool.cc:224] Handling call
0709 12:24:32.532381 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.536971 (+  4590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.537003 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.553162 (+ 16159us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.553203 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.553258 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.553346 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.553828 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2261) took 1243 ms. Trace:
I20260709 12:24:32.555199 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.565569 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:32.530658 17836 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:32.569681 15831 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:32.531311 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:32.535588 17754 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.564306 15904 rpcz_store.cc:276] 0709 12:24:31.310520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.392327 (+ 81807us) service_pool.cc:224] Handling call
0709 12:24:31.392641 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.392852 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:31.587644 (+194792us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.553522 (+965878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.553568 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:32.553606 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.553682 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.553777 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58821,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"thread_start_us":1052153,"threads_started":3}
I20260709 12:24:32.583163 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:32.584263 15838 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 5. Ops: []
I20260709 12:24:32.589596 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:32.591384 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2339) took 1220 ms. Trace:
I20260709 12:24:32.591882 15838 rpcz_store.cc:276] 0709 12:24:31.372829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.581864 (+1209035us) service_pool.cc:224] Handling call
0709 12:24:32.582244 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.590809 (+  8565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.591301 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.557732 18046 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.601738 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.549947 17811 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:32.569556 17778 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:32.604825 15835 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:32.624277 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2333) took 1255 ms. Trace:
I20260709 12:24:32.605726 15834 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:32.605871 15829 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
I20260709 12:24:32.569556 17949 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.579499 18061 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:32.622558 15803 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:32.622809 15988 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:32.616876 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:32.585681 17754 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.619244 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:32.590837 18047 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:32.626912 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 48839.6us
W20260709 12:24:32.672817 18065 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:24:32.658533 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2335) took 1289 ms. Trace:
I20260709 12:24:32.658680 17811 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:32.673142 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:32.627063 18077 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:32.624711 15835 rpcz_store.cc:276] 0709 12:24:31.368594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.592306 (+1223712us) service_pool.cc:224] Handling call
0709 12:24:32.592556 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.624017 (+ 31461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.624212 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.627461 17687 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:32.556578 18062 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:32.580961 17965 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:32.625509 18076 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:32.626830 18044 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:24:32.586660 17836 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:32.951190 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 323) took 1494 ms. Trace:
W20260709 12:24:32.847831 18068 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:24:33.059513 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2260) took 1751 ms. Trace:
I20260709 12:24:33.059965 15910 rpcz_store.cc:276] 0709 12:24:31.308094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.390610 (+ 82516us) service_pool.cc:224] Handling call
0709 12:24:31.390892 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.424836 (+ 33944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.424874 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.425392 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.510036 (+1084644us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:32.510078 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.510209 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.059261 (+549052us) raft_consensus.cc:1685] finished
0709 12:24:33.059289 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.059443 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33587,"raft.queue_time_us":43334,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":74858,"thread_start_us":870198,"threads_started":1,"wal-append.queue_time_us":1019236}
W20260709 12:24:32.909744 18057 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 12:24:32.747316 17562 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:33.057281 15986 rpcz_store.cc:276] 0709 12:24:31.456536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.456684 (+   148us) service_pool.cc:224] Handling call
0709 12:24:32.413752 (+957068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.414654 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.950898 (+536244us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b540036e2d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:32.951099 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200318208}
W20260709 12:24:32.896483 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 329558us
W20260709 12:24:32.750303 18055 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 12:24:32.672529 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.068965 18074 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.070093 17778 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.627717 17949 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:33.038736 17987 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.564s	user 0.007s	sys 0.004s
I20260709 12:24:33.085807 18074 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.086843 17987 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.088290 18074 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:32.841832 18047 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:32.724742 15837 rpcz_store.cc:276] 0709 12:24:31.369138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.591202 (+1222064us) service_pool.cc:224] Handling call
0709 12:24:32.620182 (+ 28980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.625379 (+  5197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.625413 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.658196 (+ 32783us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:32.658258 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.658342 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.658479 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.755816 18054 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:24:33.089151 18036 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.755141 18059 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:24:33.063436 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2253) took 1758 ms. Trace:
I20260709 12:24:33.089756 18036 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.089881 15906 rpcz_store.cc:276] 0709 12:24:31.304953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.305141 (+   188us) service_pool.cc:224] Handling call
0709 12:24:31.312262 (+  7121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.324370 (+ 12108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.324401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.329957 (+  5556us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.614944 (+284987us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:31.614986 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.615056 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.063232 (+1448176us) raft_consensus.cc:1685] finished
0709 12:24:33.063258 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.063380 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6847,"raft.queue_time_us":8347,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":2236,"thread_start_us":249263,"threads_started":1,"wal-append.queue_time_us":1102826}
I20260709 12:24:32.753005 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 588) took 1029 ms. Trace:
W20260709 12:24:32.859257 17862 consensus_meta.cc:287] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.486s	user 0.014s	sys 0.006s
I20260709 12:24:33.091833 18036 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:33.075443 18063 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.492s	user 0.000s	sys 0.000s
I20260709 12:24:33.075846 15979 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
W20260709 12:24:32.750523 18060 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 12:24:33.092628 15832 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:33.092952 18090 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.091535 16486 rpcz_store.cc:276] 0709 12:24:31.723183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.737235 (+ 14052us) service_pool.cc:224] Handling call
0709 12:24:31.746294 (+  9059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.581147 (+834853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.583507 (+  2360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.590650 (+  7143us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:32.601524 (+ 10874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.752697 (+151173us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400619254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:32.752762 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.752930 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846863232}
W20260709 12:24:33.096447 15980 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.001s
I20260709 12:24:33.096789 15980 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:33.097292 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.098378 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.098886 15832 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:32.685137 17754 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.099611 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.100560 18073 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.101125 18073 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.103132 18073 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:32.746210 18064 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:24:33.104771 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 379) took 1708 ms. Trace:
I20260709 12:24:32.848237 18083 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.076071 17811 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:32.812979 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.001065 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 417943us
I20260709 12:24:32.783147 15907 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:32.658739 15981 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.106721 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:32.899475 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2331) took 1531 ms. Trace:
I20260709 12:24:33.107174 15832 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:33.078044 15983 raft_consensus.cc:2410] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:32.630591 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 191696us
I20260709 12:24:33.108609 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:33.047623 17861 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.002s
I20260709 12:24:32.754307 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.116041 15831 raft_consensus.cc:2376] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5. Re-sending same reply.
I20260709 12:24:32.857910 18061 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.135290 18061 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:32.961616 18038 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.135743 18061 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.135942 18038 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:33.025784 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 380) took 1629 ms. Trace:
I20260709 12:24:33.138161 17861 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:32.764575 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 92228.4us
I20260709 12:24:33.081632 15829 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:33.084822 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.085808 15911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:33.154970 15911 raft_consensus.cc:606] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:33.086186 17778 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.086156 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.089347 17987 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.089596 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:33.062948 18049 consensus_meta.cc:287] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.001s
I20260709 12:24:33.109436 15832 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
W20260709 12:24:32.882558 15833 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:24:32.886566 15987 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:32.627185 15838 raft_consensus.cc:2376] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4. Re-sending same reply.
I20260709 12:24:33.148872 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:33.075829 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.859438 18056 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 12:24:33.073809 18029 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:33.198390 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:33.199364 15953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.019s	sys 0.060s
W20260709 12:24:33.008926 16494 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.010s	sys 0.002s
W20260709 12:24:33.199668 15953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.019s	sys 0.060s
W20260709 12:24:33.199781 16494 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.011s	sys 0.003s
I20260709 12:24:33.117017 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:33.199976 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 573653us
I20260709 12:24:33.118089 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.119761 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.120543 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.121819 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.122105 15982 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:33.105118 16496 rpcz_store.cc:276] 0709 12:24:31.396466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.396608 (+   142us) service_pool.cc:224] Handling call
0709 12:24:31.405599 (+  8991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.406026 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:31.406056 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.421816 (+ 15760us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.795047 (+373231us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.795109 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.795210 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.104577 (+1309367us) raft_consensus.cc:1685] finished
0709 12:24:33.104597 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.104720 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":214517,"threads_started":1,"wal-append.queue_time_us":1008373}
I20260709 12:24:33.122591 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.201589 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.201669 18103 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.201989 15984 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:33.202140 15831 raft_consensus.cc:2376] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4. Re-sending same reply.
I20260709 12:24:33.203589 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 399) took 1829 ms. Trace:
I20260709 12:24:33.109450 18077 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:33.200606 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.003333 18046 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.124120 18082 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:33.124238 17836 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:33.124763 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.117550 17862 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:33.117741 18047 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:33.126219 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2256) took 1820 ms. Trace:
I20260709 12:24:33.128477 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.077251 17562 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:33.122625 18076 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.134380 17965 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:32.962904 18045 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:32.764278 17989 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.137737 18090 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:33.064491 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 535755us
I20260709 12:24:33.076418 18062 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.080818 15904 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:33.107477 15830 rpcz_store.cc:276] 0709 12:24:31.368096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.356698 (+988602us) service_pool.cc:224] Handling call
0709 12:24:32.373526 (+ 16828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.437951 (+ 64425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.437979 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.457867 (+ 19888us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.605927 (+148060us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.605962 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.606020 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.899221 (+293201us) raft_consensus.cc:1685] finished
0709 12:24:32.899249 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.899405 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38359,"raft.queue_time_us":55802,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":82648,"threads_started":1,"wal-append.queue_time_us":424829}
W20260709 12:24:33.269728 15950 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.754s (SENT)
I20260709 12:24:33.142554 16492 rpcz_store.cc:276] 0709 12:24:31.396737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.396869 (+   132us) service_pool.cc:224] Handling call
0709 12:24:31.401230 (+  4361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.418507 (+ 17277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.418538 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.419049 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.396057 (+977008us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:32.396093 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.396160 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.025506 (+629346us) raft_consensus.cc:1685] finished
0709 12:24:33.025535 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.025708 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4628,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7759,"thread_start_us":976656,"threads_started":1,"wal-append.queue_time_us":948981}
I20260709 12:24:33.196162 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.156271 15909 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:33.197345 15833 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:33.271294 15981 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:33.197588 15834 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:33.116326 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.132393 17754 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.203971 15831 rpcz_store.cc:276] 0709 12:24:31.374703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.202807 (+1828104us) service_pool.cc:224] Handling call
0709 12:24:33.203109 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.203266 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.203297 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.203343 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:33.203374 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.203433 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.203542 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:33.197919 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49166.1us
W20260709 12:24:33.204138 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 581594us
I20260709 12:24:33.205336 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.206923 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:33.207924 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 89913.7us
I20260709 12:24:32.856567 17747 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.209901 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.242175 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.293468 15837 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:33.242792 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.214418 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2343) took 1563 ms. Trace:
I20260709 12:24:33.153524 18038 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:33.296079 18038 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.296260 15837 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:33.264384 18044 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.298530 18044 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.256994 15908 rpcz_store.cc:276] 0709 12:24:31.305915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.306021 (+   106us) service_pool.cc:224] Handling call
0709 12:24:31.313374 (+  7353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.324895 (+ 11521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.324925 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.328416 (+  3491us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.485680 (+157264us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:31.485736 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.485827 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.744715 (+1258888us) spinlock_profiling.cc:243] Waited 950 us on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:33.125936 (+381221us) raft_consensus.cc:1685] finished
0709 12:24:33.125959 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.126162 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11185,"raft.queue_time_us":14485,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":2186112,"thread_start_us":156842,"threads_started":1,"wal-append.queue_time_us":1143175}
I20260709 12:24:33.273182 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.273785 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.293362 15835 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:33.277549 18077 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.278191 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2342) took 1811 ms. Trace:
I20260709 12:24:33.301417 15831 rpcz_store.cc:276] 0709 12:24:31.466833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.277446 (+1810613us) service_pool.cc:224] Handling call
0709 12:24:33.277741 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.277904 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.277928 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.277965 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.277999 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.278058 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.278142 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:33.262982 15802 connection.cc:256] RPC call timeout handler was delayed by -1.1478197990004446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 12:24:33.202402 18103 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.257869 18033 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:33.317101 18033 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.319568 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:33.319828 18094 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:33.320446 17956 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:33.320267 18038 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:33.281723 15833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2330) took 1903 ms (client timeout 2019 ms). Trace:
W20260709 12:24:33.321267 15833 rpcz_store.cc:269] 0709 12:24:31.367841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.529764 (+161923us) service_pool.cc:224] Handling call
0709 12:24:33.271475 (+1741711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.283349 16459 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:33.322960 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 53265.6us
I20260709 12:24:33.283807 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2340) took 1910 ms. Trace:
I20260709 12:24:33.284221 17687 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:33.272691 15832 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:33.284981 15830 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:24:33.332372 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 59245.6us
I20260709 12:24:33.333554 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2341) took 1911 ms. Trace:
I20260709 12:24:33.334025 15830 rpcz_store.cc:276] 0709 12:24:31.422053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.270331 (+1848278us) service_pool.cc:224] Handling call
0709 12:24:33.284590 (+ 14259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.333251 (+ 48661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.333486 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.334451 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.281761 15904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:33.289134 18091 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.290351 18074 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:33.243888 17861 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.293404 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.341434 15904 raft_consensus.cc:606] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:33.341958 15904 raft_consensus.cc:614] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:33.249701 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49193.6us
I20260709 12:24:33.343768 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:33.344722 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 51408.2us
W20260709 12:24:33.345165 15950 leader_election.cc:336] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.920s (SENT)
I20260709 12:24:33.345603 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:33.294698 15836 rpcz_store.cc:276] 0709 12:24:31.651153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.083740 (+1432587us) service_pool.cc:224] Handling call
0709 12:24:33.214346 (+130606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.264511 17998 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:33.280676 17949 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:33.302531 15802 connection.cc:256] RPC call timeout handler was delayed by -1.1397197990004315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 12:24:33.349224 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.319401 18033 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.292272 17989 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.315003 18102 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.315088 18076 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:33.316607 18046 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.320880 17956 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:33.323836 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.348011 18082 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.324293 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:33.371807 15983 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:33.371948 15837 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:33.322577 17754 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.326169 18039 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:33.294517 15829 raft_consensus.cc:2376] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6. Re-sending same reply.
W20260709 12:24:33.347132 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 85228us
I20260709 12:24:33.346598 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.211735 17987 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.242985 18029 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.322801 18047 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:33.354848 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 48021.9us
I20260709 12:24:33.345100 18091 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.378034 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:33.395390 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.371439 17956 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:33.348954 18090 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:24:33.361788 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.352029 18062 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:33.362888 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.345264 18074 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:33.363422 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.348158 18036 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.365550 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.403911 15832 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.367401 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.404443 15833 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:33.324011 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 50276.1us
I20260709 12:24:33.323879 15834 rpcz_store.cc:276] 0709 12:24:31.373268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.633755 (+1260487us) service_pool.cc:224] Handling call
0709 12:24:33.197271 (+563516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.271676 (+ 74405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.283561 (+ 11885us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540027f1d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:33.283734 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039155968}
I20260709 12:24:33.373762 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.374023 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.262038 17862 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.375000 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.410439 18103 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.361007 17562 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.411550 17562 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.411819 17989 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.349416 15835 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:33.394527 18083 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:33.414690 18061 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.416724 18061 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.376144 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.353374 17965 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.418170 18029 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:33.418288 17965 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:33.418929 17965 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:33.418099 18080 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:33.419917 17965 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.374897 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.421343 17949 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.353835 18073 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.397272 18102 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:33.399808 18076 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:24:33.428143 18038 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.428215 18076 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:33.407830 17987 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:33.429538 17987 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:33.430764 17987 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.353444 17998 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.399196 18098 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.401062 15984 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.433523 18029 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:33.434121 17998 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.434273 18083 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:33.435444 18083 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.401362 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:33.351119 18051 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:24:33.405915 15986 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:33.405951 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.356026 18101 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:24:33.374166 18039 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.395313 18091 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.410043 18074 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.379308 18099 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:33.437816 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.380208 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 579) took 2979 ms. Trace:
I20260709 12:24:33.454726 18051 consensus_queue.cc:1243] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:33.469144 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.466400 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.470489 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:33.435057 17892 consensus_queue.cc:1175] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:33.474942 18103 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:33.468629 17687 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:24:33.471654 18098 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:33.467854 18044 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.475814 18098 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:33.438489 18080 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:33.477352 18080 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.478963 18080 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.480465 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.469587 17588 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:33.481362 17588 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:33.482115 17778 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.455628 18082 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:33.484157 17778 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:33.484277 15911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:33.457547 18039 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.482149 17588 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.486024 17588 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.379841 15952 leader_election.cc:400] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:33.470647 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.487779 15952 leader_election.cc:403] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:33.450559 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72529us
W20260709 12:24:33.454685 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 48807.4us
I20260709 12:24:33.488382 15833 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:33.488652 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:33.489318 15832 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:33.490098 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.458093 16494 rpcz_store.cc:276] 0709 12:24:30.395139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.395349 (+   210us) service_pool.cc:224] Handling call
0709 12:24:31.411360 (+1016011us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:32.008043 (+596683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.008329 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:33.206282 (+1197953us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.368274 (+161992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.368310 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:33.368337 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.368384 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.374345 (+  5961us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400705150. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:33.374443 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12914,"prepare.queue_time_us":1074411,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":23499,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4382,"spinlock_wait_cycles":1421803648,"thread_start_us":1092096,"threads_started":2,"wal-append.queue_time_us":194945}
I20260709 12:24:33.492035 15984 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:24:33.492399 15950 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.019s (SENT)
I20260709 12:24:33.375463 17836 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:33.501227 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 98351.7us
I20260709 12:24:33.371265 18078 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.397780 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:33.502550 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:33.473395 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.458616 18074 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.494393 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:33.206544 18049 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.499635 18082 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.499815 18084 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:33.487564 18061 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:33.502616 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 104914us
I20260709 12:24:33.525246 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:33.474115 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 64817.3us
I20260709 12:24:33.506496 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.506532 15981 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.529371 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.507012 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:33.493925 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 116960us
W20260709 12:24:33.517694 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 51390.4us
I20260709 12:24:33.532745 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.458806 17949 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.437849 18076 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:33.513535 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.470669 18099 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:33.505198 18078 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:33.536182 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.543526 15904 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:33.505295 18103 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.505246 17998 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:33.542429 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 50054.7us
I20260709 12:24:33.513983 17778 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:33.544862 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74296.5us
I20260709 12:24:33.476662 18098 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.541843 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.504781 18039 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.513692 18062 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:24:33.524751 18061 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.544744 18078 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.535071 18047 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:33.605854 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 80674.3us
I20260709 12:24:33.553263 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:33.645648 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 113899us
I20260709 12:24:33.646333 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.647432 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.648494 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:33.607786 15984 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:24:33.649173 15984 pending_rounds.cc:85] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 2
I20260709 12:24:33.649437 15984 pending_rounds.cc:107] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 12:24:33.556880 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.649730 15984 raft_consensus.cc:2889] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:33.608305 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.605713 18044 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.641443 15981 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:33.642812 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.646536 15802 leader_election.cc:400] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3.
I20260709 12:24:33.544094 18090 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.524915 17989 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.670914 16492 raft_consensus.cc:2368] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:33.659523 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.605784 18076 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.652161 15988 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:33.551393 17778 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:33.686866 15984 pending_rounds.cc:85] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 3
I20260709 12:24:33.687168 15984 pending_rounds.cc:107] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:24:33.687402 15984 raft_consensus.cc:2889] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:33.631703 17998 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:24:33.688217 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.651908 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 110153us
I20260709 12:24:33.689365 15952 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.690256 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.638942 18061 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.692806 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.693374 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:33.696880 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.697747 15832 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:33.698057 15911 raft_consensus.cc:606] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.698578 15911 raft_consensus.cc:614] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:33.699764 15907 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:33.688735 18098 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.700404 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:33.701411 15832 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:33.686610 18047 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.702818 18047 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.703389 18047 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:33.699225 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 59194us
I20260709 12:24:33.710173 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.711179 15832 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:33.544916 18070 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 12:24:33.715857 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.716665 15832 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:33.717061 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.713117 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 66701.8us
I20260709 12:24:33.718677 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.720064 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:33.720506 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:33.721520 15835 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.552054 18109 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:33.636226 18094 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:24:33.734525 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.739346 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 206698us
I20260709 12:24:33.688303 17778 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.742208 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:33.744971 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:33.746662 16460 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:33.755177 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.679033 18082 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:24:33.766150 17748 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.740816 17892 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:33.743649 18090 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:33.770036 18044 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.713284 17949 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:24:33.771482 18109 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:33.740950 17861 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.735414 18117 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:33.792202 15835 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:33.799019 15904 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:33.800002 15908 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:33.795625 18121 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.804678 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.781131 18090 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.827932 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:33.829075 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:33.829317 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:33.829591 15832 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:33.830307 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:33.862581 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.862213 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.864455 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:33.772861 18084 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:33.776260 18070 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:33.795718 18087 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.867983 15913 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.799465 18077 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:33.796416 17862 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:33.871719 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:33.873418 18073 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:33.827565 18101 raft_consensus.cc:2764] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:33.825618 18121 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:33.878038 18112 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:33.912665 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.886343 18073 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:33.888897 18106 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:24:33.889959 18115 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:33.800100 18109 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.864817 18090 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.913354 15913 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:33.837359 18044 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:33.863909 18080 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 12:24:33.940801 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 251488us
I20260709 12:24:33.794312 17998 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:33.946445 15905 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:33.938609 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 203057us
I20260709 12:24:33.950209 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:33.899173 18121 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:33.940320 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 305807us
I20260709 12:24:33.936118 18073 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.955580 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:33.914803 18029 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:33.899315 17862 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:24:33.895006 17778 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.895246 18077 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:33.971056 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 251083us
W20260709 12:24:33.964250 17747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.012s	sys 0.021s
I20260709 12:24:33.904810 18091 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:33.994714 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47447.7us
I20260709 12:24:33.964892 18029 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:33.977483 17747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.021s
I20260709 12:24:34.026206 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:34.038005 18091 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.040525 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2369) took 1205 ms. Trace:
I20260709 12:24:34.041103 15838 rpcz_store.cc:276] 0709 12:24:32.835356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.299799 (+464443us) service_pool.cc:224] Handling call
0709 12:24:33.333083 (+ 33284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.347321 (+ 14238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.347352 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.349193 (+  1841us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.606968 (+257775us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.689868 (+ 82900us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.878426 (+188558us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18003a56a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:24:33.953327 (+ 74901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.953399 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.030790 (+ 77391us) raft_consensus.cc:1685] finished
0709 12:24:34.040277 (+  9487us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.040447 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25928,"prepare.queue_time_us":40058,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":24513,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":17981,"spinlock_wait_cycles":9451520,"thread_start_us":576697,"threads_started":3,"wal-append.queue_time_us":284349}
I20260709 12:24:34.043059 18047 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:33.970072 18117 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:33.991297 17892 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.048588 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:33.972139 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.050082 15952 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:34.050484 15910 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.050954 15910 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:34.058477 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.060849 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:34.061669 15983 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.051834 15910 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.064520 15910 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:34.066321 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 94248.2us
I20260709 12:24:34.067061 15802 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:34.053608 17956 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 12:24:34.068974 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.071237 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.072942 15832 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.071866 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:34.079365 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 214992us
I20260709 12:24:34.079792 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:34.080406 15985 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.081221 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.082228 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:34.083957 15950 leader_election.cc:336] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.127s (SENT)
I20260709 12:24:34.069387 18039 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.094446 15910 raft_consensus.cc:2410] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:34.088785 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.078132 17811 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.062990 17892 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.080618 18103 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.102147 15832 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:34.103065 18075 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:24:34.103856 18119 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.089162 17862 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.081633 18126 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.113202 17862 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.113232 18119 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.113796 17862 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.114188 18126 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:34.115108 17892 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.115551 18119 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:34.116146 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:34.121322 18094 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:34.130026 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.130743 15910 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:34.131631 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.134210 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.134660 15909 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:34.141327 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.142025 15909 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:34.142171 15910 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:34.143270 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:34.150725 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 81856.5us
I20260709 12:24:34.074005 17956 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:34.151852 18122 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:34.149235 18137 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.089977 18044 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:24:34.157423 18117 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.158701 18047 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:34.149718 18104 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.731s	user 0.004s	sys 0.000s
I20260709 12:24:34.167026 18134 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:24:34.227453 18134 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:34.227909 18134 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:34.228966 18134 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.230530 18134 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.167681 18132 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.152213 18133 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.170125 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.144933 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:34.232966 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 88112.5us
I20260709 12:24:34.234050 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.234418 17956 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.236689 18090 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.241331 18098 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.183435 15983 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
W20260709 12:24:34.243645 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73624.3us
I20260709 12:24:34.243791 18096 raft_consensus.cc:2764] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:34.244356 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.165354 18103 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:34.217657 18061 consensus_meta.cc:287] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 12:24:34.245446 18061 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.218024 18044 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.218333 16487 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:34.226022 18077 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:34.149325 18125 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.244556 17862 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.248078 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:34.250398 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 117227us
W20260709 12:24:34.238670 18074 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.003s
I20260709 12:24:34.242252 18132 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.270224 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.247452 18146 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.259171 18103 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:34.260362 18125 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:34.271227 18078 consensus_meta.cc:287] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.003s
I20260709 12:24:34.260006 17778 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.269702 18077 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.274923 18132 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:34.313067 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.400717 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.360530 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.361249 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.360092 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.416380 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.427549 15837 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:34.427683 15835 raft_consensus.cc:2368] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:34.370278 15834 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:34.376215 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.430024 15833 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:34.430188 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.430481 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.431305 15835 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
W20260709 12:24:34.387550 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 150211us
I20260709 12:24:34.433081 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.403015 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.437832 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.438423 15829 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:34.439599 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.440094 15829 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:34.428207 15830 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:34.442952 15838 raft_consensus.cc:2368] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:34.446141 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.450815 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.451048 15837 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:34.443845 15831 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:34.452425 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.460229 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.457080 18077 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.461683 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.463227 18077 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.420899 18151 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:24:34.464388 18119 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:34.464745 18119 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:34.465786 18131 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 12:24:34.465572 18119 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:34.467087 18143 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:24:34.442126 18132 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.417390 17862 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.419744 18049 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:34.477823 18129 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.023s	sys 0.049s
I20260709 12:24:34.489554 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36636 (request call id 22) took 1032 ms. Trace:
I20260709 12:24:34.470336 18148 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.217s
I20260709 12:24:34.507680 15911 rpcz_store.cc:276] 0709 12:24:33.457344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.469843 (+ 12499us) service_pool.cc:224] Handling call
0709 12:24:34.470033 (+1000190us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400431554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc29d853 00007f03d126b60a 00007f03ca7f17d4 00007f03ca7f1762 00007f03ca7f1691 00007f03ca7f160c 00007f03ca7f08c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:34.489467 (+ 19434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490260736}
I20260709 12:24:34.511063 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.376194 18141 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:34.490535 15836 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:34.516557 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:34.517133 15904 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:34.491053 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.500530 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 593) took 1100 ms. Trace:
I20260709 12:24:34.518563 16492 rpcz_store.cc:276] 0709 12:24:33.400357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.401128 (+   771us) service_pool.cc:224] Handling call
0709 12:24:34.487477 (+1086349us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54007693d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:34.500477 (+ 13000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536128768}
I20260709 12:24:34.282218 18091 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.357719 18061 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.441854 18125 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.361661 17965 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.513273 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.442837 18078 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.364058 18075 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 12:24:34.530771 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:34.507560 18129 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.024s	sys 0.049s
I20260709 12:24:34.533596 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.514328 17811 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.535519 18141 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:34.549172 15834 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:34.549207 18114 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.537549 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:34.556787 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 292031us
I20260709 12:24:34.557582 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.564811 16494 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:34.566042 16492 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:34.566865 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:34.528429 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 258262us
I20260709 12:24:34.568039 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:34.639133 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 71201.6us
I20260709 12:24:34.639376 15907 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:34.640316 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:34.640853 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:34.537935 18090 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:34.538153 18074 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.536027 18160 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.553192 18118 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:34.659192 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 165636us
I20260709 12:24:34.549556 18145 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 12:24:34.555238 17965 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:34.668722 15802 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.812s (SENT) [suppressed 27 similar messages]
I20260709 12:24:34.646844 18133 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:34.635402 18114 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.684084 18159 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 12:24:34.664443 15904 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:34.574599 18084 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:24:34.697150 18161 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:24:34.652856 18118 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.698336 18118 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:34.660388 18135 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.548s	user 0.003s	sys 0.000s
I20260709 12:24:34.702291 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 932) took 1094 ms. Trace:
I20260709 12:24:34.702656 15980 rpcz_store.cc:276] 0709 12:24:33.607457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.685407 (+ 77950us) service_pool.cc:224] Handling call
0709 12:24:33.740628 (+ 55221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.776409 (+ 35781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.779750 (+  3341us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.877230 (+ 97480us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.009689 (+132459us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.025239 (+ 15550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.031459 (+  6220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.470237 (+438778us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:34.701982 (+231745us) raft_consensus.cc:1685] finished
0709 12:24:34.702006 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.702230 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117225728,"thread_start_us":94647,"threads_started":1,"wal-append.queue_time_us":207446}
I20260709 12:24:34.706069 15836 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.652397 18061 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:34.663758 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.660966 18141 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.732908 18075 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:34.733363 18075 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:34.733731 18075 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:34.734323 18121 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.000s
I20260709 12:24:34.734694 18121 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.736598 18121 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:34.737336 16486 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:34.738561 18099 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:34.741089 18130 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.910s	user 0.003s	sys 0.000s
W20260709 12:24:34.741494 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 77803.7us
I20260709 12:24:34.742340 18133 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.742820 18133 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:34.743214 18170 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:34.742377 15950 leader_election.cc:400] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:34.744457 15950 leader_election.cc:403] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:34.747354 15836 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
W20260709 12:24:34.753247 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 190275us
I20260709 12:24:34.761996 15983 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:34.763000 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:34.764565 15981 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:34.766433 15981 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:34.767505 15980 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:34.664008 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 162804us
I20260709 12:24:34.773829 15953 leader_election.cc:400] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:34.774021 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:34.774652 15982 raft_consensus.cc:606] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:34.775024 15982 raft_consensus.cc:614] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:34.776657 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:34.730902 18155 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:24:34.747907 18147 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:24:34.793839 15906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 332) took 1674 ms (client timeout 1732 ms). Trace:
W20260709 12:24:34.793916 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51693us
W20260709 12:24:34.738577 18073 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.766s	user 0.007s	sys 0.003s
W20260709 12:24:34.775034 18137 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.003s
I20260709 12:24:34.732939 18078 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:34.787689 18134 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 12:24:34.802809 17965 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:34.803740 15906 rpcz_store.cc:269] 0709 12:24:33.119409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.119526 (+   117us) service_pool.cc:224] Handling call
0709 12:24:34.793675 (+1674149us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540010b154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:34.793786 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012325120}
I20260709 12:24:34.802031 18145 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:34.746383 18099 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.804227 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.804316 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:34.826009 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 185812us
W20260709 12:24:34.813482 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 59510.5us
I20260709 12:24:34.833676 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:34.826725 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 121245us
I20260709 12:24:34.836884 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.837584 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:34.837628 15835 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.840662 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:34.841408 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:34.841840 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:34.848469 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:34.914192 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:34.910705 18159 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.917198 18159 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:34.917735 18159 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.921300 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:34.921482 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.922688 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:34.921977 15831 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.930102 18173 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 12:24:34.931008 18142 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:34.931425 18142 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:34.931579 18173 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:34.932183 18173 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:34.922327 17640 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.933601 18047 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.934146 18062 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.934604 18062 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.935904 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:34.935988 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 98469.9us
I20260709 12:24:34.936124 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.937234 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.937384 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.938509 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.938576 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:34.939549 15905 raft_consensus.cc:2410] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:34.943078 18141 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:34.943744 18141 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.803589 18163 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.931802 18142 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.829420 18137 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.828668 18061 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:34.803834 18101 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:24:34.846151 18087 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:24:34.913481 18134 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:34.955456 18134 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.913005 18145 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:34.949620 18161 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:34.958635 18145 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:34.959064 18161 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:34.959254 18145 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.946637 17987 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.961756 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.961401 18061 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:34.961968 17987 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.826701 18073 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:34.965960 18073 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:34.965991 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:34.967530 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:34.968495 15829 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 2: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:34.971868 15980 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:34.969408 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:34.987958 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 139555us
I20260709 12:24:34.989892 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:34.990120 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.990459 15906 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.993499 15907 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
W20260709 12:24:34.994448 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 325758us
I20260709 12:24:34.998364 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.999521 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:35.000852 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:35.002102 15835 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:35.002938 15913 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:35.004521 15835 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:35.005089 15835 pending_rounds.cc:85] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 1
I20260709 12:24:35.006247 15835 pending_rounds.cc:107] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:35.006696 15835 raft_consensus.cc:2889] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.006769 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:35.007309 15950 leader_election.cc:400] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:35.007615 15950 leader_election.cc:403] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:34.995510 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.960254 18161 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.014006 15835 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.015252 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.018004 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.019470 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:35.022132 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:34.998034 18137 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:35.024760 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.002348 18084 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:35.035673 15980 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.067770 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:35.070802 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 101547us
W20260709 12:24:35.082926 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63524.3us
I20260709 12:24:35.085291 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:34.993997 18132 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.025429 18074 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.025609 17836 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.021063 18109 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.082199 18160 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.032449 18163 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.025719 18137 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:35.086673 17987 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.118202 15831 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:34.993499 17640 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.082753 18084 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:35.125970 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.994379 18173 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.107766 17862 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.135584 18124 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.135773 18171 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.137355 18114 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.141264 18174 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:35.141755 18125 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
W20260709 12:24:35.153137 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 58732.6us
I20260709 12:24:35.142292 18162 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:35.142689 18166 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.143100 18168 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:35.145818 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 49250.7us
I20260709 12:24:35.149664 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:35.145700 18126 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.135445 18034 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.123164 18137 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.135519 18084 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.143175 18075 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.141705 18164 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.143885 18119 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.133977 18141 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.119267 18098 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:35.160722 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:35.134799 18163 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.146004 18073 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:24:35.221683 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.223592 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.224323 15879 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.150480 18109 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.149060 17687 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.158618 17862 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.211220 15981 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.215057 15982 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:35.132041 18160 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.228098 18141 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:35.232903 18062 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.233474 18091 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:35.233803 18187 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:35.235114 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.237772 18089 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.237218 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.156381 18125 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.168692 18074 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 12:24:35.253160 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 99017.7us
I20260709 12:24:35.169790 18118 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.230264 18061 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:35.257342 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.203754 18162 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:24:35.259686 15906 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:35.206238 18164 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.269308 15987 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:35.250756 18186 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.161708 18166 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.204356 18034 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.239205 18098 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:24:35.262852 18082 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.278863 15981 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
W20260709 12:24:35.279013 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 56412.8us
I20260709 12:24:35.261289 18062 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.289157 18062 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.291286 18062 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:35.292227 18181 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:24:35.292057 18142 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.243726 17862 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:35.294519 17862 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.295006 17862 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:35.295313 17862 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:35.296066 17862 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.298180 18034 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:35.242483 17687 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.300026 17687 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.276463 18186 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.302359 18186 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:35.305543 15980 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:35.231571 18124 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:35.307174 18124 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.311980 18062 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.312506 18062 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.314661 18062 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.314793 18047 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.315452 18047 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.316057 17965 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:35.316426 17965 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:35.317173 17965 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.318255 17965 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.322049 18125 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:35.323510 18184 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:24:35.323644 18159 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:35.326905 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 104133us
I20260709 12:24:35.336549 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.337361 15834 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
W20260709 12:24:35.339412 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 102262us
I20260709 12:24:35.340763 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:35.241565 18109 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.361578 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.364817 15835 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:24:35.387501 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 46512.5us
I20260709 12:24:35.387811 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.388213 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:35.389281 18191 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:35.391601 18191 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:35.392220 18191 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:35.281211 18132 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.399349 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.402678 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.403273 15981 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:35.403462 18190 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.403980 18190 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.387024 18034 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:35.405360 18171 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.406046 18034 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:35.395905 17640 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.406464 18034 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:35.407306 18034 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.407853 18109 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.386685 18121 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.410252 15835 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.410259 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:35.408444 18034 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.418531 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.413439 18174 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.430604 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.430624 18174 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.399400 18193 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.441367 15835 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:35.414225 18132 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.409732 18163 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.416998 18109 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.464980 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.406050 18190 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.442016 18083 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.446431 18142 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.447489 18164 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.447969 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.447988 17862 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.448506 18166 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.449365 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.449800 18159 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:35.453471 18118 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.423952 18121 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.453974 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:35.454829 16496 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:35.455380 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:35.470372 18133 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.005s
I20260709 12:24:35.429656 18098 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:24:35.429347 18046 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.503932 18046 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.504334 18046 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.428460 18084 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.418293 18047 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.462292 18137 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.465808 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.402796 18145 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.466619 17861 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.448625 18076 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.466290 18109 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.467414 15979 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:35.492173 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:35.457297 18075 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:35.494416 18164 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.495280 17965 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.503285 18098 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:35.463292 18132 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.505834 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.470346 18174 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.510262 15983 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:35.510368 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.510463 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.517333 15987 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.518170 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.472752 18083 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.530161 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.469501 18191 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.533727 15986 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:35.508546 18133 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.545586 16496 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:35.537787 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2390) took 1094 ms. Trace:
I20260709 12:24:35.516621 17861 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.538231 15829 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:35.546372 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.538509 18166 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:35.549017 18161 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:35.550063 18161 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:35.550465 18161 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:35.551191 18101 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.542011 18047 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.543150 18164 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:35.526801 18160 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.530388 18098 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:35.559828 18098 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.560567 18133 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.555656 18141 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.562687 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.563514 18137 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:35.563642 18109 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.548884 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:35.546260 15838 rpcz_store.cc:276] 0709 12:24:34.444906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.452836 (+  7930us) service_pool.cc:224] Handling call
0709 12:24:34.453210 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.453651 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.453690 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.454202 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.830420 (+376218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.916194 (+ 85774us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.916490 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.916588 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.313888 (+397300us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b1800012100. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:24:35.315770 (+  1882us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b1800012100. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:24:35.456127 (+140357us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b1800012100. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:24:35.537587 (+ 81460us) raft_consensus.cc:1685] finished
0709 12:24:35.537608 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.537733 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5210,"prepare.queue_time_us":90553,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1825,"raft.queue_time_us":7672,"raft.run_cpu_time_us":1713,"raft.run_wall_time_us":35233,"spinlock_wait_cycles":88398336,"thread_start_us":310233,"threads_started":1,"wal-append.queue_time_us":435167}
I20260709 12:24:35.555090 15987 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:35.555882 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.551542 18161 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.530867 17965 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.551721 18101 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.527007 18029 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.570528 16494 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:35.662559 18102 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.623051 15905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:36636
I20260709 12:24:35.877624 18137 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.624782 18047 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.560925 18098 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.560603 17861 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.834556 15834 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:35.878509 18137 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.582149 15907 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:35.880998 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.881301 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.707226 18061 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.882230 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.882310 18061 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.883193 15988 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:35.883643 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.884532 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.884891 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.885200 15988 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:35.567658 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:35.852506 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.887756 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:35.886436 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 337620us
I20260709 12:24:35.886523 18062 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.888893 18062 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.889297 18062 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.579596 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 500) took 1500 ms. Trace:
I20260709 12:24:35.626650 18164 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:35.634016 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.891144 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:35.891507 17862 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.892176 18109 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.892843 18109 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:35.885171 18061 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.895138 18160 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:35.894111 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.893895 18109 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.895275 18047 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:35.895670 18160 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.896119 18061 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.893991 18164 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:35.897904 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.901778 15913 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:35.905524 15838 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:35.906620 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.907296 15838 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:35.806133 18121 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.908907 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.909483 15838 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:35.910569 18029 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.910521 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:35.911506 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.912844 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.914085 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:35.915337 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.915380 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.915958 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.634660 18141 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:35.920867 18141 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:35.627826 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1468) took 1094 ms. Trace:
I20260709 12:24:35.926604 17965 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.927139 17965 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.927649 17965 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.930768 17965 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.928802 18161 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.931236 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:35.889320 15831 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.924480 15836 rpcz_store.cc:276] 0709 12:24:34.533024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.557341 (+ 24317us) service_pool.cc:224] Handling call
0709 12:24:35.627593 (+1070252us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400082d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:35.627749 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330619648}
I20260709 12:24:35.892238 17862 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.927824 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.896698 18061 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.953377 16496 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:35.889993 16486 rpcz_store.cc:276] 0709 12:24:34.079219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.079820 (+   601us) service_pool.cc:224] Handling call
0709 12:24:34.098815 (+ 18995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.737749 (+638934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.579294 (+841545us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b540039c1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:35.579519 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454787840}
I20260709 12:24:35.954833 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:35.957645 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.958227 15836 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:35.959158 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:35.958916 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.935659 18132 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.963402 15835 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 12:24:35.963510 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:35.935535 18145 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:35.961270 15831 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:35.935750 18101 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.964820 15835 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:35.970371 15836 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:35.944021 18049 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:35.971246 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:35.877511 18102 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.956503 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.962666 18051 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.985869 15831 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:24:35.962011 18091 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:35.986431 15831 pending_rounds.cc:85] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 4
I20260709 12:24:35.987711 15831 pending_rounds.cc:107] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:35.969972 18166 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:35.981177 18160 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.981714 17862 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.972512 18049 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:35.982666 16493 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:35.954563 18046 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:35.983441 18161 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:35.986577 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.988179 15831 raft_consensus.cc:2889] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.987950 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.979121 18102 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:35.973014 18047 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:35.987071 18083 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.020375 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.020709 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.047197 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:35.974676 18141 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:36.017395 18091 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:36.057765 18076 consensus_meta.cc:287] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:24:36.017609 18166 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.016983 18126 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:36.062721 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.062968 15837 raft_consensus.cc:2410] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:36.058439 18046 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.045607 18049 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.056272 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.245294 15980 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.019678 18191 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:36.025075 18051 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:36.467326 15980 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:36.446900 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 475658us
I20260709 12:24:36.065425 18166 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:36.451763 15986 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:36.064991 18141 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.450341 18061 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:36.485555 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.486577 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.486882 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.484230 18141 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:36.487437 15985 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:36.487743 15983 raft_consensus.cc:2410] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:36.488510 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:36.469645 15950 leader_election.cc:336] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.081s (SENT)
I20260709 12:24:36.490574 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.492192 15983 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:36.245072 18126 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:36.495170 18062 consensus_meta.cc:287] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 12:24:36.492727 15950 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:36.491112 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:36.495966 18191 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.495672 18062 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.498772 18062 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:36.499926 18098 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.001s
W20260709 12:24:36.313915 18205 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
W20260709 12:24:36.344175 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.500746 15838 raft_consensus.cc:2410] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:36.500586 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:36.501773 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.502262 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.502192 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:36.503459 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.503513 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.505023 15829 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:36.505213 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:36.506095 15831 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:36.487473 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.506974 15984 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:36.507421 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:36.508211 15831 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:36.508000 18051 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.508286 18141 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.325569 16486 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:36.510613 18141 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.450897 18091 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.488993 15981 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:36.513329 18029 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 12:24:36.514598 18083 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:36.515009 18083 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:36.515817 18083 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.516496 18166 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.517030 18083 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.495333 18126 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.522615 15833 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:36.523041 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.495160 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.534147 15980 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
W20260709 12:24:36.737726 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.744325 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:36.651039 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.749002 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 162255us
I20260709 12:24:36.746594 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:36.673939 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.721019 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.536275 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2395) took 2088 ms. Trace:
I20260709 12:24:36.768903 15837 rpcz_store.cc:276] 0709 12:24:34.447996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.452186 (+  4190us) service_pool.cc:224] Handling call
0709 12:24:36.531252 (+2079066us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540024f4d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:36.536192 (+  4940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3685440896}
W20260709 12:24:36.765847 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 296243us
I20260709 12:24:36.726114 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.610505 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.773068 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.773705 15837 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:36.771620 16496 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:36.803128 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.523730 18095 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.602417 18134 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:36.809638 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:36.815461 15837 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:36.523883 18128 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.725679 18098 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:36.811259 16457 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.000s	sys 0.036s
W20260709 12:24:36.829376 16457 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.000s	sys 0.036s
I20260709 12:24:36.534183 18190 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.773115 15986 raft_consensus.cc:2410] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:36.530694 18191 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:36.817557 15836 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.124s	sys 0.152s
I20260709 12:24:36.818418 15829 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:36.833074 15836 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.124s	sys 0.153s
I20260709 12:24:36.800278 17588 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:36.807684 18126 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.812911 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.599776 18151 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:36.827031 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.580246 18156 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:36.829800 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 744412us
I20260709 12:24:36.801286 18141 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:36.814585 18082 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:36.863374 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:36.868012 15831 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.518949 18166 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.866057 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.558733 18049 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.870275 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.870280 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:36.873782 15981 raft_consensus.cc:2410] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:36.873977 15829 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:36.843618 18203 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.598s	user 0.001s	sys 0.012s
I20260709 12:24:36.771034 18161 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:24:36.878703 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:36.844228 18209 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:24:36.842942 18164 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.882937 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:36.897953 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 120185us
I20260709 12:24:36.898285 16492 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:36.877664 18166 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:36.885293 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:36.866994 17588 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.900135 15829 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:36.833294 18098 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.906211 15831 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:36.872889 18134 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:36.817605 18095 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.897250 16488 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:36.883672 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.833896 18128 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.900640 18091 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.902127 16459 leader_election.cc:336] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.732s (SENT)
I20260709 12:24:36.850500 18190 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.862931 18126 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.893121 16490 raft_consensus.cc:2393] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:36.902961 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:36.903393 15980 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:37.071444 15980 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:36.869552 18156 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.901338 18166 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:36.900662 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:36.940193 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1481) took 1041 ms. Trace:
I20260709 12:24:37.073733 15838 rpcz_store.cc:276] 0709 12:24:35.899197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.915125 (+ 15928us) service_pool.cc:224] Handling call
0709 12:24:36.940009 (+1024884us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400291654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:36.940130 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344271744}
I20260709 12:24:36.877077 18082 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:36.901371 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:36.967271 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1488) took 1066 ms. Trace:
I20260709 12:24:37.109571 15836 rpcz_store.cc:276] 0709 12:24:35.901120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.973456 (+ 72336us) service_pool.cc:224] Handling call
0709 12:24:35.973771 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.973975 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:36.833763 (+859788us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.966825 (+133062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.966893 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:36.966957 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.967046 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.967199 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1049615,"raft.queue_time_us":157,"spinlock_wait_cycles":86285184,"thread_start_us":978697,"threads_started":2}
I20260709 12:24:37.112233 15836 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:37.072464 15980 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.134825 15980 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.061635 17588 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.156137 16486 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.946346 18168 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:37.004766 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.059988 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:37.060348 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:36.942561 18178 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.990s	user 0.010s	sys 0.008s
I20260709 12:24:37.108219 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:36.906375 18164 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:37.172998 18211 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 12:24:37.410375 17588 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:37.410593 18174 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:37.411020 17588 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:37.411329 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1467) took 2878 ms. Trace:
I20260709 12:24:37.411183 18174 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.411887 15830 rpcz_store.cc:276] 0709 12:24:34.532615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.532806 (+   191us) service_pool.cc:224] Handling call
0709 12:24:34.533142 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.533505 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.533533 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:34.549571 (+ 16038us) log.cc:844] Serialized 52 byte log entry
0709 12:24:34.945339 (+395768us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:34.945385 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.945447 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.808475 (+1863028us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:37.411013 (+602538us) raft_consensus.cc:1685] finished
0709 12:24:37.411034 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.411250 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2512,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":11798,"spinlock_wait_cycles":43206400,"thread_start_us":376237,"threads_started":1,"wal-append.queue_time_us":383687}
W20260709 12:24:37.341454 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.413528 17588 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.218310 15838 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:36.977934 15829 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:37.415287 18164 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.413755 18174 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:37.409451 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:37.416232 18174 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.060194 18091 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.416661 15983 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.416864 18174 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.418160 18091 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.175786 18156 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.172761 18082 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.069574 18103 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.419314 18174 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:37.419616 18103 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:37.416229 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.421658 18103 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:36.965157 18134 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:37.411164 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 416748us
I20260709 12:24:37.424302 18134 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.165222 18219 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:37.425426 18219 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:37.170959 18166 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.177914 18095 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.157919 18049 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.181898 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1486) took 1281 ms. Trace:
I20260709 12:24:37.437644 15835 rpcz_store.cc:276] 0709 12:24:35.900580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.973389 (+ 72809us) service_pool.cc:224] Handling call
0709 12:24:36.467037 (+493648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.481603 (+ 14566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.481635 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.559840 (+ 78205us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.897568 (+337728us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:36.897606 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.897675 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.181642 (+283967us) raft_consensus.cc:1685] finished
0709 12:24:37.181677 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.181830 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21898,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":337378,"threads_started":1,"wal-append.queue_time_us":381132}
I20260709 12:24:37.413522 15831 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:37.429261 18168 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:37.430482 15837 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 12:24:37.440492 15837 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:37.429329 15986 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:37.413015 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.446659 18134 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:37.448031 18216 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:24:37.444731 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 388) took 1995 ms. Trace:
I20260709 12:24:37.449738 16487 rpcz_store.cc:276] 0709 12:24:35.449119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.453133 (+  4014us) service_pool.cc:224] Handling call
0709 12:24:35.453507 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.529602 (+ 76095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.530747 (+  1145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.539047 (+  8300us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.557826 (+ 18779us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:35.557867 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.444193 (+1886326us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:37.444263 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.444331 (+    68us) raft_consensus.cc:1685] finished
0709 12:24:37.444353 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.444644 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7427,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":1768,"spinlock_wait_cycles":127469440,"thread_start_us":18177,"threads_started":1,"wal-append.queue_time_us":37464,"wal-append.run_cpu_time_us":1945,"wal-append.run_wall_time_us":1002983}
W20260709 12:24:37.456656 18182 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 2.234s	user 0.002s	sys 0.015s
W20260709 12:24:37.457453 18204 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 1.147s	user 0.008s	sys 0.019s
W20260709 12:24:37.176193 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 307701us
W20260709 12:24:37.458516 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 557876us
I20260709 12:24:37.460008 15908 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:37.460217 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.460767 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2292) took 1836 ms. Trace:
I20260709 12:24:37.461187 15908 rpcz_store.cc:276] 0709 12:24:35.624477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.624947 (+   470us) service_pool.cc:224] Handling call
0709 12:24:37.459559 (+1834612us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:37.459780 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.460510 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.460716 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28673792}
W20260709 12:24:37.169888 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 230652us
I20260709 12:24:37.476716 15983 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:37.451474 18134 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:37.488962 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:37.490067 16492 raft_consensus.cc:2410] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:24:37.497681 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.498585 15980 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:37.502833 15878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.002s	sys 0.039s
W20260709 12:24:37.503280 15878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.002s	sys 0.039s
W20260709 12:24:37.505227 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 84565.8us
W20260709 12:24:37.505847 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.507193 15986 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
W20260709 12:24:37.507369 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.509819 15980 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:37.510183 15980 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:37.510896 15980 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.511720 15980 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.476080 18164 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.499723 18077 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.619876 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:37.501132 18174 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.634188 15950 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.025s	sys 0.015s
I20260709 12:24:37.476238 18161 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:37.486922 18103 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:37.647472 15980 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:37.651559 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:37.503059 18091 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.654640 15950 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.025s	sys 0.015s
I20260709 12:24:37.655507 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:37.656167 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:37.658071 18215 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:37.507103 18156 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:37.663657 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 703762us
I20260709 12:24:37.474982 18061 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 12:24:37.679819 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:37.680567 15836 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:37.681676 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:37.682349 15836 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:37.671265 15837 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:37.674978 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.684494 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.514446 18051 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:37.677317 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:37.668295 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:37.627610 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:37.653761 18164 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.695072 18168 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.645504 18224 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.659101 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:37.705574 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:37.679131 18161 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:37.709360 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:37.710363 15987 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.711027 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:37.656740 18077 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:37.672508 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:37.850667 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 949314us
I20260709 12:24:38.162232 18062 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:38.162410 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:38.162895 18062 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:38.063823 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 369199us
I20260709 12:24:38.165351 18164 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.165393 18062 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.712733 18232 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.167187 18232 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.167915 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:37.822177 18230 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.169811 18230 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.171002 18210 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:38.171613 18210 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:38.172505 18210 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.173560 18224 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.176640 18224 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.177961 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:37.954272 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 259650us
I20260709 12:24:38.178583 18221 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.926648 18075 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.253s
I20260709 12:24:38.179342 18062 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.180015 18141 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.181145 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.182029 15985 raft_consensus.cc:2410] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:37.840492 15980 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:38.201364 15980 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:38.031750 18223 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:24:37.916795 16494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 390) took 2446 ms (client timeout 2177 ms). Trace:
W20260709 12:24:37.929539 15833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2394) took 3481 ms (client timeout 2081 ms). Trace:
W20260709 12:24:38.205065 15833 rpcz_store.cc:269] 0709 12:24:34.447704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.447831 (+   127us) service_pool.cc:224] Handling call
0709 12:24:37.929284 (+3481453us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540024f9d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:37.929441 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4725859712}
W20260709 12:24:37.922099 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.169317 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.172894 18230 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.925447 18117 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.675619 18103 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.188035 18237 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.187943 18239 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.189359 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:38.195995 15950 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 3.287s (SENT)
I20260709 12:24:38.053529 18190 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:37.919034 18083 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.394s	user 0.010s	sys 0.006s
I20260709 12:24:38.235525 15911 raft_consensus.cc:2410] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:38.224648 18230 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.060812 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.236227 18230 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.202196 15984 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:38.237836 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.238559 15984 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:38.238720 18230 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.239661 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.240705 15984 raft_consensus.cc:2410] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:38.203727 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.241964 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:38.209988 16494 rpcz_store.cc:269] 0709 12:24:35.469837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.469984 (+   147us) service_pool.cc:224] Handling call
0709 12:24:37.916529 (+2446545us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b540066b054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:37.916675 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82472320}
I20260709 12:24:38.217129 18062 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.696609 18051 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:38.269804 18189 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:24:38.270403 18062 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.930308 18128 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.218298 18161 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.218930 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.270967 18051 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.271663 18232 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:38.272095 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:37.696790 18082 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:38.273329 18082 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:37.678236 18091 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.274430 18082 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.221668 18141 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.219483 15980 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.188520 18164 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:24:38.203815 18221 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:37.923578 18044 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.932354 18219 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:37.697059 18156 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:38.224355 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:38.190717 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:38.196586 18077 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.292534 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:38.293335 18177 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 3.341s	user 0.023s	sys 0.058s
I20260709 12:24:38.293852 18061 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:38.294437 18061 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:38.294950 15983 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:38.295512 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1471) took 3737 ms. Trace:
I20260709 12:24:38.295341 18061 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.295966 15983 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.887751 18098 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.295866 15832 rpcz_store.cc:276] 0709 12:24:34.558208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.558322 (+   114us) service_pool.cc:224] Handling call
0709 12:24:34.558603 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.565528 (+  6925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.565557 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.642653 (+ 77096us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.815712 (+173059us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:34.815755 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.815849 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.292807 (+3476958us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:38.295266 (+  2459us) raft_consensus.cc:1685] finished
0709 12:24:38.295284 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.295459 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3767,"raft.queue_time_us":3680,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":71458,"spinlock_wait_cycles":67123072,"thread_start_us":133526,"threads_started":1,"wal-append.queue_time_us":285431}
I20260709 12:24:38.228382 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.225706 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.298915 18082 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:38.299422 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 55683.2us
I20260709 12:24:38.231493 18103 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.233117 18237 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.233642 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.234318 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.301268 16490 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:38.301803 18237 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.234119 18239 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.304744 18239 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:37.690750 18215 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.305919 18117 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:38.307047 18215 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.307119 18141 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.309227 15830 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:38.310078 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 114150us
W20260709 12:24:38.310717 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.281636 15980 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.279749 18156 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.280143 18221 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:38.285496 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 94847.9us
W20260709 12:24:38.324211 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.286334 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:37.675282 18174 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.292306 18044 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.299494 18126 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.339802 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.340703 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.341270 15832 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:38.342239 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.342742 15832 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:38.230147 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 604) took 1455 ms (client timeout 1616 ms). Trace:
I20260709 12:24:38.300675 15987 raft_consensus.cc:2376] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5. Re-sending same reply.
I20260709 12:24:38.309103 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.310557 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:38.268167 18134 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.280427 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2293) took 2655 ms. Trace:
I20260709 12:24:38.328285 15984 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:38.336383 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.338088 18044 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:38.343549 16489 rpcz_store.cc:269] 0709 12:24:36.774923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.775680 (+   757us) service_pool.cc:224] Handling call
0709 12:24:38.189227 (+1413547us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:38.230083 (+ 40856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33159040}
I20260709 12:24:38.346061 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.346437 15980 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:38.347196 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.357338 16496 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
W20260709 12:24:38.349284 15908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.028s	sys 0.045s
I20260709 12:24:38.349452 15833 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
W20260709 12:24:38.359613 15908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.029s	sys 0.045s
I20260709 12:24:38.356789 15830 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.360128 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.323858 18173 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.359135 15980 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.358884 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.348768 15912 rpcz_store.cc:276] 0709 12:24:35.624814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.626325 (+  1511us) service_pool.cc:224] Handling call
0709 12:24:38.279743 (+2653418us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:38.279939 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.280104 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.280131 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.280173 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:38.280207 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.280261 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.280368 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34835328}
I20260709 12:24:38.328073 18189 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:38.361747 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1506) took 1875 ms. Trace:
I20260709 12:24:38.370704 15832 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:24:38.370822 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.021s	sys 0.015s
I20260709 12:24:38.393077 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:38.403987 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 201141us
I20260709 12:24:38.369375 15988 rpcz_store.cc:276] 0709 12:24:36.485861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.487758 (+  1897us) service_pool.cc:224] Handling call
0709 12:24:36.488093 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.869841 (+381748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.869870 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.876141 (+  6271us) log.cc:844] Serialized 26 byte log entry
0709 12:24:37.061058 (+184917us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.061107 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.061188 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.361481 (+1300293us) raft_consensus.cc:1685] finished
0709 12:24:38.361513 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.361672 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92071,"raft.queue_time_us":110795,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":433865,"threads_started":2,"wal-append.queue_time_us":765489}
I20260709 12:24:38.576033 15830 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:38.625787 15833 raft_consensus.cc:2376] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5. Re-sending same reply.
I20260709 12:24:38.377285 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:38.627571 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 250359us
I20260709 12:24:38.453001 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:38.624390 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.030s	sys 0.026s
I20260709 12:24:38.357267 18232 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:38.626452 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.626269 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.404628 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:38.628746 15832 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
W20260709 12:24:38.628985 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 936169us
I20260709 12:24:38.629803 18126 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.630409 18239 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.452517 18074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.130s	user 0.027s	sys 0.036s
I20260709 12:24:38.630607 18187 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:38.630757 18103 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:38.629534 18044 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.632377 15830 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
W20260709 12:24:38.632388 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.630605 15952 connection.cc:256] RPC call timeout handler was delayed by -1.7178831419996641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 12:24:38.379010 18188 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.072s	user 0.023s	sys 0.054s
I20260709 12:24:38.635877 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.412341 18091 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.643061 18137 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.643628 18044 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.636981 18126 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.656517 18044 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.645288 18103 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.631155 18098 raft_consensus.cc:476] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:38.633428 18219 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.649533 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.634021 18232 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:38.651945 15833 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:38.646957 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.663497 16489 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:38.665561 18103 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.666989 17588 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.667512 17588 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.668717 15986 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:38.669028 15986 pending_rounds.cc:85] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 3
I20260709 12:24:38.669282 15986 pending_rounds.cc:107] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:38.669528 15986 raft_consensus.cc:2889] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:38.637497 18074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.356s	user 0.031s	sys 0.044s
I20260709 12:24:38.654076 18117 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:38.652874 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:38.680648 15831 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:38.644851 18174 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.644480 16495 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.640642 18187 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.638463 18239 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.657934 18126 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.480170 18077 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.661481 18238 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:38.688145 18238 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:38.688710 18084 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:38.689414 18187 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.688962 18238 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.690183 18238 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.691148 18239 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:38.692471 18124 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:38.659734 18219 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.692845 18124 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:38.662272 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.652509 18188 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.346s	user 0.031s	sys 0.073s
I20260709 12:24:38.678999 18117 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.686792 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 602) took 1947 ms. Trace:
I20260709 12:24:38.693934 16495 rpcz_store.cc:276] 0709 12:24:36.739371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.739878 (+   507us) service_pool.cc:224] Handling call
0709 12:24:38.644089 (+1904211us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:38.644315 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.686567 (+ 42252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.686731 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35609984}
I20260709 12:24:38.674183 18232 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:38.696034 15979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1496) took 3850 ms (client timeout 2116 ms). Trace:
W20260709 12:24:38.702706 15979 rpcz_store.cc:269] 0709 12:24:34.845720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.846136 (+   416us) service_pool.cc:224] Handling call
0709 12:24:38.695872 (+3849736us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540036e7d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:38.695967 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221256448}
W20260709 12:24:38.704577 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 69860.8us
I20260709 12:24:38.705889 15909 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.693288 18219 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.695865 18084 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:38.708249 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:38.708937 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 72471.9us
I20260709 12:24:38.705300 16490 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:38.713853 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:38.715785 18124 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.717327 18250 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:38.717842 18250 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:38.716921 18124 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.721374 18117 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.721940 18084 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.723976 18084 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:38.708294 18086 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:24:38.725226 18086 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:38.725608 18086 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:38.725404 18250 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.726459 18086 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.727408 18086 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.730105 18249 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:38.730634 18249 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:38.731518 18249 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:38.734158 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.735824 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1499) took 1891 ms. Trace:
I20260709 12:24:38.736192 15838 rpcz_store.cc:276] 0709 12:24:36.844621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.074828 (+230207us) service_pool.cc:224] Handling call
0709 12:24:37.075147 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.414553 (+339406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.735573 (+1321020us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400406fd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:38.735766 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328111872}
I20260709 12:24:38.738657 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.738811 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2289) took 3156 ms. Trace:
I20260709 12:24:38.739439 18077 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.739202 15910 rpcz_store.cc:276] 0709 12:24:35.582158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.583711 (+  1553us) service_pool.cc:224] Handling call
0709 12:24:38.738136 (+3154425us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:38.738331 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.738490 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.738517 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.738559 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:38.738599 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.738652 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.738747 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35482880}
I20260709 12:24:38.745906 15829 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.746708 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1516) took 1974 ms. Trace:
I20260709 12:24:38.746817 18126 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.747112 15981 rpcz_store.cc:276] 0709 12:24:36.772113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.772788 (+   675us) service_pool.cc:224] Handling call
0709 12:24:38.746538 (+1973750us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54001b8854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:38.746654 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228589440}
I20260709 12:24:38.747334 18126 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.739215 15835 raft_consensus.cc:2376] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4. Re-sending same reply.
I20260709 12:24:38.750283 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:38.729718 16457 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:38.750910 15904 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:38.754520 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.750356 18126 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:38.752882 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.755352 17989 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:38.762152 17989 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:38.763706 17989 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:38.767050 18242 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.248s	user 0.005s	sys 0.008s
W20260709 12:24:38.768676 18240 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.250s	user 0.000s	sys 0.007s
I20260709 12:24:38.770900 18232 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.774453 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.775005 15836 raft_consensus.cc:2376] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3. Re-sending same reply.
I20260709 12:24:38.778685 15906 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:38.779040 15906 pending_rounds.cc:85] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 2
I20260709 12:24:38.779244 15906 pending_rounds.cc:107] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:38.779456 15906 raft_consensus.cc:2889] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:38.761889 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:38.781352 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.782009 18191 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:38.780840 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.788422 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:38.789955 15906 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.789999 15904 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:38.792825 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.793404 15907 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:38.794104 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.794732 15836 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:38.795038 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.794121 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.795816 15835 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:38.796382 15907 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:38.798961 15908 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:38.800350 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2290) took 3167 ms (client timeout 2206 ms). Trace:
W20260709 12:24:38.800757 15904 rpcz_store.cc:269] 0709 12:24:35.623687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.625767 (+  2080us) service_pool.cc:224] Handling call
0709 12:24:38.750149 (+3124382us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:38.790558 (+ 40409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35536768}
I20260709 12:24:38.802156 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.803678 18235 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:38.788987 18191 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.805405 18191 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.805508 18174 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:38.806707 18173 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:38.807078 18173 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:38.807869 18173 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.810058 15910 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:24:38.811913 15906 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:38.812029 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:38.811801 18173 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.821127 18151 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:38.821828 18151 consensus_queue.cc:1243] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:38.822235 18151 raft_consensus.cc:3055] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:38.822521 18151 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:38.823320 18151 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.824361 18151 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:38.827189 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2396) took 3467 ms (client timeout 2206 ms). Trace:
W20260709 12:24:38.827570 15834 rpcz_store.cc:269] 0709 12:24:35.359636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.361347 (+  1711us) service_pool.cc:224] Handling call
0709 12:24:38.826982 (+3465635us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400030a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:38.827112 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029614976}
I20260709 12:24:38.828380 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:38.829291 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:38.830003 18243 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.830399 18243 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.830770 18243 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:38.832087 15911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 358) took 1326 ms (client timeout 1634 ms). Trace:
W20260709 12:24:38.832482 15911 rpcz_store.cc:269] 0709 12:24:37.505771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.505876 (+   105us) service_pool.cc:224] Handling call
0709 12:24:38.831911 (+1326035us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540010b154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:38.832032 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353216384}
I20260709 12:24:38.832924 18151 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.833452 18151 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:38.833878 18151 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.835021 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2291) took 3211 ms. Trace:
I20260709 12:24:38.835367 15909 rpcz_store.cc:276] 0709 12:24:35.624106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.626149 (+  2043us) service_pool.cc:224] Handling call
0709 12:24:38.037447 (+2411298us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:38.037697 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.707274 (+669577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.834808 (+127534us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001969d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:38.834963 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555306112}
I20260709 12:24:38.836496 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.816258 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.833469 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.837652 18243 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:38.839290 15908 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:38.842413 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.843235 15911 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:38.844646 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:38.846130 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.848049 15905 raft_consensus.cc:606] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:38.849258 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:38.843050 15908 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:38.851045 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.851897 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.855180 15909 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:38.855455 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.856240 15837 raft_consensus.cc:2376] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7. Re-sending same reply.
I20260709 12:24:38.856235 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.858141 15908 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:38.858080 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.859238 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.860901 15837 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.862478 15911 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:38.862991 17687 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:38.863364 17687 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.863693 17687 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.814893 18219 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.859655 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36636 (request call id 23) took 3267 ms. Trace:
I20260709 12:24:38.870355 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.870705 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.870909 15838 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.871886 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.872334 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.872691 15830 raft_consensus.cc:2410] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:38.873303 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.874084 15831 raft_consensus.cc:2410] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:38.872960 15832 raft_consensus.cc:2368] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:38.874966 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.875694 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.876133 15830 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:38.877023 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.869072 15905 rpcz_store.cc:276] 0709 12:24:35.580910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.582361 (+  1451us) service_pool.cc:224] Handling call
0709 12:24:38.847840 (+3265479us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127fc40 00007f03d126bbb9 00007f03d126b47c 00007f03ca7f17d4
0709 12:24:38.848614 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35167104}
I20260709 12:24:38.876963 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:38.876171 15832 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:38.878459 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.881258 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.904680 15830 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:38.875051 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.864496 18151 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:38.883585 15909 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:24:38.889326 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.914244 15833 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.889492 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.914816 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.890275 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:38.915848 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.915920 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:38.890811 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.916918 15831 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:38.917011 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:38.892092 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:38.893180 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:38.896173 18084 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:38.815209 18137 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:24:38.900679 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.904031 15913 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:38.879231 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:38.909695 15908 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:38.922884 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.923081 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:38.923796 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.917994 15838 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:24:38.918761 15950 leader_election.cc:400] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:38.915113 15911 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:38.925197 15950 leader_election.cc:403] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:38.936761 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:38.937364 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.912781 15837 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:38.921286 18124 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:38.937408 15909 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:38.939682 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.925802 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.938354 15833 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:38.926295 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:38.927289 18243 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:38.921119 18117 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:38.924589 18188 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:38.909315 18126 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:24:38.929922 18084 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:38.886451 18232 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:38.932230 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:38.933861 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:38.924714 15913 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:38.934809 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:38.957253 16460 leader_election.cc:336] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 1.527s (SENT)
I20260709 12:24:38.941155 18074 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:38.998498 18074 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.999018 18074 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.998786 18191 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:39.002310 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 79307.9us
I20260709 12:24:39.003409 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.006659 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2417) took 1331 ms. Trace:
I20260709 12:24:39.007371 15833 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:39.007962 15837 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:39.007046 15829 rpcz_store.cc:276] 0709 12:24:37.675574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.679441 (+  3867us) service_pool.cc:224] Handling call
0709 12:24:38.745746 (+1066305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.746278 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.006475 (+260197us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400406fd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:39.006597 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414628608}
I20260709 12:24:39.008769 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.009730 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.009795 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.010213 15837 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.990765 18187 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:38.991168 18075 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.012709 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.015679 15837 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:39.016392 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:38.958201 18137 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:39.017565 18232 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:39.025977 18232 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.026443 18232 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.029131 18187 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:38.994517 18238 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:24:39.029846 18238 raft_consensus.cc:3055] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:39.030294 18238 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.030043 18187 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.031234 18219 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.019012 18239 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.033334 15953 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:39.033974 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.017742 18124 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:39.036589 15834 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.021929 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.037506 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.038411 16495 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.039248 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.000053 18117 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.037302 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.040374 16489 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.041409 18137 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.034480 18238 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.041810 18137 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:39.042220 18137 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.042290 18238 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.042708 18151 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.033334 18075 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.019208 18173 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.044066 18173 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.044409 18173 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.045200 18098 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.045603 18098 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.045795 18075 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.045962 18098 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.046526 18084 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.046629 17687 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:39.049984 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.035223 16493 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.040788 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:39.053365 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.035458 18239 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.036947 18103 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.037107 18124 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.064988 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.067044 16496 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.045616 18038 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:24:39.068092 17687 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:39.059957 18087 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:24:39.068698 18151 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:39.068830 18191 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:39.040766 18127 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.072149 16495 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:39.067699 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:39.072921 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.073123 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:39.075954 15834 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:39.076901 18151 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:39.076776 18117 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.077433 18151 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.066275 18103 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:39.078462 18103 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.078332 18151 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.064661 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.081243 18243 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.081800 18243 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.061848 18126 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.082490 18126 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.082855 18126 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.082690 18243 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.066453 18239 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.086540 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.086874 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.075893 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.089393 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.091256 16489 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.092995 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.092180 18036 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.071970 18124 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.099756 18075 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.102625 18215 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:39.105352 18191 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.101962 18222 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:39.117298 18075 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.116456 18117 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:24:39.113005 18078 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:24:39.128954 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:39.134021 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:39.149494 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.126101 18191 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:39.118230 18232 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.183456 18239 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.186357 18098 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:39.190199 18259 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:24:39.192108 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.220670 18239 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:39.188912 18098 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:39.221956 18075 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.179862 18096 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.224059 18096 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.225123 18096 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.180888 18261 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.229346 18261 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.230186 18261 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.231144 18261 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.233470 18191 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.237180 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1525) took 1578 ms. Trace:
I20260709 12:24:39.237644 15986 rpcz_store.cc:276] 0709 12:24:37.659232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.659376 (+   144us) service_pool.cc:224] Handling call
0709 12:24:37.659727 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.669948 (+1010221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.236866 (+566918us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000136d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:39.237116 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319595392}
I20260709 12:24:39.241001 18074 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.242583 17588 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:39.243626 18074 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:39.246901 18173 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.250305 18232 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:39.256676 15982 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.257126 15982 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:39.261514 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.258926 18173 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:39.283267 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.239836 18103 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.298337 18215 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:39.332363 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 206510us
I20260709 12:24:39.274621 18137 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:39.335048 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 200956us
I20260709 12:24:39.338670 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.334065 18188 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:39.337848 18243 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.356989 18222 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.363029 18103 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.364630 18124 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.365945 18137 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:39.367571 18222 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.368351 18124 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.354177 18243 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.370607 18243 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.351074 18188 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.361650 18215 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.375965 18188 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:39.416729 15837 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:39.419018 15829 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:39.344134 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.432155 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.432397 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.433233 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.435268 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.449632 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:39.450724 15834 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.453863 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.455070 15979 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:39.456926 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.456465 15982 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.478008 15982 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.476625 15979 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:39.457770 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.481551 15980 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:39.481703 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.458277 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.482582 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.458341 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.483566 15980 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:39.483944 15983 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:39.484653 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.484972 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.485970 15983 raft_consensus.cc:2410] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:39.486054 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.486534 15980 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:39.486999 15831 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.487279 15983 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:39.458900 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.488647 15981 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:39.459735 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.489836 15984 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:39.482566 18075 consensus_queue.cc:1175] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fd62f0fa06a4561a0a7101b85942f86" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:39.462296 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.463037 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.463480 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:39.464376 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.464254 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.465754 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:39.467715 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.468961 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.470023 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.471371 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.474704 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.475286 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:39.504746 18276 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:24:39.506139 15985 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
W20260709 12:24:39.507061 16488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 609) took 1980 ms (client timeout 1714 ms). Trace:
W20260709 12:24:39.508008 18277 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:24:39.507673 16488 rpcz_store.cc:269] 0709 12:24:37.526753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.529029 (+  2276us) service_pool.cc:224] Handling call
0709 12:24:39.474914 (+1945885us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:39.506948 (+ 32034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3531648}
I20260709 12:24:39.508319 16496 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:39.521893 15836 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.522840 15831 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.359293 18126 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.526144 16493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 601) took 2963 ms. Trace:
I20260709 12:24:39.526633 16493 rpcz_store.cc:276] 0709 12:24:36.562472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.580835 (+ 18363us) service_pool.cc:224] Handling call
0709 12:24:38.935592 (+2354757us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917ef8c 00007f03c917eef6 000000000036eb39 00007f03d11f21e0 00007f03d12bb0c4 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:38.935739 (+   147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.060578 (+124839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.525495 (+464917us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b5400619254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:39.525882 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244501760}
I20260709 12:24:39.527534 18126 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:39.528645 15987 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:39.529946 15950 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.519488 15829 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.539093 15832 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.541795 18117 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:39.542285 18117 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.542707 18117 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:39.543136 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.544241 15953 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:39.546257 18238 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:39.547089 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.541813 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:39.549907 18189 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.550143 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.552423 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.552637 18222 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:39.553434 15982 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:39.553686 18126 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.550172 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.554523 15836 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:39.554322 18126 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.555110 15986 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:39.556681 18126 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:39.557399 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.557529 15803 connection.cc:256] RPC call timeout handler was delayed by -1.5929625809999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:24:39.558064 18263 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:39.559216 15832 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:39.567746 15803 connection.cc:256] RPC call timeout handler was delayed by -1.5921560960000534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:24:39.561468 18222 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.562947 15837 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:39.567917 15832 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:39.573529 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.573570 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.574797 16488 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:39.575573 15982 raft_consensus.cc:2410] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:39.577018 15831 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:39.581982 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:39.585876 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 1.18113e+06us
I20260709 12:24:39.588701 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:39.584980 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.569914 18263 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.601197 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.602614 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.601639 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.607630 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.611086 18077 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:39.611585 18077 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:39.611987 18077 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.613137 16495 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:39.613232 18062 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.614109 18062 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:39.615198 18222 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.616722 15832 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.608209 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:39.617516 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:39.617944 15832 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.627900 15987 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.628047 15981 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.621599 15982 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:39.617262 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:39.627249 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:39.630609 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45913.5us
I20260709 12:24:39.634416 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.624147 16488 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:39.639508 18174 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:39.640393 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.641336 15908 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.602900 18263 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.645488 15979 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.649554 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.650363 15905 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:39.654650 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.655938 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.657389 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 68903.4us
W20260709 12:24:39.660215 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.661696 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.664215 18051 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.663926 18117 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.665163 18051 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.667212 18117 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.667583 15986 raft_consensus.cc:2410] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:24:39.669332 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 86082.1us
I20260709 12:24:39.689090 15908 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:39.626912 18164 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:24:39.693362 18082 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:39.616991 18062 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:39.701301 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.688746 15803 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.68:43743 timed out after 1.962s (SENT) [suppressed 45 similar messages]
I20260709 12:24:39.667253 18051 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.702803 15979 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
W20260709 12:24:39.704146 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.693362 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:39.694151 18082 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.710515 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.711336 18163 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:39.711447 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.712478 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.712654 18141 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:39.713011 18127 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:39.713152 18210 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.718106 18263 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:39.718869 15879 connection.cc:256] RPC call timeout handler was delayed by -1.4531175320003058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 12:24:39.722476 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.722362 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.723642 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.724541 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.722572 15829 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:24:39.737732 15879 connection.cc:256] RPC call timeout handler was delayed by -1.3955175320002127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:24:39.738082 15879 connection.cc:256] RPC call timeout handler was delayed by -1.3910175320002054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 12:24:39.725293 15803 connection.cc:256] RPC call timeout handler was delayed by -1.4074766579997231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 12:24:39.726907 15984 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:39.734377 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.725378 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:39.738477 15803 connection.cc:256] RPC call timeout handler was delayed by -1.3795107039995855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23020000000000002s for a response
W20260709 12:24:39.739686 15803 connection.cc:256] RPC call timeout handler was delayed by -1.2447547679998934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:24:39.740020 15803 connection.cc:256] RPC call timeout handler was delayed by -1.1671107039996969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25379999999999997s for a response
I20260709 12:24:39.743216 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.743475 18082 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.745201 15979 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:39.745493 15803 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:39.746376 18163 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.744565 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:39.748648 15985 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:39.747980 17836 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.752331 15980 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:39.752557 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:39.753824 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.754942 15911 raft_consensus.cc:2410] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:39.755772 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:39.756801 18074 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.757720 17861 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:39.758335 18127 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.759415 18127 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.755806 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.769750 15832 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:39.772984 15988 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:39.772786 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.783845 15834 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:39.780977 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 43634.3us
I20260709 12:24:39.785779 15908 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:39.778944 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.786969 15981 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:39.787288 15835 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.788482 15982 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:39.790943 15905 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:39.788894 15982 pending_rounds.cc:85] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 4
I20260709 12:24:39.788558 15910 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.791352 15911 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.796252 18156 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:39.797056 18156 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.798301 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.799659 15982 pending_rounds.cc:107] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:39.800194 15982 raft_consensus.cc:2889] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:39.801458 15909 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:39.802103 18263 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:39.802861 15909 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:39.799599 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.799597 18156 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.809129 15987 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:39.811256 15906 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.811966 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.814841 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:39.816196 15985 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:39.794492 18174 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:24:39.820024 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.822255 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.823472 16495 raft_consensus.cc:2368] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
W20260709 12:24:39.824568 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 46440.4us
I20260709 12:24:39.825314 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:39.825753 16487 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:39.826447 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:39.826613 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.827070 16493 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.829252 15986 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:39.829828 15732 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.832398 15732 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 2 to 4, term changed from 1 to 3, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.833390 18124 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:39.813241 18163 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.788290 18141 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.837318 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.836796 15732 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 2 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.838579 18126 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.839012 18126 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.839466 18126 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.839637 18141 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:39.838941 15732 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.842097 15983 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:39.842799 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.843914 18268 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.845623 18173 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.846180 18173 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.828939 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:39.851639 17989 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:39.852257 18278 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:39.853356 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.853646 18174 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:39.854099 18174 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.855279 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.844583 18268 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.870620 18243 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:39.871817 18268 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:39.872385 18268 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:39.843465 15732 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 3 to 5, term changed from 3 to 5, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to <none>, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:39.874171 15732 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 2 to 4, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 4 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.874949 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.887656 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:39.887997 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:39.888224 15831 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.890218 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:39.895804 18238 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:39.896772 18074 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:39.897606 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.900993 15829 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:39.905452 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.906972 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.908129 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:39.905552 15730 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 275) took 12727 ms (client timeout 15000 ms). Trace:
I20260709 12:24:39.909346 15832 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:39.910171 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:39.918104 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 60927us
I20260709 12:24:39.918731 15906 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:39.918908 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:39.918058 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.887221 17836 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.855082 18174 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:39.923916 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.924045 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.882195 15732 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 4 to 5, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.931216 15911 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:39.931023 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.932067 15906 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:39.932507 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:39.934598 15979 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.935793 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.890093 18278 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:24:39.930332 18103 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:39.954201 15906 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:39.953092 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 59618.6us
W20260709 12:24:39.957201 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 180213us
I20260709 12:24:39.959380 15905 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:39.957332 15904 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:39.927130 18124 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:39.975042 18124 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:39.971922 18291 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.933840 18074 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:39.978623 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:39.979254 15913 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:39.980050 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:39.980557 15913 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.981539 15906 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:39.982745 15909 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.969986 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1018) took 1192 ms. Trace:
I20260709 12:24:39.971473 18096 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:24:39.962059 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.971866 17989 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:39.972126 18187 raft_consensus.cc:2764] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:39.972702 15732 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 5 to 7, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.988224 15910 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:39.957497 17836 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.990993 15831 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:39.987963 15911 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:39.995682 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 63449.2us
W20260709 12:24:39.909363 15730 rpcz_store.cc:269] 0709 12:24:27.178104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.179347 (+  1243us) service_pool.cc:224] Handling call
0709 12:24:32.305211 (+5125864us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b54001109a8. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cfc0d161 00007f03cfc973af 00007f03cfc98b11 00007f03d2198fa1 00007f03d21997ff 00007f03d2058a1b 00007f03d216090e 00007f03d06212a4 00007f03d0621232 00007f03d0621161 00007f03d06210dc
0709 12:24:39.905256 (+7600045us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:32.590453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:32.756343 (+165890us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:32.756392 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:24:32.756425 (+    33us) tablet.cc:662] Decoding operations
0709 12:24:32.878102 (+121677us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:32.878192 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:32.878229 (+    37us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:24:32.879936 (+  1707us) tablet.cc:701] Row locks acquired
0709 12:24:32.879988 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:24:32.880176 (+   188us) write_op.cc:270] Start()
0709 12:24:32.880359 (+   183us) write_op.cc:276] Timestamp: P: 1783599872880108 usec, L: 0
0709 12:24:32.880381 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:33.083661 (+203280us) log.cc:844] Serialized 6672 byte log entry
0709 12:24:33.392160 (+308499us) op_driver.cc:464] REPLICATION: finished
0709 12:24:33.665608 (+273448us) write_op.cc:301] APPLY: starting
0709 12:24:33.665736 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:33.666215 (+   479us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:33.666402 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:33.668766 (+  2364us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:33.756964 (+ 88198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:24:33.757017 (+    53us) write_op.cc:312] APPLY: finished
0709 12:24:33.769385 (+ 12368us) log.cc:844] Serialized 119 byte log entry
0709 12:24:33.769607 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:33.769768 (+   161us) write_op.cc:454] Released schema lock
0709 12:24:33.769844 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:33.770243 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:33.770271 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167,"reported_tablets":33,"spinlock_wait_cycles":9448192,"child_traces":[["op",{"apply.queue_time_us":273144,"apply.run_cpu_time_us":5255,"apply.run_wall_time_us":104630,"num_ops":17,"prepare.queue_time_us":226523,"prepare.run_cpu_time_us":38711,"prepare.run_wall_time_us":711419,"raft.queue_time_us":99994,"raft.run_cpu_time_us":10988,"raft.run_wall_time_us":158855,"replication_time_us":511593,"thread_start_us":458093,"threads_started":4,"wal-append.queue_time_us":164309,"wal-append.run_cpu_time_us":31936,"wal-append.run_wall_time_us":1486089}]]}
W20260709 12:24:40.000473 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.000949 15879 connection.cc:256] RPC call timeout handler was delayed by -1.0526403929998196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29560000000000003s for a response
I20260709 12:24:40.001801 18141 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:40.009196 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.010177 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 91359us
I20260709 12:24:40.011896 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:39.988756 17989 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:39.983482 15912 rpcz_store.cc:276] 0709 12:24:38.777087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.777186 (+    99us) service_pool.cc:224] Handling call
0709 12:24:38.797646 (+ 20460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.693567 (+895921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.693610 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:39.694104 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.819652 (+125548us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:39.819695 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.878645 (+ 58950us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.969577 (+ 90932us) raft_consensus.cc:1685] finished
0709 12:24:39.969599 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.969794 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":791186,"raft.queue_time_us":817194,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"thread_start_us":207106,"threads_started":2,"wal-append.queue_time_us":233011}
I20260709 12:24:40.013110 15983 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:40.014624 15983 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:39.994722 17836 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:40.010017 18163 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.016916 15803 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.014614 15732 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:40.027818 15835 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.013439 18074 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:40.036144 18294 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:40.037153 17989 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:40.037906 18279 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:24:40.038605 17989 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.042603 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.043244 15910 raft_consensus.cc:2376] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5. Re-sending same reply.
I20260709 12:24:40.044127 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.045542 15905 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.046478 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.047467 15905 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:40.047657 18173 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:40.048666 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:40.049077 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.049369 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.048213 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.019879 17836 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.051574 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.019654 18163 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:39.992625 18103 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.051995 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.164695 15906 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:40.153752 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.156232 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.166347 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.166391 15910 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:40.153141 15909 raft_consensus.cc:2410] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:40.167316 15911 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:40.052711 16495 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:40.171066 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 157095us
I20260709 12:24:40.152658 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.137303 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:40.172415 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 166114us
I20260709 12:24:40.093345 15732 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 4, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:40.056293 15913 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
W20260709 12:24:40.226215 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54440.6us
I20260709 12:24:40.050480 18074 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:40.105279 15983 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.230037 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.241073 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.173592 15732 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:40.236269 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.247558 15905 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:24:40.264768 15905 pending_rounds.cc:85] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 7
I20260709 12:24:40.265110 15905 pending_rounds.cc:107] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:24:40.265399 15905 raft_consensus.cc:2889] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:40.249023 15911 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.266736 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.258512 16493 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
W20260709 12:24:40.260085 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 95424.6us
I20260709 12:24:40.260838 18228 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.261299 18188 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:40.107095 18077 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.269243 15907 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:40.272040 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.268160 15912 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
W20260709 12:24:40.272899 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.262952 15909 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:40.289510 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.290395 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.291934 15832 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.291702 15909 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:40.297366 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.307679 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.310592 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.313241 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:40.314329 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.314258 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.318010 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.319106 15904 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:40.320968 15732 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:24:40.325464 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.324376 15732 catalog_manager.cc:5697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:40.307130 18210 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 12:24:40.327407 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.333331 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.334136 15909 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.334666 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.335366 15913 raft_consensus.cc:2368] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:40.338346 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.296522 18188 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:40.312135 18291 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.340673 15982 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:40.342096 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.345602 15905 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.346761 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.348747 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.351087 15907 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:40.351492 15913 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:40.335865 18222 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.336303 18210 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:40.359403 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 90826.4us
I20260709 12:24:40.360728 15979 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:40.362207 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 225041us
I20260709 12:24:40.312021 18156 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:40.327119 18302 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 12:24:40.372033 15908 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:40.372687 15803 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:40.357918 18291 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.376715 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:40.381247 17687 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:24:40.382444 17687 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:40.382799 17687 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:40.383658 17687 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.365165 18222 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.377951 15732 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 4 to 7, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:40.400548 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 49906.7us
I20260709 12:24:40.412086 15909 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:40.401221 18282 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.424470 18294 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.428987 18294 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.429389 18294 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.384904 18188 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.349915 18163 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.397125 18086 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:24:40.433795 18163 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.434513 18196 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:40.434612 16459 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.435011 18196 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:40.354182 18074 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.435992 18196 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.435014 15732 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 2, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 2 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.436791 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:40.438378 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 66866.9us
I20260709 12:24:40.384979 17687 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.389228 18291 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:40.444381 15905 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:40.447655 15732 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.441560 18167 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:40.480129 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 152075us
W20260709 12:24:40.480381 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 43665.8us
I20260709 12:24:40.481299 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.482659 16459 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.483462 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.484656 18087 raft_consensus.cc:2764] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 12:24:40.485144 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 152282us
W20260709 12:24:40.485500 18126 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.004s
I20260709 12:24:40.485736 18222 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:40.487654 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.551716 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.488440 18299 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:40.489114 18077 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:40.489981 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:40.496482 15983 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.445724 18124 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:40.499181 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.500041 18036 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.501183 18096 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.503326 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.480422 18291 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.445279 18086 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:40.510928 15910 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:40.467430 18173 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.468485 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 99844.6us
W20260709 12:24:40.526024 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49684.3us
I20260709 12:24:40.468966 18196 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.517094 18278 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.569478 15836 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:40.600677 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:40.574272 15829 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.607398 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:40.575728 15834 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:40.583747 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:40.547298 18210 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.594303 18294 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.594844 15833 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.611445 15909 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.561208 18126 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.573752 18036 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:40.615856 18222 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.625757 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.627043 15836 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:40.629454 15950 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:40.630285 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 143183us
I20260709 12:24:40.601562 18124 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:40.634618 15907 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.634924 15905 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.636137 15905 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:40.636521 15838 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:40.635748 15907 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:40.632377 18103 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:40.637084 15905 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.638808 18137 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.639345 15905 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.639424 18137 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.640023 18077 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:40.640879 18311 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:40.641589 18036 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.642441 18311 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.642645 15833 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:40.642913 18311 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.642645 18036 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.644356 17687 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:40.620446 18173 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.582854 18282 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:40.648258 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 158329us
I20260709 12:24:40.626154 18188 raft_consensus.cc:2764] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:24:40.660513 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.666890 15905 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:40.667292 15905 pending_rounds.cc:85] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 2
I20260709 12:24:40.667527 15905 pending_rounds.cc:107] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:40.667809 15905 raft_consensus.cc:2889] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:40.666723 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 182573us
W20260709 12:24:40.677388 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 78774us
W20260709 12:24:40.648360 18301 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:24:40.686111 15909 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:40.619984 18096 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.651065 18294 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:40.657099 18174 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.692798 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.669725 18222 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.691542 15832 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:40.696184 15803 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.644981 18311 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:40.704166 15904 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:40.703558 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:40.707602 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.704663 15904 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:40.649802 17836 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:40.648490 18308 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:24:40.706744 18222 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.719946 15833 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:40.738035 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 176191us
I20260709 12:24:40.740628 15835 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:40.708643 18311 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:24:40.761338 16459 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:40.748210 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.758867 15911 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:40.714097 18137 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:40.726238 18188 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.737911 18222 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.773161 18317 raft_consensus.cc:2764] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:24:40.774063 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 96008us
I20260709 12:24:40.738916 15904 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.737699 18243 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:40.793938 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 87305.6us
I20260709 12:24:40.799872 15904 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.800140 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:40.800491 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:40.805380 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 207480us
W20260709 12:24:40.803752 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 174406us
I20260709 12:24:40.806912 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:40.812583 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 403791us
I20260709 12:24:40.803351 18163 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:40.820572 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.819780 18126 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:40.822350 18294 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.822918 18163 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:40.823257 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:40.824002 16493 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:40.823882 18163 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.824694 18137 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.822959 18294 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.825313 18137 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:40.826282 18137 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.827005 18294 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:40.806866 18243 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:40.836045 18096 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:40.836339 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:40.836948 15912 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:40.836759 18096 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:40.839571 18096 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:40.840682 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:40.841260 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45453.8us
I20260709 12:24:40.841991 15803 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:40.841900 15907 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:40.842890 15907 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.811774 18188 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.848574 16488 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:40.829972 18243 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:40.858204 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 112282us
I20260709 12:24:40.819602 18278 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:24:40.892560 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:24:40.911016 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 244137us
I20260709 12:24:40.853749 18167 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.803148 18124 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:40.923799 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 98424.9us
I20260709 12:24:40.886001 18189 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:40.936781 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 94872.9us
I20260709 12:24:40.891031 18298 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:41.017396 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 91885.6us
W20260709 12:24:41.067672 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.068256 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.892787 18294 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:41.082847 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.088290 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:41.093729 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 207523us
I20260709 12:24:40.937960 18189 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:41.137538 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.138576 18315 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.392s	user 0.000s	sys 0.002s
I20260709 12:24:41.141144 18126 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.141474 18319 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:41.141698 18126 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.141552 18189 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.143026 18189 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:41.146184 18320 log.cc:927] Time spent T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:24:41.149204 18324 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:41.149712 18324 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:41.136621 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 303614us
I20260709 12:24:41.150686 18324 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.151765 18324 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.151952 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:41.153050 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.154066 18187 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.157481 18308 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.080894 18298 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.160485 18298 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:41.100101 18285 log.cc:927] Time spent T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
W20260709 12:24:41.104964 18284 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:24:41.209316 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 113366us
W20260709 12:24:41.212997 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.213676 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.105166 17836 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:41.219583 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 125542us
W20260709 12:24:41.221922 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 76733.8us
I20260709 12:24:41.207496 18137 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:41.235428 18309 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:41.235514 18296 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:24:41.246093 15907 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:41.247156 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 308812us
I20260709 12:24:41.244115 18173 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.236137 18309 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.248736 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.250643 18309 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.251012 17836 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.250005 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.252321 18337 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:41.254347 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.255017 17836 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.255462 18173 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:41.256259 18173 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.256595 18173 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.252233 18325 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:41.229472 18167 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:24:41.257972 18325 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:41.258309 18325 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:41.259131 18325 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.260541 18294 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.262200 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.265419 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.265630 18294 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.267225 18318 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.267940 18318 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:41.236445 18137 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:41.273568 18137 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.273171 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.264134 15904 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:41.275622 15904 pending_rounds.cc:85] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 4
I20260709 12:24:41.275911 15904 pending_rounds.cc:107] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:41.276189 15904 raft_consensus.cc:2889] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:41.300297 15983 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.000s
W20260709 12:24:41.290783 18196 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.678s	user 0.004s	sys 0.006s
I20260709 12:24:41.305347 15983 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:41.306717 15983 pending_rounds.cc:85] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 5
I20260709 12:24:41.307756 15983 pending_rounds.cc:107] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:41.306200 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.308523 15983 raft_consensus.cc:2889] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:41.311371 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 401) took 1328 ms. Trace:
W20260709 12:24:41.312537 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 160736us
W20260709 12:24:41.314023 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.311740 15983 rpcz_store.cc:276] 0709 12:24:39.981016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.988310 (+  7294us) service_pool.cc:224] Handling call
0709 12:24:40.003469 (+ 15159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.496283 (+492814us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b58007376d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc1ff0aa 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a5b49 00007f03cc2a6416 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4
0709 12:24:41.309020 (+812737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.309195 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300960000}
I20260709 12:24:41.314721 15879 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:41.319612 18173 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.321269 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2325) took 1067 ms. Trace:
I20260709 12:24:41.321707 18173 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.321597 15911 rpcz_store.cc:276] 0709 12:24:40.253602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.266447 (+ 12845us) service_pool.cc:224] Handling call
0709 12:24:41.321121 (+1054674us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54001c4654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:41.321208 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114980224}
I20260709 12:24:41.327687 15908 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:41.328037 15908 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:41.329957 18137 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.316876 18196 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.328778 15908 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.341799 15879 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:41.347745 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.335345 18173 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.349205 18331 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.349407 18173 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.349951 18331 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:41.350327 18331 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:41.350656 18331 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.351521 18173 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:41.352571 18137 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.311453 18309 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:24:41.345697 18313 raft_consensus.cc:2764] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:41.374619 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.355252 17836 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:41.386988 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 70529.8us
W20260709 12:24:41.393450 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.393950 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.394290 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.396601 18314 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.658s	user 0.019s	sys 0.025s
W20260709 12:24:41.397153 18326 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:24:41.403360 18126 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:41.404284 18196 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:41.408269 18297 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.408946 18297 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:41.409505 18297 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.411535 18297 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.416204 15913 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:41.416320 15908 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.416785 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:41.417675 15910 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
W20260709 12:24:41.431085 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 75237.6us
I20260709 12:24:41.432024 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:41.434719 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:41.435496 17836 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.436856 17836 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:41.437208 17836 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.437543 17836 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.443475 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:41.443400 18331 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.444276 18291 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.444911 18291 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:41.459005 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.464875 18210 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:24:41.466562 18340 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:24:41.466632 15908 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:41.478160 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.478889 15982 raft_consensus.cc:2376] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4. Re-sending same reply.
I20260709 12:24:41.479084 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.479046 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.482652 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.483439 15982 raft_consensus.cc:2393] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:41.487442 15986 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:41.488343 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.479883 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.491918 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.491206 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.455176 18117 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:41.495690 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.485335 18086 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:24:41.497673 18344 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.499639 15988 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:41.474997 18126 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.508245 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.508082 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.509894 16487 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:41.510491 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:41.512949 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 494564us
I20260709 12:24:41.514034 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:41.514503 16495 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.515480 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:41.468822 18345 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:24:41.528175 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.528771 16496 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:41.531066 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:41.534865 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:41.555152 18243 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:41.555691 18343 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.556205 18343 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:41.557152 18349 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:41.514837 18331 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:41.511365 18344 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.559466 18224 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.559984 18224 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:41.560762 18141 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:24:41.526072 18126 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.578902 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.585129 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:41.513825 18291 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.589210 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:41.589850 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 55055.5us
I20260709 12:24:41.590442 18342 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:41.626422 18342 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.626840 18342 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.627089 18163 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:41.629382 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 50584.9us
I20260709 12:24:41.630221 15879 leader_election.cc:400] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:41.630478 15879 leader_election.cc:403] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:41.631330 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.597157 18298 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.552953 18238 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:24:41.625276 18345 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.608824 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:41.601356 18174 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.887s	user 0.012s	sys 0.000s
W20260709 12:24:41.641861 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 116056us
W20260709 12:24:41.638314 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 127869us
I20260709 12:24:41.632833 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:41.632066 18313 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6.
I20260709 12:24:41.650136 15979 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
W20260709 12:24:41.650991 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.654358 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.654791 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:41.655277 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.658448 18298 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:41.660755 18324 consensus_meta.cc:287] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.509s	user 0.017s	sys 0.020s
I20260709 12:24:41.661638 18343 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:41.661392 18189 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.007s
I20260709 12:24:41.640005 18325 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.640033 18141 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.669716 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:41.670600 15836 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:41.671550 15830 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:41.671733 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:41.672298 15838 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:41.673905 15836 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:41.674508 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:41.675146 15907 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.675969 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:41.676007 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:41.676723 15908 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:41.679903 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:41.681495 15835 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:41.681607 16495 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:41.653241 18331 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:41.688840 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:41.689683 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.675550 18137 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.699323 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:41.698484 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45520.4us
I20260709 12:24:41.700642 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:41.675858 18337 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.704610 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.705938 15835 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:41.705628 15980 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:41.709196 18351 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:41.709621 15985 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:41.709818 18351 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.710181 18351 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.710348 15838 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:41.683200 17836 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.690773 18188 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.715517 18294 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.716429 15831 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:41.709124 18173 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.718111 18096 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.721306 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:41.721915 15838 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.717648 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:41.723059 18126 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.688966 18331 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:41.732993 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:41.729223 15987 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:41.924718 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:41.733716 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:41.731135 15907 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:41.789654 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:42.076840 15834 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
W20260709 12:24:42.077280 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.789252 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.077847 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.882220 18163 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.079427 18163 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.927245 18291 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.733850 18096 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:41.967232 18188 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.081211 18291 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.081559 18188 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.081794 18096 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.083676 18291 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:41.735945 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:41.774731 18173 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.301s
I20260709 12:24:42.083841 18188 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:41.845973 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.085764 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.866034 18344 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:41.747534 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:41.820603 15988 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:42.087325 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:41.747332 15876 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.571s (SENT)
I20260709 12:24:42.094237 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:41.865793 15838 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
W20260709 12:24:42.073741 18352 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:24:41.736366 18331 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.099140 15829 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.805168 18141 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.774576 18117 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:41.866572 18222 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.059s	user 0.015s	sys 0.001s
I20260709 12:24:42.125272 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.126552 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 390288us
I20260709 12:24:42.107442 15981 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:41.705238 18137 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:41.883297 18228 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.096031 18189 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.099373 17836 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.068643 18342 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:41.725633 18337 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:42.135845 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 409258us
I20260709 12:24:42.355425 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.366540 15879 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:42.362890 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:42.356956 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:42.230764 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.357712 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 610374us
W20260709 12:24:42.215029 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 87549.5us
I20260709 12:24:42.121732 18210 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:42.135519 18354 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.346s	user 0.001s	sys 0.001s
I20260709 12:24:42.164930 18261 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:42.383399 18339 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:24:42.123633 18117 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.374549 15838 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:42.413368 15830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.019s
W20260709 12:24:42.429638 15830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.019s
I20260709 12:24:42.373533 18096 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:42.126760 18343 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:42.422164 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 65296us
I20260709 12:24:42.427362 15983 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:42.378106 15950 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:42.440472 15832 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:42.441529 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:42.373054 18124 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.445055 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 67018.6us
W20260709 12:24:42.356778 18356 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.532s	user 0.000s	sys 0.002s
I20260709 12:24:42.135334 18222 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.126514 18141 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.416518 18261 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:42.307421 18338 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:24:42.452947 18173 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:42.438511 18117 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.442412 18343 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:42.165793 18228 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.458298 15952 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:42.398376 18189 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.443957 18174 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:24:42.463762 18331 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.513378 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:42.514158 15835 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.472707 18342 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.474205 18337 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:42.475332 18363 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:24:42.500221 18173 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:42.477489 18196 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:42.480822 18317 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.430469 17989 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:42.446394 18210 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.487805 18224 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.487900 18163 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.492308 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.494290 15981 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:42.305714 18238 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.196s
I20260709 12:24:42.509786 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.536960 18173 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:42.467459 18325 consensus_meta.cc:287] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 12:24:42.512389 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:42.518890 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.476157 18364 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:42.532567 15984 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.506433 18343 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.538007 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:42.510512 17836 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:42.549975 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1551) took 1050 ms. Trace:
I20260709 12:24:42.516685 18368 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:42.516916 18344 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:42.557137 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.585531 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 219138us
I20260709 12:24:42.496016 18261 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.563807 15830 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:42.575848 18163 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.577719 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 119522us
I20260709 12:24:42.581763 15905 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:42.586342 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:42.583465 15987 rpcz_store.cc:276] 0709 12:24:41.502030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.506505 (+  4475us) service_pool.cc:224] Handling call
0709 12:24:42.542804 (+1036299us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003156d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:42.542904 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383002368}
W20260709 12:24:42.576722 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 64444.5us
I20260709 12:24:42.543387 18196 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.591485 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.594506 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.591531 15836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.017s
I20260709 12:24:42.499989 18124 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.547482 18317 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.580904 18188 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:42.600473 15835 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:42.603780 15836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.002s	sys 0.017s
I20260709 12:24:42.550022 17989 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:42.601055 18351 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.002s
I20260709 12:24:42.643481 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.637889 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.648348 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:42.648576 15830 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:42.650898 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:42.651657 15832 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:42.639811 18364 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:24:42.658528 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 72284.9us
I20260709 12:24:42.613165 18210 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.588867 17836 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.662439 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:42.664427 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:42.652946 18334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.012s	sys 0.047s
I20260709 12:24:42.603746 18163 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.610744 18336 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:24:42.646282 18222 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.611192 18228 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.670912 15831 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:42.667956 18334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.012s	sys 0.048s
I20260709 12:24:42.645401 18351 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.688828 15829 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:42.671550 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.695627 15984 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:42.592442 18368 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:42.697777 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 147734us
W20260709 12:24:42.709394 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 56684.6us
I20260709 12:24:42.710625 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:42.669088 18379 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:42.715372 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.709365 18366 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:24:42.718161 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.697645 18238 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.697741 18189 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.738969 15832 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:42.745556 18196 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.747112 18368 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.748382 18163 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.732322 15986 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:24:42.761581 18384 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:24:42.761523 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.766978 15832 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:42.762778 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 417) took 1124 ms. Trace:
I20260709 12:24:42.767292 15982 rpcz_store.cc:276] 0709 12:24:41.638534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.638656 (+   122us) service_pool.cc:224] Handling call
0709 12:24:41.638989 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.640630 (+  1641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.640656 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.641099 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.856406 (+215307us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18003805c0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:24:42.136292 (+279886us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:42.136345 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.136437 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.762518 (+626081us) raft_consensus.cc:1685] finished
0709 12:24:42.762534 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.762713 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1204,"raft.queue_time_us":1431,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11879,"spinlock_wait_cycles":31186816,"thread_start_us":279653,"threads_started":1,"wal-append.queue_time_us":887780}
I20260709 12:24:42.732782 18141 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.774559 15952 leader_election.cc:400] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:42.774868 15952 leader_election.cc:403] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:42.779985 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:42.780733 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:42.781719 15988 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
W20260709 12:24:42.782208 18386 log.cc:927] Time spent T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:42.780767 15982 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:42.783088 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:42.784062 18377 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.784446 18377 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.773504 18163 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.784785 18377 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.785224 18376 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:42.785765 18376 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.786458 18137 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.787843 18376 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.789618 18351 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.791010 18124 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.780692 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:42.794145 17861 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:42.794687 17861 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:42.794790 17989 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.794214 18377 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.792414 16460 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:42.795673 17861 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.765892 18325 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.797669 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.797678 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:42.799642 15905 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
I20260709 12:24:42.800706 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:42.768486 18331 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.775206 18337 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.796389 18336 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:42.804365 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:42.822649 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 119542us
I20260709 12:24:42.818588 18337 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.802333 18334 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:42.806201 18325 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.827006 18325 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.805877 18336 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.828882 18336 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.830786 18377 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:42.832993 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:42.833540 15988 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.834360 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:42.834995 16495 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:42.802577 17861 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.837634 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.833475 17836 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:42.838574 16493 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:42.839416 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 71057.5us
I20260709 12:24:42.840438 15988 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:42.840759 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:42.841377 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:42.842947 15952 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:42.804840 17989 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.845991 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:42.849231 18337 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.850210 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:42.845511 17989 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:42.850976 17989 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.852154 18351 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:42.852545 18351 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:42.852893 18351 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.855417 18334 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:42.855928 18334 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:42.856820 18334 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:42.848843 18308 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:42.801182 18261 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:42.871716 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.906791 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:42.908277 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.874089 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.912130 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 48027.9us
W20260709 12:24:42.914120 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 90368.4us
I20260709 12:24:42.916306 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:42.916908 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 47714.8us
W20260709 12:24:42.917062 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 49655.6us
I20260709 12:24:42.926864 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:42.936363 15832 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:42.936478 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:42.941318 15905 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:42.931152 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:42.946950 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:42.948814 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:42.954887 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:42.915022 18308 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:42.917598 18137 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.963265 16493 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:42.929255 18317 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:42.944569 18344 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:42.871387 18337 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 12:24:42.956660 18390 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:24:42.933841 18376 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:24:42.984653 15876 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.005s
I20260709 12:24:42.997107 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.008002 15988 raft_consensus.cc:2393] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:42.957461 18331 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.997536 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:43.013886 15981 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.933738 18342 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:24:43.005697 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 50914.6us
I20260709 12:24:43.017123 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:43.006934 15876 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.003s	sys 0.006s
I20260709 12:24:42.997808 15984 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:43.018065 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 597262us
I20260709 12:24:43.010365 18189 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:43.018435 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:42.975576 18391 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:24:43.002554 18163 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:43.003578 18137 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:43.001509 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.002444 18343 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.034298 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:42.987519 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:42.950989 18222 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:24:43.036477 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.035264 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.007906 18319 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.038513 18319 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.038900 18319 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.039523 16488 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:43.042346 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.010461 18344 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:43.029069 18189 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:43.008761 17989 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.037985 15984 raft_consensus.cc:2410] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:43.061591 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.064213 16495 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:43.073516 15981 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:43.079478 15979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1548) took 1583 ms (client timeout 1790 ms). Trace:
W20260709 12:24:43.051998 18117 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 12:24:43.082409 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.085964 15829 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:43.057811 18391 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.045526 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:43.079949 15979 rpcz_store.cc:269] 0709 12:24:41.478348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.478447 (+    99us) service_pool.cc:224] Handling call
0709 12:24:43.061499 (+1583052us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54003151d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:43.061593 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370852096}
W20260709 12:24:43.085196 15876 leader_election.cc:336] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.743s (SENT)
I20260709 12:24:43.048228 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.083932 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.090348 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:43.084605 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:43.089341 15987 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.034169 18141 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.090749 16496 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:43.043560 18238 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:43.058087 18379 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:43.078923 18163 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:42.985008 18336 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.035024 18331 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:24:43.083227 18137 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:43.049082 18319 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.118602 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:43.052812 18308 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.223562 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1559) took 1365 ms. Trace:
I20260709 12:24:43.131335 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.231630 15829 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:43.133262 16489 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:43.228195 15981 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.182699 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.230659 15986 rpcz_store.cc:276] 0709 12:24:41.866913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.867173 (+   260us) service_pool.cc:224] Handling call
0709 12:24:41.919046 (+ 51873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.766055 (+847009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.223296 (+457241us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400139a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:43.223498 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835793792}
I20260709 12:24:43.095206 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:43.204250 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 120542us
W20260709 12:24:43.119726 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.224768 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:43.242959 15984 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:43.243171 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.244004 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.193787 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 164660us
W20260709 12:24:43.227389 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 309391us
W20260709 12:24:43.177783 18210 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.001s
W20260709 12:24:43.230763 18173 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 12:24:43.219339 18268 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:43.201835 18403 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:43.249543 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:43.218369 18383 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.202247 18141 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.249850 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.252362 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.131153 16486 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.221212 18189 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.253113 16490 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:43.254561 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:43.254976 18336 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.255316 18173 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.093492 18391 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.258309 18398 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:24:43.132828 18399 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.215s
I20260709 12:24:43.260763 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.261157 17989 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.261884 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.357748 15988 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:43.358892 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:43.229817 18344 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.262674 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:43.263676 18404 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:43.272818 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.361423 18163 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.362402 18173 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:43.362498 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:43.363168 18173 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.363651 18173 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:43.287032 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.178925 18379 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.364645 18173 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.366288 18319 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:43.366478 18379 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.233203 18343 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.289960 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:43.093933 18238 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:43.290863 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:43.292541 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:43.296236 15984 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:43.334810 15981 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:43.337936 15829 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
W20260709 12:24:43.337091 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45444.7us
I20260709 12:24:43.370715 15953 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:43.091955 18117 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.250689 18268 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:43.331568 18408 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.345367 18347 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:43.244858 18331 consensus_queue.cc:1243] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:43.347450 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.346668 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1563) took 1222 ms. Trace:
W20260709 12:24:43.349601 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 104711us
I20260709 12:24:43.250783 18210 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.258741 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.394379 15982 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:43.353240 18337 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.389222 15980 rpcz_store.cc:276] 0709 12:24:42.124106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.134499 (+ 10393us) service_pool.cc:224] Handling call
0709 12:24:42.219095 (+ 84596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.438102 (+219007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.438160 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.451441 (+ 13281us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.543897 (+ 92456us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:42.543949 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.273394 (+729445us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540011a8d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:43.273435 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.273478 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:43.273490 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.346607 (+ 73117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6811,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":4458,"spinlock_wait_cycles":466595584,"thread_start_us":57054,"threads_started":1,"wal-append.queue_time_us":171805}
I20260709 12:24:43.386762 18137 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.397583 18337 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.398365 15980 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:43.399544 15980 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:43.287881 18325 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:24:43.360702 15987 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:43.363653 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:43.371300 15876 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.630s (SENT)
I20260709 12:24:43.378151 15913 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.370016 15905 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:43.380554 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1508) took 1326 ms (client timeout 1571 ms). Trace:
I20260709 12:24:43.375347 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.381006 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1507) took 1450 ms. Trace:
I20260709 12:24:43.381501 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:43.381654 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 128758us
I20260709 12:24:43.405524 15988 raft_consensus.cc:2368] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6.
I20260709 12:24:43.384982 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:43.390822 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:43.394488 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.406349 15984 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:43.406648 15838 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:43.403915 15834 rpcz_store.cc:269] 0709 12:24:42.044900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.077738 (+ 32838us) service_pool.cc:224] Handling call
0709 12:24:43.260615 (+1182877us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800010298. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:43.370945 (+110330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4345216}
I20260709 12:24:43.380055 18379 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.404929 15833 rpcz_store.cc:276] 0709 12:24:41.922822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.078455 (+155633us) service_pool.cc:224] Handling call
0709 12:24:43.286884 (+1208429us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800010298. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:43.365027 (+ 78143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4569856}
I20260709 12:24:43.410187 15985 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.412138 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:43.412528 15904 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.414911 15986 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:43.388373 18334 raft_consensus.cc:2764] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:43.416033 15910 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:43.298509 18383 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.417016 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.399778 18337 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.386915 18188 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:43.418926 15980 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:43.355516 18351 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:43.422175 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 50889.7us
I20260709 12:24:43.423390 18126 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.424057 18360 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:43.424811 18370 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.441306 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.441913 15833 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:43.426946 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.443176 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.443944 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:43.427798 18294 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:43.429188 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:43.429410 18228 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.429929 18343 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:43.459937 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:43.437548 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:43.439129 15876 leader_election.cc:336] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.731s (SENT)
W20260709 12:24:43.461946 15876 leader_election.cc:336] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.808s (SENT)
I20260709 12:24:43.462354 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.463048 15832 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.347513 18403 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.440708 15879 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:43.441754 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 71139.7us
I20260709 12:24:43.430716 18331 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:43.454553 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.458839 15904 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:43.475682 15838 raft_consensus.cc:2376] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6. Re-sending same reply.
I20260709 12:24:43.361459 18400 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.140s
I20260709 12:24:43.428400 18415 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.421454 17836 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:43.472801 15913 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:43.416637 18379 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.476521 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:43.487186 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.509364 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:43.459441 18334 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.517699 15803 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:43.435590 18368 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.519667 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.520288 15833 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:43.443610 18297 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.504845 18407 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.491060 15905 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:43.516697 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.497416 15832 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:43.504743 18210 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:43.527290 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.527931 15832 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:43.523846 18297 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.528925 18399 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.529340 18399 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.529663 18399 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.394948 18408 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.532142 18408 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.523653 18368 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:43.522760 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 48062.9us
I20260709 12:24:43.486649 18268 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.550127 18268 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.524448 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.553333 15833 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 3: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:43.510370 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.524770 15803 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:43.459677 18163 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:24:43.521538 18347 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:43.507579 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.521534 18319 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:43.528739 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.548619 18407 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.574998 15834 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:43.554651 15838 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:43.575207 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:43.469404 18294 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.473950 18228 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.573320 15832 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.565867 18210 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:43.455797 18360 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.532748 18408 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:24:43.526783 18415 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.577499 18347 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:43.519487 17836 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:43.574201 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 113211us
I20260709 12:24:43.572009 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.593366 15831 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.487252 18141 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:24:43.546940 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.565888 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.467931 18126 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.609872 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1501) took 1897 ms. Trace:
W20260709 12:24:43.609992 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.611979 15832 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:43.595685 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:43.612955 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:43.488217 18370 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.585760 18117 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.579599 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.580425 18210 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.603312 18379 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.603423 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.603901 18391 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.580693 18368 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.604737 18403 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.605726 18297 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.607273 18228 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.608668 18294 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.522511 18334 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.613341 15904 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:43.806130 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.680357 15831 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:43.806908 15838 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:43.645959 18261 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:43.755656 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.810559 15833 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.610232 15836 rpcz_store.cc:276] 0709 12:24:41.692404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.692522 (+   118us) service_pool.cc:224] Handling call
0709 12:24:41.692811 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:42.045295 (+352484us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:42.046247 (+   952us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.460362 (+1414115us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:43.475393 (+ 15031us) log.cc:844] Serialized 52 byte log entry
0709 12:24:43.475600 (+   207us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:43.475662 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.475751 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.589210 (+113459us) raft_consensus.cc:1685] finished
0709 12:24:43.589231 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.589354 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772045,"prepare.queue_time_us":223,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":752490,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":15839,"thread_start_us":1020521,"threads_started":3,"wal-append.queue_time_us":614793}
W20260709 12:24:43.656215 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 147538us
I20260709 12:24:43.613266 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:43.714141 16494 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:43.813326 15832 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.813465 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:43.815094 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 290371us
I20260709 12:24:43.817909 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:43.819733 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:43.820443 15904 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.820545 15910 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:43.584122 18291 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.720830 18036 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.583022 18383 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:43.815785 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:43.846904 15803 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:43.849161 15906 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:43.647135 18336 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:43.832100 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:43.829957 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:43.583935 18415 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.588932 17836 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.581825 18360 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.582069 18124 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:43.589020 18319 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:43.744169 18407 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:43.835623 18036 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:43.883240 18036 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.884569 18036 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.887307 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2491) took 1246 ms. Trace:
I20260709 12:24:43.577903 18412 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.887990 18412 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.888480 18412 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.887740 15830 rpcz_store.cc:276] 0709 12:24:42.641129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.712536 (+ 71407us) service_pool.cc:224] Handling call
0709 12:24:42.753748 (+ 41212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.387202 (+633454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.387245 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.407363 (+ 20118us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.799685 (+392322us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:43.799746 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.799838 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.887107 (+ 87269us) raft_consensus.cc:1685] finished
0709 12:24:43.887125 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.887248 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649949,"raft.queue_time_us":637448,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":7321,"thread_start_us":368958,"threads_started":1,"wal-append.queue_time_us":454859}
I20260709 12:24:43.889847 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.890105 18344 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.890381 15830 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:43.890612 18344 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.891105 18344 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.891673 15837 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:43.891371 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.892421 15831 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:43.893365 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1520) took 1238 ms. Trace:
I20260709 12:24:43.839771 18174 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.830304 16493 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:43.770177 18351 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.840242 18117 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.800559 18163 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:24:43.812129 18141 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:43.750734 18413 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:43.843981 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1561) took 1855 ms. Trace:
I20260709 12:24:43.580842 18414 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.844916 15829 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:43.830371 15904 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:43.852950 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:43.854693 15910 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:43.855340 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:43.857342 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:43.826144 18391 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.587368 18347 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.833467 18379 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.865991 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 663) took 1034 ms. Trace:
I20260709 12:24:43.869622 18126 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:43.856463 18424 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:43.859674 18297 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:24:43.855415 18368 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.876485 18319 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.879786 18399 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:43.887493 18224 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:43.888890 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56897.6us
I20260709 12:24:43.838548 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.668867 18238 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.589254 18188 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.893755 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.262420 15911 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:44.263564 15838 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:44.264300 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1541) took 1349 ms. Trace:
I20260709 12:24:44.264534 15983 rpcz_store.cc:276] 0709 12:24:41.988625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.076056 (+ 87431us) service_pool.cc:224] Handling call
0709 12:24:42.076399 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.442930 (+366531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.843718 (+1400788us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002788d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:43.843916 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806386048}
I20260709 12:24:44.265836 15833 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:24:44.266891 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:44.267510 16494 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.152658 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:44.035542 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.269481 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.260218 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:44.101382 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:43.893712 15837 rpcz_store.cc:276] 0709 12:24:42.654658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.755672 (+101014us) service_pool.cc:224] Handling call
0709 12:24:43.891481 (+1135809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.892052 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.893211 (+  1159us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400250650. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:43.893319 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611499776}
I20260709 12:24:43.915601 15832 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:43.891403 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:44.099673 18427 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.894352 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.263464 18415 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.894073 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:44.265793 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.152482 18317 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:44.278326 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 425376us
I20260709 12:24:44.263521 18141 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:44.306744 18222 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:44.288825 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.307314 18141 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.308246 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.308658 18141 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.286540 18174 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.854151 18336 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:44.292034 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.305588 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:44.286454 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:43.860635 18383 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.442s
W20260709 12:24:44.245309 18409 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.014s
I20260709 12:24:44.300005 15982 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:44.301303 15830 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.302767 15912 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:44.207232 16490 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.326063 15909 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.326669 15906 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:44.303794 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.332474 15983 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:43.924609 17836 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.217219 18412 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:43.894354 18124 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.274500 18117 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:44.304951 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 44814.8us
I20260709 12:24:44.259732 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.261188 18224 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:24:44.306913 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.309259 18163 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:44.308902 15911 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:44.320587 15904 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:44.320703 15837 raft_consensus.cc:2410] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:44.307340 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.359786 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1544) took 1401 ms. Trace:
I20260709 12:24:44.360288 15837 rpcz_store.cc:276] 0709 12:24:42.957939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.305365 (+1347426us) service_pool.cc:224] Handling call
0709 12:24:44.359710 (+ 54345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.360819 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.309973 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:44.361464 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:44.362097 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54166.7us
I20260709 12:24:44.264845 15838 rpcz_store.cc:276] 0709 12:24:42.914831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.838222 (+923391us) service_pool.cc:224] Handling call
0709 12:24:44.264239 (+426017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.362954 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:44.363315 18360 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.314586 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:44.364781 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1547) took 1371 ms. Trace:
I20260709 12:24:44.364410 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:43.900779 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:44.366328 15836 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:44.366052 18379 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:44.367498 15837 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:44.368263 15838 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.368556 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1521) took 1698 ms. Trace:
I20260709 12:24:44.369102 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1522) took 1661 ms. Trace:
I20260709 12:24:44.270287 18334 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.335186 16494 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:44.337878 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:44.340781 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44282.3us
I20260709 12:24:44.340488 17836 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:44.235287 18324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.006s	sys 0.017s
W20260709 12:24:44.370692 18324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.007s	sys 0.019s
W20260709 12:24:44.084110 18419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.010s
W20260709 12:24:44.371194 18419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.000s	sys 0.014s
I20260709 12:24:44.342710 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.371971 17836 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:44.372422 15982 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.372586 15980 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:44.373587 15980 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.342520 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.369654 15838 rpcz_store.cc:276] 0709 12:24:42.708216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.367600 (+1659384us) service_pool.cc:224] Handling call
0709 12:24:44.368017 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.368810 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.369053 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.288200 18126 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.352933 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:44.322077 18409 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.013s	sys 0.015s
I20260709 12:24:44.374529 15983 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:44.321610 15985 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.263638 18424 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:44.376978 18424 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.365272 15831 rpcz_store.cc:276] 0709 12:24:42.993301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.314239 (+1320938us) service_pool.cc:224] Handling call
0709 12:24:44.364708 (+ 50469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.379737 15831 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.380230 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1524) took 1630 ms. Trace:
I20260709 12:24:44.362989 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.382921 15803 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:44.384127 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:44.386494 18414 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:44.386943 18414 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:44.387324 18414 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.388911 18126 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.389810 18126 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:44.390355 18126 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:44.391363 18126 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.334355 18317 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.393262 18210 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.263761 16486 rpcz_store.cc:276] 0709 12:24:42.831951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.832059 (+   108us) service_pool.cc:224] Handling call
0709 12:24:42.832387 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.351088 (+518701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.865694 (+514606us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54007044d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:43.865911 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595677056}
I20260709 12:24:44.394526 18174 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.394634 18317 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:44.395462 15979 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:44.323521 18336 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.393452 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.380513 15831 rpcz_store.cc:276] 0709 12:24:42.749918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.379284 (+1629366us) service_pool.cc:224] Handling call
0709 12:24:44.379546 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.380037 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.380186 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.399746 15831 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:44.402946 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1525) took 1640 ms. Trace:
I20260709 12:24:44.403477 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.403770 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.369372 15837 rpcz_store.cc:276] 0709 12:24:42.669906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.366727 (+1696821us) service_pool.cc:224] Handling call
0709 12:24:44.367239 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.368092 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.368434 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87424}
I20260709 12:24:44.375670 15838 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:44.275472 18413 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.336623 18417 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:44.397411 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:44.403469 15831 rpcz_store.cc:276] 0709 12:24:42.762192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.399211 (+1637019us) service_pool.cc:224] Handling call
0709 12:24:44.399514 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.400180 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.402878 (+  2698us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:44.405391 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 145757us
I20260709 12:24:44.400751 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:44.404716 15986 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:44.407629 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2494) took 1667 ms. Trace:
I20260709 12:24:44.307327 18222 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.411373 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.414674 15835 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:44.421640 15906 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:44.416885 15838 rpcz_store.cc:276] 0709 12:24:42.740466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.374878 (+1634412us) service_pool.cc:224] Handling call
0709 12:24:44.375254 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.407294 (+ 32040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.407551 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.418540 15831 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:44.322717 18415 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.420235 15837 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.426261 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1526) took 1663 ms. Trace:
I20260709 12:24:44.426717 15837 rpcz_store.cc:276] 0709 12:24:42.762492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.407227 (+1644735us) service_pool.cc:224] Handling call
0709 12:24:44.420041 (+ 12814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.426037 (+  5996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.426205 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.426261 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1531) took 1662 ms. Trace:
I20260709 12:24:44.428438 15831 rpcz_store.cc:276] 0709 12:24:42.763811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.417791 (+1653980us) service_pool.cc:224] Handling call
0709 12:24:44.418323 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.426033 (+  7710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.426205 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:44.452023 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.452625 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.402968 18163 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:44.309809 18427 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.467099 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2497) took 1628 ms. Trace:
I20260709 12:24:44.455186 18370 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:44.482108 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 84681us
I20260709 12:24:44.486377 18413 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:44.488180 18344 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.003s
I20260709 12:24:44.405803 18321 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:44.421447 18417 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.484069 15837 rpcz_store.cc:276] 0709 12:24:42.838732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.427787 (+1589055us) service_pool.cc:224] Handling call
0709 12:24:44.455722 (+ 27935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.466636 (+ 10914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.466678 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.466738 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:44.466793 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.466871 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.467026 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.492755 18415 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:44.492957 18417 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:44.442343 17989 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:44.493635 18432 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:44.493817 17989 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.494192 17989 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.494956 18222 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.495141 18124 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:44.495849 18117 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.497161 18412 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.413241 18398 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:44.498308 18398 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:44.499063 18407 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:44.499487 18407 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:44.499217 18398 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.500298 18407 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:44.510064 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.509881 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.451457 18188 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:44.411556 18096 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:24:44.504419 15830 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:44.490247 18427 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:44.515799 15803 leader_election.cc:400] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6.
I20260709 12:24:44.501233 18308 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:44.516585 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 522) took 1070 ms. Trace:
W20260709 12:24:44.503101 15876 connection.cc:256] RPC call timeout handler was delayed by -1.0404302089996236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:24:44.519724 15803 leader_election.cc:403] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:44.520852 15830 rpcz_store.cc:276] 0709 12:24:43.446280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.891091 (+444811us) service_pool.cc:224] Handling call
0709 12:24:44.516520 (+625429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57600}
W20260709 12:24:44.521890 15876 leader_election.cc:336] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.810s (SENT)
I20260709 12:24:44.522287 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:44.523195 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 510) took 1662 ms. Trace:
I20260709 12:24:44.466467 18334 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.524330 15803 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.524109 15830 rpcz_store.cc:276] 0709 12:24:42.860950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.522422 (+1661472us) service_pool.cc:224] Handling call
0709 12:24:44.522735 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.522896 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.522923 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.522960 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.523007 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.523056 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.523146 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.532812 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 511) took 1671 ms. Trace:
I20260709 12:24:44.532470 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:44.527372 15876 leader_election.cc:336] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.989s (SENT)
I20260709 12:24:44.533697 15879 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.533915 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:44.533205 15830 rpcz_store.cc:276] 0709 12:24:42.861282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.532183 (+1670901us) service_pool.cc:224] Handling call
0709 12:24:44.532455 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.532608 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.532623 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.532650 (+    27us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.532680 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.532713 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.532775 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.515347 18413 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.541191 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.541899 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.510401 18124 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:44.518500 18379 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.513414 18415 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:44.518474 18188 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:44.509426 18344 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.529290 17836 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6.
I20260709 12:24:44.529264 18321 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:24:44.536378 18297 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.517004 18370 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:44.530020 18308 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.534819 18407 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:44.548195 15876 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.039s (SENT)
I20260709 12:24:44.607888 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:44.563215 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 513) took 1696 ms. Trace:
I20260709 12:24:44.572144 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.537767 18360 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:24:44.572887 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.541327 18413 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:44.554395 18436 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:24:44.551690 18418 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.018s	user 0.004s	sys 0.009s
W20260709 12:24:44.572463 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.608855 15832 rpcz_store.cc:276] 0709 12:24:42.866865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.562341 (+1695476us) service_pool.cc:224] Handling call
0709 12:24:44.562678 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.562852 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.562880 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.562934 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.562979 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.563047 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.563156 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.610556 15950 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:44.605082 18297 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.621114 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 515) took 1707 ms. Trace:
I20260709 12:24:44.621477 15832 rpcz_store.cc:276] 0709 12:24:42.913598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.620316 (+1706718us) service_pool.cc:224] Handling call
0709 12:24:44.620610 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.620785 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.620810 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.620847 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:44.620884 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.620944 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.621055 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.622016 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.622614 15912 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:44.623154 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 519) took 1658 ms. Trace:
I20260709 12:24:44.623462 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.623976 15912 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.589996 18412 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.612510 18268 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:44.612751 17989 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.563284 18336 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.573526 18379 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:44.557341 18163 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.613583 18408 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.538875 18334 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:44.611725 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 85740.6us
W20260709 12:24:44.616098 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.580922 18440 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.602069 18427 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:44.616657 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82077.8us
W20260709 12:24:44.618229 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 70093.3us
I20260709 12:24:44.602476 18441 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.627667 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.621536 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.636322 15904 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:44.610949 18421 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:24:44.684280 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 151971us
I20260709 12:24:44.681282 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:44.684890 15876 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.127s (SENT)
I20260709 12:24:44.686717 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.686939 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:44.687315 15904 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:44.686091 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:44.643435 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 69209.6us
I20260709 12:24:44.688174 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.623477 15832 rpcz_store.cc:276] 0709 12:24:42.964361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.622486 (+1658125us) service_pool.cc:224] Handling call
0709 12:24:44.622761 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.622900 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.622923 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.622956 (+    33us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.622983 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.623029 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.623111 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.641238 18376 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:44.607443 18442 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.612825 18415 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:24:44.617110 18413 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.692616 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:44.694317 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 520) took 1720 ms. Trace:
I20260709 12:24:44.691376 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.606935 18424 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.695482 15911 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:44.690557 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:44.697093 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.626288 18297 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.741541 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.738955 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:44.741377 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50888.5us
I20260709 12:24:44.739816 15832 rpcz_store.cc:276] 0709 12:24:42.976645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.693436 (+1716791us) service_pool.cc:224] Handling call
0709 12:24:44.693711 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.693929 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.693966 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.694022 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:44.694066 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.694135 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.694250 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.691211 18427 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.771350 18427 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.773438 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.689448 18441 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:44.776914 18441 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.741117 18319 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.778388 18334 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.778882 18319 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.781363 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.782418 15983 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.847177 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.848958 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.847330 15980 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.848045 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.848400 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 521) took 1787 ms. Trace:
I20260709 12:24:44.850414 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.850265 15832 rpcz_store.cc:276] 0709 12:24:43.060647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.760693 (+1700046us) service_pool.cc:224] Handling call
0709 12:24:44.847959 (+ 87266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.848119 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.848140 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.848177 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.848212 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.848260 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.848351 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.850979 15912 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:44.851125 16495 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:44.856957 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.857205 15985 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:44.857555 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.857224 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:44.859124 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 174336us
W20260709 12:24:44.860023 15876 leader_election.cc:336] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.430s (SENT)
I20260709 12:24:44.860484 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:44.861533 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.863210 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:44.782518 18444 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:44.702066 18421 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.871996 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:44.867060 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 174501us
I20260709 12:24:44.868122 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.652530 18268 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:44.642864 18412 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.874660 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.888787 16496 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:44.888190 15905 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:44.890363 18324 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.888203 18412 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.891057 18324 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.893745 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.875047 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:44.875281 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:44.870559 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.881481 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.781330 18376 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:44.898775 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:44.891847 18412 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.904502 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.905903 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:44.906647 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.909183 15912 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:44.913468 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.874230 18347 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.846820 17836 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:24:44.645308 18433 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.245s
I20260709 12:24:44.782295 18297 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.897686 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.881891 18440 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:44.923751 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48767.1us
I20260709 12:24:44.923072 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:44.914132 18173 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:44.690016 18188 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.935737 15912 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:44.943949 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2500) took 1516 ms. Trace:
I20260709 12:24:44.924600 18347 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.923323 18210 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.921344 18451 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.965387 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.965080 15832 rpcz_store.cc:276] 0709 12:24:43.427268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.851796 (+1424528us) service_pool.cc:224] Handling call
0709 12:24:44.852053 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.852298 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:44.909908 (+ 57610us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.911673 (+  1765us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.943509 (+ 31836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.943556 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.943624 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.943731 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.943877 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31643,"thread_start_us":16281,"threads_started":2}
I20260709 12:24:44.971884 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:44.923640 18370 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:44.973493 18370 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.920989 18412 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.870335 18414 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.942767 18319 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:44.923118 16490 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:44.933872 18344 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:44.927983 18379 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.964058 18360 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:44.976038 18370 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:44.984388 15952 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:44.960584 18442 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:44.968298 18347 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.921576 18450 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:44.898118 18421 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:44.994370 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:44.999089 18454 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:24:44.999261 18455 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:44.999478 18456 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:45.002898 15952 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:45.003871 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:45.005069 15952 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:44.967903 18173 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:45.012396 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48474.9us
I20260709 12:24:45.000582 18222 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:45.000419 18344 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:24:45.015192 18222 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.016180 18344 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:45.016644 18344 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:44.977845 18210 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.995857 18324 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:44.997604 17989 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.997743 18336 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.009665 18433 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.028213 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1085) took 1134 ms. Trace:
I20260709 12:24:45.010927 18379 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.000645 18360 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:45.024578 18443 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:24:45.024792 18424 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:45.025327 18453 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:24:45.025831 18476 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:45.025905 18297 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.028610 15909 rpcz_store.cc:276] 0709 12:24:43.893965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.894458 (+   493us) service_pool.cc:224] Handling call
0709 12:24:44.272493 (+378035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.326592 (+ 54099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.027964 (+701372us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b540029ac54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:45.028139 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122614656}
I20260709 12:24:45.059532 15906 raft_consensus.cc:2410] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:45.033902 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:45.042009 18470 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:45.042718 18360 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.066310 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:45.067104 15986 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:45.067274 18189 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:45.049515 18447 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 12:24:45.043341 18414 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:45.045193 18459 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.040545 18344 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.076095 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:45.076014 18459 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.077361 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:45.077872 15909 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.045838 18460 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:45.046257 18210 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.047847 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2493) took 2375 ms. Trace:
I20260709 12:24:45.087443 15836 rpcz_store.cc:276] 0709 12:24:42.672817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.366875 (+1694058us) service_pool.cc:224] Handling call
0709 12:24:44.367126 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.367478 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.367509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.367995 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.522003 (+154008us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:44.522063 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.522171 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.047655 (+525484us) raft_consensus.cc:1685] finished
0709 12:24:45.047673 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.047792 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1339,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"thread_start_us":153618,"threads_started":1,"wal-append.queue_time_us":223376}
I20260709 12:24:45.089013 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:45.011390 18370 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:45.089543 18427 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.048636 18402 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:45.090670 18402 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:45.090822 15904 raft_consensus.cc:2368] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:45.082207 18460 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:45.091593 18427 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.092139 18460 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:44.993391 18268 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.049973 18476 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.115530 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:45.054602 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:45.062988 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.117264 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.037117 18324 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.084088 18173 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:44.997515 18442 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.085611 18421 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:45.086750 15981 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:45.089285 18405 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:44.985371 18376 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.064831 18450 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:45.096349 18347 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.078578 18470 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.107375 18189 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:45.111431 18459 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.142572 16496 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:45.091517 18402 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.100345 18224 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.126292 18417 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.078855 18141 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.005s
I20260709 12:24:45.084533 18441 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.122378 18460 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.148984 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:45.126256 18370 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.160343 15836 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:45.128656 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:45.137179 18455 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:45.163472 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.163694 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:45.165182 15909 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:45.167810 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:45.142584 18464 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:45.169399 15911 raft_consensus.cc:2410] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:24:45.164474 18331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.638s	user 0.011s	sys 0.018s
I20260709 12:24:45.138558 18450 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:45.178736 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:45.162086 18224 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.173153 18476 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:45.174477 18442 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:45.175069 18413 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.156327 18189 consensus_queue.cc:1243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:45.172739 18188 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:45.162475 18325 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:45.166625 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:45.175182 18464 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.140311 18405 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.340118 15905 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:45.176628 18331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.656s	user 0.011s	sys 0.019s
I20260709 12:24:45.180322 18402 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.930474 18331 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:45.634709 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2489) took 2952 ms. Trace:
I20260709 12:24:45.384402 18222 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:45.931600 18331 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.932701 18188 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.933212 18188 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.180410 18450 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:45.384146 18477 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:24:45.938156 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1014) took 1237 ms. Trace:
I20260709 12:24:45.938642 18413 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.939370 18413 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.235416 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.938490 15984 rpcz_store.cc:276] 0709 12:24:44.700809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.896580 (+195771us) service_pool.cc:224] Handling call
0709 12:24:44.896936 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.923110 (+ 26174us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:44.925841 (+  2731us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.082592 (+156751us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.093156 (+ 10564us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.093378 (+   222us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:45.093570 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.093664 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.937980 (+844316us) raft_consensus.cc:1685] finished
0709 12:24:45.937997 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.938098 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11592,"prepare.queue_time_us":7889,"prepare.run_wall_time_us":45,"raft.queue_time_us":55362,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":27604,"spinlock_wait_cycles":3007360,"thread_start_us":148645,"threads_started":1,"wal-append.queue_time_us":251672}
W20260709 12:24:45.940256 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.339969 18268 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.940685 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.214618 18424 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.941687 18325 consensus_queue.cc:1243] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:45.709556 18441 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.348729 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 669) took 1872 ms. Trace:
W20260709 12:24:45.765184 15803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.012s	sys 0.000s
W20260709 12:24:45.949493 15803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.014s	sys 0.001s
W20260709 12:24:45.950117 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 782319us
I20260709 12:24:45.179478 15909 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.951438 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:45.179895 18455 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:45.941129 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.230548 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.220456 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 215474us
I20260709 12:24:45.931497 15835 rpcz_store.cc:276] 0709 12:24:42.512052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.661574 (+149522us) service_pool.cc:224] Handling call
0709 12:24:42.681507 (+ 19933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.421824 (+1740317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.464058 (+1042234us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400082d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:45.464376 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3985136000}
I20260709 12:24:45.977844 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:45.940958 18460 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.774s	user 0.009s	sys 0.000s
I20260709 12:24:45.162149 18417 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:45.947393 16489 rpcz_store.cc:276] 0709 12:24:43.476763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.476924 (+   161us) service_pool.cc:224] Handling call
0709 12:24:43.486789 (+  9865us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:43.507379 (+ 20590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.507409 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:45.030127 (+1522718us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b2c0009bf18. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:24:45.030648 (+   521us) log.cc:844] Serialized 52 byte log entry
0709 12:24:45.167595 (+136947us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:45.167629 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.167691 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.348326 (+180635us) raft_consensus.cc:1685] finished
0709 12:24:45.348352 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.348624 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4073,"raft.queue_time_us":572,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5878,"spinlock_wait_cycles":2502912,"thread_start_us":136597,"threads_started":1,"wal-append.queue_time_us":271664}
W20260709 12:24:45.355005 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.939831 18413 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:45.981544 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.747918 18478 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
W20260709 12:24:45.990391 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.988175 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1537) took 3117 ms (client timeout 1989 ms). Trace:
W20260709 12:24:45.991297 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.991900 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:45.994709 18376 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.646377 18347 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:45.166680 18370 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:45.200866 18473 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.994544 15834 rpcz_store.cc:269] 0709 12:24:42.857379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.437276 (+579897us) service_pool.cc:224] Handling call
0709 12:24:45.974355 (+2537079us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540024ead4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:45.975067 (+   712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261176704}
I20260709 12:24:45.346050 18461 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.345849 18470 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:45.999579 15952 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.589s (SENT) [suppressed 30 similar messages]
I20260709 12:24:45.999948 18489 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.000836 15909 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:45.988436 18441 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.016402 18441 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.018343 18490 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.018879 18441 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.019110 18490 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.020212 18489 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:46.003497 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.004062 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.022804 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2387) took 1057 ms. Trace:
I20260709 12:24:46.023195 15909 rpcz_store.cc:276] 0709 12:24:44.965683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.166102 (+200419us) service_pool.cc:224] Handling call
0709 12:24:46.022744 (+856642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.004078 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:46.024993 15834 raft_consensus.cc:2410] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:46.029611 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:46.012118 18473 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:46.025013 15832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.005s	sys 0.035s
W20260709 12:24:46.031006 15832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.005s	sys 0.035s
I20260709 12:24:46.031980 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2502) took 2604 ms. Trace:
I20260709 12:24:46.039096 15835 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:45.941007 18268 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.072253 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.091900 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.092374 15909 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:46.092990 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2380) took 1170 ms. Trace:
I20260709 12:24:46.093441 15909 rpcz_store.cc:276] 0709 12:24:44.922247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.071925 (+1149678us) service_pool.cc:224] Handling call
0709 12:24:46.092918 (+ 20993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.001343 18342 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:46.021680 18464 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.000579 18460 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.092921 15834 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:46.122390 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2512) took 1059 ms. Trace:
I20260709 12:24:46.122887 15834 rpcz_store.cc:276] 0709 12:24:45.062533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.091436 (+1028903us) service_pool.cc:224] Handling call
0709 12:24:46.122329 (+ 30893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.124269 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.125260 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1557) took 1001 ms. Trace:
I20260709 12:24:46.127344 15834 rpcz_store.cc:276] 0709 12:24:45.123904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.123953 (+1000049us) service_pool.cc:224] Handling call
0709 12:24:46.125199 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.054123 18424 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.053598 18470 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:46.137279 18461 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:46.160445 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:46.168007 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.144596 18490 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.169869 15834 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.170540 15909 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:46.140590 18342 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:46.172071 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 439) took 1203 ms. Trace:
I20260709 12:24:46.172344 15909 rpcz_store.cc:276] 0709 12:24:44.969270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.094215 (+1124945us) service_pool.cc:224] Handling call
0709 12:24:46.172028 (+ 77813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.138725 18460 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.168524 18420 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.218868 18413 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.219012 15908 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:46.219493 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2364) took 1578 ms (client timeout 1975 ms). Trace:
I20260709 12:24:46.221464 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2513) took 1151 ms. Trace:
I20260709 12:24:46.222092 18405 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.223063 18188 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.225999 18455 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:46.226480 18347 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.226872 18450 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:46.227134 18370 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:46.233601 15829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1527) took 3470 ms (client timeout 1902 ms). Trace:
I20260709 12:24:46.235497 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 512) took 3370 ms. Trace:
I20260709 12:24:46.235639 18268 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.235528 18402 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.236789 18342 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:46.240161 18492 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.270830 18347 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.273381 18492 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:46.273963 15906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2348) took 1654 ms (client timeout 1589 ms). Trace:
W20260709 12:24:46.274371 15906 rpcz_store.cc:269] 0709 12:24:44.619460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.621202 (+  1742us) service_pool.cc:224] Handling call
0709 12:24:46.273758 (+1652556us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540038fc54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:46.273889 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851848064}
I20260709 12:24:46.275127 18347 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:46.275377 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.275763 18492 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:46.276005 15906 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:46.276472 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2385) took 1332 ms. Trace:
W20260709 12:24:46.240773 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.236810 18124 raft_consensus.cc:3055] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:46.242488 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 509) took 3381 ms. Trace:
I20260709 12:24:46.277458 15837 rpcz_store.cc:276] 0709 12:24:42.860650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.241701 (+3381051us) service_pool.cc:224] Handling call
0709 12:24:46.242008 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.242163 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.242199 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.242236 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:46.242271 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.242326 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.242422 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.276777 15906 rpcz_store.cc:276] 0709 12:24:44.944175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.275109 (+1330934us) service_pool.cc:224] Handling call
0709 12:24:46.276423 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.253849 15836 rpcz_store.cc:276] 0709 12:24:45.069936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.088792 (+ 18856us) service_pool.cc:224] Handling call
0709 12:24:46.221316 (+1132524us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b54000901d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:46.221413 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162569600}
I20260709 12:24:46.279125 18503 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:46.279563 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:46.279810 18503 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.280534 15836 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:46.253086 15904 rpcz_store.cc:269] 0709 12:24:44.640762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.857334 (+216572us) service_pool.cc:224] Handling call
0709 12:24:46.218716 (+1361382us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400153bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:46.219428 (+   712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534677760}
I20260709 12:24:46.281088 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2514) took 1205 ms. Trace:
W20260709 12:24:46.259748 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.263960 15830 rpcz_store.cc:276] 0709 12:24:42.864700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.538194 (+1673494us) service_pool.cc:224] Handling call
0709 12:24:45.974510 (+1436316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.974706 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.974736 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.974779 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:45.974823 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.974879 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.235343 (+260464us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540024ead0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:46.235443 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3302337408}
W20260709 12:24:46.263266 15829 rpcz_store.cc:269] 0709 12:24:42.762747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.416790 (+654043us) service_pool.cc:224] Handling call
0709 12:24:46.233366 (+2816576us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54001252d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:46.233510 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950365056}
I20260709 12:24:46.272588 18489 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:46.281658 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:46.477365 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:46.478148 15913 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:46.411363 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 381775us
I20260709 12:24:46.478973 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.281512 15836 rpcz_store.cc:276] 0709 12:24:45.079346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.279254 (+1199908us) service_pool.cc:224] Handling call
0709 12:24:46.280984 (+  1730us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:46.459959 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.479775 15985 raft_consensus.cc:2410] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:24:46.457938 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 357380us
I20260709 12:24:46.331439 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.480897 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:46.481374 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2528) took 1150 ms. Trace:
I20260709 12:24:46.481741 15837 rpcz_store.cc:276] 0709 12:24:45.330864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.278702 (+947838us) service_pool.cc:224] Handling call
0709 12:24:46.481312 (+202610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.480109 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.363606 15984 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:46.339684 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 307469us
I20260709 12:24:46.489795 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.490639 15913 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:46.491039 15985 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:46.383423 16496 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:46.350564 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.299214 16489 raft_consensus.cc:1217] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[3.4-6.5]   Dedup: 3.4->[6.5-6.5]
I20260709 12:24:46.493018 16489 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: [3.4-6.5]
W20260709 12:24:46.490208 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.493286 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.493816 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.493821 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.494364 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:46.494647 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.331799 15988 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:46.495729 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:46.332036 15987 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:46.489812 15836 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:46.478075 18503 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:46.497503 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1560) took 1372 ms. Trace:
I20260709 12:24:46.477602 15904 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:46.481609 16492 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:46.498612 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.307569 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.499436 15909 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:46.499485 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:46.499850 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2383) took 1565 ms. Trace:
I20260709 12:24:46.500090 15909 rpcz_store.cc:276] 0709 12:24:44.934858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.261853 (+1326995us) service_pool.cc:224] Handling call
0709 12:24:46.499806 (+237953us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.497895 15836 rpcz_store.cc:276] 0709 12:24:45.124714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.479886 (+1355172us) service_pool.cc:224] Handling call
0709 12:24:46.497438 (+ 17552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.502794 15982 raft_consensus.cc:1217] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Deduplicated request from leader. Original: 3.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:24:46.503484 15982 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:46.355818 18492 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.504727 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:46.504832 18492 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.505342 15986 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.332183 18261 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.508037 18261 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:46.509353 15906 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:46.509797 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2390) took 1530 ms. Trace:
I20260709 12:24:46.510267 15913 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:46.510233 15906 rpcz_store.cc:276] 0709 12:24:44.979402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.321142 (+1341740us) service_pool.cc:224] Handling call
0709 12:24:46.509746 (+188604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.510946 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2354) took 1882 ms. Trace:
I20260709 12:24:46.511350 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1556) took 1371 ms. Trace:
I20260709 12:24:46.512142 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:46.530525 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.511255 15913 rpcz_store.cc:276] 0709 12:24:44.628973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.509738 (+1880765us) service_pool.cc:224] Handling call
0709 12:24:46.509994 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.510724 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.510892 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.556005 15988 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:46.523483 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.532693 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:46.525102 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.483281 18331 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.560081 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.457886 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:46.483120 18464 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.590273 15984 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:46.567752 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.556825 18470 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.307432 18402 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.590273 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.255514 18420 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.602854 15986 raft_consensus.cc:2410] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:46.591331 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:46.557825 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:46.585333 15985 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:46.642684 15836 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.595638 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.556769 15830 rpcz_store.cc:276] 0709 12:24:45.123580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.494150 (+1370570us) service_pool.cc:224] Handling call
0709 12:24:46.495002 (+   852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.601706 18460 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.648411 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.640707 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2508) took 1579 ms. Trace:
I20260709 12:24:46.592978 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.649353 15909 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:46.640317 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.649147 15837 rpcz_store.cc:276] 0709 12:24:45.061341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.523220 (+1461879us) service_pool.cc:224] Handling call
0709 12:24:46.640623 (+117403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.307287 18124 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:46.599025 16522 heartbeater.cc:646] Failed to heartbeat to 127.14.78.126:37123 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.78.126:37123 timed out after 15.000s (SENT)
I20260709 12:24:46.621672 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2527) took 1291 ms. Trace:
I20260709 12:24:46.566474 18373 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:46.644863 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.665735 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2509) took 1604 ms. Trace:
I20260709 12:24:46.666052 15830 rpcz_store.cc:276] 0709 12:24:45.061681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.644296 (+1582615us) service_pool.cc:224] Handling call
0709 12:24:46.665679 (+ 21383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.667189 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.645328 15988 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:46.645674 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.643177 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:46.669899 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.594257 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:46.387135 18473 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:46.644122 15913 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:46.647398 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:46.483465 18442 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.566622 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:46.619246 18331 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.645990 18464 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.653940 15904 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:46.522776 18489 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.650055 15984 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:46.591019 18493 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.597883 18450 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:46.662606 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.664031 15829 rpcz_store.cc:276] 0709 12:24:45.330523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.509056 (+1178533us) service_pool.cc:224] Handling call
0709 12:24:46.621592 (+112536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.605254 18405 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.671236 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1558) took 1547 ms. Trace:
I20260709 12:24:46.672286 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:46.671741 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 77523.2us
I20260709 12:24:46.672866 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2510) took 1610 ms. Trace:
I20260709 12:24:46.795533 18412 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:46.800416 15981 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 437) took 2452 ms (client timeout 2514 ms). Trace:
I20260709 12:24:46.679662 15909 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:46.800921 15981 rpcz_store.cc:269] 0709 12:24:44.347634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.360467 (+ 12833us) service_pool.cc:224] Handling call
0709 12:24:46.800223 (+2439756us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400139054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:46.800333 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666641152}
I20260709 12:24:46.801581 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2365) took 2160 ms. Trace:
I20260709 12:24:46.802332 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.803575 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.800004 15837 rpcz_store.cc:276] 0709 12:24:45.061976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.651160 (+1589184us) service_pool.cc:224] Handling call
0709 12:24:46.672814 (+ 21654us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:46.804096 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 271463us
I20260709 12:24:44.587453 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:46.805797 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 140748us
I20260709 12:24:46.804168 15981 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:46.807260 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:46.807355 15830 rpcz_store.cc:276] 0709 12:24:45.124182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.666906 (+1542724us) service_pool.cc:224] Handling call
0709 12:24:46.671187 (+  4281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.808899 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.678525 18504 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:46.809969 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2522) took 1591 ms. Trace:
I20260709 12:24:46.810112 18504 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:46.810493 18493 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:46.818727 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:46.819782 15985 raft_consensus.cc:2410] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:24:46.711283 15834 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.539s	user 0.001s	sys 0.011s
I20260709 12:24:46.822165 15834 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
W20260709 12:24:46.822819 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2521) took 1644 ms (client timeout 2026 ms). Trace:
W20260709 12:24:46.823290 15834 rpcz_store.cc:269] 0709 12:24:45.178090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.160192 (+982102us) service_pool.cc:224] Handling call
0709 12:24:46.822748 (+662556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.810521 15830 rpcz_store.cc:276] 0709 12:24:45.218505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.808531 (+1590026us) service_pool.cc:224] Handling call
0709 12:24:46.809897 (+  1366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.753137 15836 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:46.811944 18450 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:46.812184 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:46.802367 15909 rpcz_store.cc:276] 0709 12:24:44.641238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.662335 (+2021097us) service_pool.cc:224] Handling call
0709 12:24:46.679295 (+ 16960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.801328 (+122033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.801529 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:46.855189 15836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2515) took 1736 ms (client timeout 2154 ms). Trace:
I20260709 12:24:46.826454 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:46.855746 15836 rpcz_store.cc:269] 0709 12:24:45.118758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.500887 (+1382129us) service_pool.cc:224] Handling call
0709 12:24:46.855113 (+354226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.856355 15904 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:46.828307 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:46.845712 18508 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:46.665668 18498 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.647151 18470 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.856671 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:47.060734 18464 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.716344 18486 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:47.411616 18486 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.412083 18486 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:46.673837 18495 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.190853 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 438) took 2319 ms. Trace:
I20260709 12:24:46.905874 15987 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:47.413698 15987 pending_rounds.cc:85] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 2
I20260709 12:24:47.414024 15987 pending_rounds.cc:107] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:24:47.414315 15987 raft_consensus.cc:2889] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.817230 18441 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.415906 15987 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:47.415746 18441 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.858625 15953 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:46.904498 18516 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:47.418614 15830 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:47.419374 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2503) took 3991 ms. Trace:
W20260709 12:24:46.858664 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46540.7us
I20260709 12:24:47.419741 15830 rpcz_store.cc:276] 0709 12:24:43.427990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.418189 (+3990199us) service_pool.cc:224] Handling call
0709 12:24:47.418432 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.419136 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.419314 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.665289 18373 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:47.063403 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1086) took 3143 ms. Trace:
I20260709 12:24:46.906266 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:47.531729 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 523) took 4075 ms. Trace:
I20260709 12:24:47.421833 15913 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
W20260709 12:24:47.533934 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 675363us
W20260709 12:24:47.020669 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.932062 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 123318us
I20260709 12:24:47.067180 18174 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:47.064095 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 508) took 4203 ms. Trace:
I20260709 12:24:47.536718 15838 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:46.932020 15909 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:47.410084 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:47.440109 15836 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 2.
W20260709 12:24:47.441179 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.413167 15907 rpcz_store.cc:276] 0709 12:24:44.871436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.189844 (+2318408us) service_pool.cc:224] Handling call
0709 12:24:47.190209 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.190429 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.190465 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.190518 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:47.190570 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.190647 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.190783 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.534631 15986 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:47.538697 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:24:47.210635 18423 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 3.413s	user 0.014s	sys 0.030s
I20260709 12:24:47.463944 15987 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:47.398747 18493 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:47.067852 18117 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:46.688236 18509 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.811129 18504 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:47.412810 18402 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.942814 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:46.906077 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:47.141731 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1009) took 2353 ms. Trace:
W20260709 12:24:47.253681 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 434879us
I20260709 12:24:46.774405 18261 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:47.027048 18518 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.195s	user 0.000s	sys 0.005s
W20260709 12:24:46.915968 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.536317 15830 rpcz_store.cc:276] 0709 12:24:43.460057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.530951 (+4070894us) service_pool.cc:224] Handling call
0709 12:24:47.531227 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.531385 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.531416 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.531458 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:47.531498 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.531553 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.531674 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.533542 15908 rpcz_store.cc:276] 0709 12:24:43.919519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.958304 (+ 38785us) service_pool.cc:224] Handling call
0709 12:24:45.115528 (+1157224us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:46.218834 (+1103306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.252711 (+ 33877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.063171 (+810460us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400153bd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:47.063318 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543424640}
I20260709 12:24:47.014046 18513 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.583s
I20260709 12:24:46.877950 18489 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:46.929788 18405 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:46.718309 18124 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:47.547303 18449 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:47.537189 15831 rpcz_store.cc:276] 0709 12:24:42.860313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.510913 (+1650600us) service_pool.cc:224] Handling call
0709 12:24:46.233527 (+1722614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.233780 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.233818 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.233875 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:46.233927 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.234019 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.063918 (+829899us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54001252d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:47.064031 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3954090240}
I20260709 12:24:47.554313 18368 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.540030 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 435) took 3272 ms. Trace:
I20260709 12:24:47.549433 15803 leader_election.cc:400] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:47.547603 18334 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.554967 18520 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:47.540036 18510 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.550702 18470 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:47.413123 18495 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:47.381124 18473 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:46.680049 18188 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:47.006039 17836 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.578s
I20260709 12:24:47.558879 15906 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:48.145761 15906 pending_rounds.cc:85] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 3
I20260709 12:24:48.146224 15906 pending_rounds.cc:107] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:47.559487 15986 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:48.146678 15906 raft_consensus.cc:2889] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:48.147362 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1027) took 1558 ms. Trace:
I20260709 12:24:48.146661 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1025) took 1558 ms. Trace:
I20260709 12:24:46.906356 18515 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.102828 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.151139 15803 leader_election.cc:403] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:46.822747 18490 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.150668 15829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2533) took 1505 ms (client timeout 1568 ms). Trace:
W20260709 12:24:47.228770 18337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.007s
W20260709 12:24:48.150977 15979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1568) took 3859 ms (client timeout 2998 ms). Trace:
W20260709 12:24:47.609894 18411 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 4.077s	user 0.016s	sys 0.029s
I20260709 12:24:48.147528 15983 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:48.154081 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2376) took 3255 ms. Trace:
I20260709 12:24:47.073158 18331 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:47.062207 18391 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:48.164335 15906 rpcz_store.cc:276] 0709 12:24:44.898743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.558258 (+2659515us) service_pool.cc:224] Handling call
0709 12:24:47.558547 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.153856 (+595309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.154033 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.559406 15834 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:48.165695 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2535) took 1510 ms. Trace:
I20260709 12:24:48.166217 15834 rpcz_store.cc:276] 0709 12:24:46.655088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.824111 (+169023us) service_pool.cc:224] Handling call
0709 12:24:48.165634 (+1341523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.555516 18441 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.155941 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:48.147985 15987 rpcz_store.cc:276] 0709 12:24:46.587973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.438054 (+850081us) service_pool.cc:224] Handling call
0709 12:24:47.463521 (+ 25467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.146249 (+682728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.146588 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.150146 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.173408 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.173542 15985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.012s	sys 0.017s
W20260709 12:24:48.173804 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.173874 15985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.012s	sys 0.017s
I20260709 12:24:47.558928 18517 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:48.161331 15829 rpcz_store.cc:269] 0709 12:24:46.645198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.817515 (+172317us) service_pool.cc:224] Handling call
0709 12:24:48.150608 (+1333093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.149276 15837 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:48.147817 15986 rpcz_store.cc:276] 0709 12:24:46.588850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.856493 (+267643us) service_pool.cc:224] Handling call
0709 12:24:48.147302 (+1290809us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.148605 15910 rpcz_store.cc:276] 0709 12:24:44.267359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.286863 (+ 19504us) service_pool.cc:224] Handling call
0709 12:24:44.287149 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.318610 (+ 31461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.318655 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.318711 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.318762 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.539821 (+3221059us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b540029a754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:47.539867 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.539976 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71839616}
I20260709 12:24:48.155689 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2507) took 3706 ms. Trace:
I20260709 12:24:48.177902 15831 rpcz_store.cc:276] 0709 12:24:44.449724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.153976 (+3704252us) service_pool.cc:224] Handling call
0709 12:24:48.155050 (+  1074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.155291 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.155329 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.155385 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.155437 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.155520 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.155638 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.152089 18449 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:48.163765 15979 rpcz_store.cc:269] 0709 12:24:44.291407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.291786 (+   379us) service_pool.cc:224] Handling call
0709 12:24:48.150847 (+3859061us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b540037d554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:48.150924 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171884928}
W20260709 12:24:48.137792 15913 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.010s
W20260709 12:24:48.182425 15913 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.006s	sys 0.011s
I20260709 12:24:48.154222 15830 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:46.995476 18500 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:48.168368 15906 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 8. Ops: []
I20260709 12:24:48.183158 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2511) took 3121 ms. Trace:
W20260709 12:24:48.168825 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 619545us
I20260709 12:24:48.183501 15830 rpcz_store.cc:276] 0709 12:24:45.062253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.153610 (+3091357us) service_pool.cc:224] Handling call
0709 12:24:48.153926 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.182924 (+ 28998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.183108 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.184952 15830 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:48.163534 15908 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:48.148243 15980 rpcz_store.cc:276] 0709 12:24:44.695917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.870368 (+174451us) service_pool.cc:224] Handling call
0709 12:24:44.906789 (+ 36421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.918651 (+ 11862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.918695 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.924576 (+  5881us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.799290 (+1874714us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18002a4b40. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1
0709 12:24:46.804455 (+  5165us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:46.905557 (+101102us) log.cc:844] Serialized 14 byte log entry
0709 12:24:47.014646 (+109089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.038656 (+ 24010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.038728 (+    72us) raft_consensus.cc:1685] finished
0709 12:24:47.048991 (+ 10263us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.049234 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125682,"raft.queue_time_us":52748,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":8499,"spinlock_wait_cycles":87147136,"thread_start_us":93319,"threads_started":2,"wal-append.queue_time_us":752400,"wal-append.run_cpu_time_us":1576,"wal-append.run_wall_time_us":1035170}
I20260709 12:24:47.043442 18420 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:46.898509 18442 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:47.952620 18525 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.153506 18243 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:48.177488 15837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2523) took 2908 ms (client timeout 2542 ms). Trace:
I20260709 12:24:47.547032 18174 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:48.163134 18337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.471s	user 0.015s	sys 0.018s
I20260709 12:24:47.708879 18342 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.159739 18513 consensus_queue.cc:1243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:48.163107 18124 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.187433 18441 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.185850 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2377) took 3280 ms. Trace:
I20260709 12:24:48.186506 15834 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:24:48.156147 18117 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:48.180400 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:48.188529 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2517) took 3028 ms. Trace:
I20260709 12:24:48.239275 15830 rpcz_store.cc:276] 0709 12:24:45.159715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.184424 (+3024709us) service_pool.cc:224] Handling call
0709 12:24:48.184673 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.185280 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.188479 (+  3199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.168087 18391 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:24:48.189175 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.199004 15829 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:47.442129 18498 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:48.197497 15837 rpcz_store.cc:269] 0709 12:24:45.269146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.804286 (+1535140us) service_pool.cc:224] Handling call
0709 12:24:48.177426 (+1373140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.153623 18368 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.153813 18334 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.202955 15980 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:48.153787 18509 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.163552 18402 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:24:47.547828 18373 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.166930 18490 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:48.210680 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2356) took 3572 ms (client timeout 2843 ms). Trace:
I20260709 12:24:48.211603 18442 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.211920 18399 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:47.584069 18486 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.160388 18473 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.183516 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2378) took 3268 ms. Trace:
I20260709 12:24:48.221617 18414 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
W20260709 12:24:48.226063 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 335538us
I20260709 12:24:48.187191 18517 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.230187 15908 rpcz_store.cc:276] 0709 12:24:44.905348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.162920 (+3257572us) service_pool.cc:224] Handling call
0709 12:24:48.163253 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.185611 (+ 22358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.185783 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.240934 15830 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:48.305521 18402 consensus_queue.cc:1243] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:48.323180 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2519) took 3153 ms. Trace:
I20260709 12:24:48.225302 18174 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.277238 18441 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.275198 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2516) took 3119 ms. Trace:
I20260709 12:24:48.280503 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.287246 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1583) took 1967 ms. Trace:
I20260709 12:24:48.205121 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:48.292798 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 142834us
I20260709 12:24:48.156420 18510 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.156677 18520 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:48.295260 15905 rpcz_store.cc:269] 0709 12:24:44.638503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.890142 (+251639us) service_pool.cc:224] Handling call
0709 12:24:48.210466 (+3320324us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400217354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:48.210608 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016915840}
I20260709 12:24:48.164001 18515 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.215660 18342 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.188349 18449 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:48.323835 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 167977us
I20260709 12:24:48.334098 18495 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.318158 15906 rpcz_store.cc:276] 0709 12:24:44.914971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.165324 (+3250353us) service_pool.cc:224] Handling call
0709 12:24:48.168139 (+  2815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.183214 (+ 15075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.183449 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.334585 16489 raft_consensus.cc:2410] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:48.323567 15830 rpcz_store.cc:276] 0709 12:24:45.169570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.240188 (+3070618us) service_pool.cc:224] Handling call
0709 12:24:48.240539 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.322897 (+ 82358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.323117 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.335062 15982 rpcz_store.cc:276] 0709 12:24:46.319854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.320886 (+  1032us) service_pool.cc:224] Handling call
0709 12:24:46.362502 (+ 41616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.503874 (+141372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.286964 (+1783090us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54000136d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:48.287174 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322319104}
I20260709 12:24:48.317734 18373 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.336930 15830 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:48.337112 15829 rpcz_store.cc:276] 0709 12:24:45.155921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.178974 (+3023053us) service_pool.cc:224] Handling call
0709 12:24:48.198723 (+ 19749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.274868 (+ 76145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.275128 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.337622 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2525) took 3007 ms. Trace:
I20260709 12:24:48.338189 15987 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:48.338554 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 430) took 1526 ms. Trace:
I20260709 12:24:48.338922 16489 rpcz_store.cc:276] 0709 12:24:46.811856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.819473 (+  7617us) service_pool.cc:224] Handling call
0709 12:24:48.204942 (+1385469us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:48.338492 (+133550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12876160}
I20260709 12:24:48.340283 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.342530 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:48.337967 15830 rpcz_store.cc:276] 0709 12:24:45.329816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.336136 (+3006320us) service_pool.cc:224] Handling call
0709 12:24:48.336693 (+   557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.337377 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.337570 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.344133 15831 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:48.344282 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.345350 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2382) took 3418 ms. Trace:
I20260709 12:24:48.345741 15906 rpcz_store.cc:276] 0709 12:24:44.926545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.341691 (+3415146us) service_pool.cc:224] Handling call
0709 12:24:48.344872 (+  3181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.345055 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.345082 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.345121 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:48.345157 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.345207 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.345298 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.347750 15905 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:48.348327 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2388) took 3381 ms. Trace:
I20260709 12:24:48.348439 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 693) took 1530 ms. Trace:
I20260709 12:24:48.348662 15905 rpcz_store.cc:276] 0709 12:24:44.966985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.335084 (+3368099us) service_pool.cc:224] Handling call
0709 12:24:48.347434 (+ 12350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.348131 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.348280 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.349036 16489 rpcz_store.cc:276] 0709 12:24:46.818485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.339990 (+1521505us) service_pool.cc:224] Handling call
0709 12:24:48.348370 (+  8380us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.351344 15879 connection.cc:256] RPC call timeout handler was delayed by -2.1059797980001349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2998s for a response
I20260709 12:24:48.351985 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.353493 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:48.354135 16489 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.356997 15906 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.324705 15837 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:48.356518 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2526) took 3026 ms. Trace:
I20260709 12:24:48.359934 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.360205 15829 rpcz_store.cc:276] 0709 12:24:45.330181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.337912 (+3007731us) service_pool.cc:224] Handling call
0709 12:24:48.356061 (+ 18149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.356223 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.356248 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.356288 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:48.356323 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.356375 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.356468 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.214551 18525 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.364537 18442 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:48.366501 18442 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:48.366532 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.367515 15982 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:48.368482 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.369922 18368 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.370289 18515 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.370515 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.370926 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2372) took 3497 ms. Trace:
I20260709 12:24:48.372233 18342 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:48.371275 15913 rpcz_store.cc:276] 0709 12:24:44.873667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.539622 (+2665955us) service_pool.cc:224] Handling call
0709 12:24:47.539980 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.555874 (+ 15894us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.182758 (+626884us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.285214 (+102456us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.285373 (+   159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.285824 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.285960 (+   136us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.285998 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.286065 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.370709 (+ 84644us) raft_consensus.cc:1685] finished
0709 12:24:48.370728 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.370852 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15483,"prepare.queue_time_us":648289,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":72,"raft.queue_time_us":18723,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":6340,"spinlock_wait_cycles":24540544,"thread_start_us":689798,"threads_started":2,"wal-append.queue_time_us":103590}
I20260709 12:24:48.374233 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 442) took 2128 ms. Trace:
I20260709 12:24:48.374364 15982 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:48.374616 15905 rpcz_store.cc:276] 0709 12:24:46.246063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.351310 (+2105247us) service_pool.cc:224] Handling call
0709 12:24:48.373789 (+ 22479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.373956 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.373979 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.374015 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.374043 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.374090 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.374182 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.375765 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.347819 18174 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.394443 16488 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.395084 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 678) took 3274 ms. Trace:
I20260709 12:24:48.395378 16488 rpcz_store.cc:276] 0709 12:24:45.120483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.120594 (+   111us) service_pool.cc:224] Handling call
0709 12:24:48.394178 (+3273584us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917ef8c 00007f03c917eef6 000000000036eb39 00007f03d11f21e0 00007f03d12bb0c4 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:48.394283 (+   105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.394855 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.395036 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3253376}
W20260709 12:24:48.380538 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.378628 15829 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:48.347309 18539 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:48.384302 18238 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.385985 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 444) took 2139 ms. Trace:
I20260709 12:24:48.401739 15905 rpcz_store.cc:276] 0709 12:24:46.246521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.385311 (+2138790us) service_pool.cc:224] Handling call
0709 12:24:48.385571 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.385703 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.385725 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.385766 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.385795 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.385839 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.385939 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.367049 18442 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.386291 18486 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:48.387334 18530 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:24:48.387504 18431 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 3.802s	user 0.006s	sys 0.041s
I20260709 12:24:48.388787 18473 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:48.408672 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 56777.2us
I20260709 12:24:48.390522 18517 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.390550 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:48.392176 18441 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.392241 18525 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:48.398568 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2530) took 2413 ms. Trace:
I20260709 12:24:48.424350 15829 rpcz_store.cc:276] 0709 12:24:45.985536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.361299 (+2375763us) service_pool.cc:224] Handling call
0709 12:24:48.378305 (+ 17006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.398265 (+ 19960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.398502 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.399775 18520 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.409524 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:48.410437 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2518) took 3243 ms. Trace:
I20260709 12:24:48.347555 18402 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:24:48.418920 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 691) took 1641 ms. Trace:
I20260709 12:24:48.389863 18445 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.427073 15833 rpcz_store.cc:276] 0709 12:24:45.167297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.202769 (+3035472us) service_pool.cc:224] Handling call
0709 12:24:48.203011 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.203204 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:48.284528 (+ 81324us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.410134 (+125606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.410179 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:48.410221 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.410276 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.410387 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6029,"prepare.queue_time_us":91110,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":25599,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":11900,"thread_start_us":200170,"threads_started":3,"wal-append.queue_time_us":97210}
I20260709 12:24:48.432621 15833 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.433220 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2532) took 1788 ms. Trace:
I20260709 12:24:48.434093 15833 rpcz_store.cc:276] 0709 12:24:46.644903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.432205 (+1787302us) service_pool.cc:224] Handling call
0709 12:24:48.432461 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.432989 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.433170 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.434679 15829 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:48.435079 16495 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:48.435302 15833 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:48.435627 16495 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 427) took 1917 ms (client timeout 1962 ms). Trace:
I20260709 12:24:48.429873 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:48.420986 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 275041us
I20260709 12:24:48.399667 18449 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.427749 16487 rpcz_store.cc:276] 0709 12:24:46.777912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.805407 (+ 27495us) service_pool.cc:224] Handling call
0709 12:24:48.418283 (+1612876us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:48.418466 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.418628 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.418653 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.418695 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.418725 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.418779 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.418868 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233962368}
I20260709 12:24:48.437469 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:48.435434 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2531) took 2449 ms. Trace:
I20260709 12:24:48.430155 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:48.436478 16495 rpcz_store.cc:269] 0709 12:24:46.518682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.007380 (+488698us) service_pool.cc:224] Handling call
0709 12:24:48.390416 (+1383036us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:48.435574 (+ 45158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217340800}
I20260709 12:24:48.441582 15829 rpcz_store.cc:276] 0709 12:24:45.985841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.425274 (+2439433us) service_pool.cc:224] Handling call
0709 12:24:48.434274 (+  9000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.435154 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.435371 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.443086 18509 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.439638 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2534) took 1794 ms. Trace:
I20260709 12:24:48.440328 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 692) took 1635 ms. Trace:
I20260709 12:24:48.443660 15833 rpcz_store.cc:276] 0709 12:24:46.645454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.434838 (+1789384us) service_pool.cc:224] Handling call
0709 12:24:48.435153 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.436016 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.439345 (+  3329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.444172 16488 rpcz_store.cc:276] 0709 12:24:46.805260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.426575 (+1621315us) service_pool.cc:224] Handling call
0709 12:24:48.439869 (+ 13294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.440033 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.440058 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.440098 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.440134 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.440181 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.440267 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.422194 18515 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:48.426481 18500 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:48.446074 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.409410 18539 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.428799 18445 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:48.471084 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:48.473202 15952 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.527s (SENT)
I20260709 12:24:48.470919 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:48.473551 16457 connection.cc:256] RPC call timeout handler was delayed by -3.2748182620002808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 12:24:48.343696 18117 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.464975 16487 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:48.478511 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 694) took 1505 ms. Trace:
W20260709 12:24:48.479027 15952 leader_election.cc:336] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.589s (SENT)
I20260709 12:24:48.478829 16487 rpcz_store.cc:276] 0709 12:24:46.973440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.440953 (+1467513us) service_pool.cc:224] Handling call
0709 12:24:48.464554 (+ 23601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.478289 (+ 13735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.478458 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:48.473992 16457 connection.cc:256] RPC call timeout handler was delayed by -1.4951033249999455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.37460000000000004s for a response
I20260709 12:24:48.473486 15982 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:48.474099 15905 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:48.428485 18549 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:48.456195 18334 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.489377 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.486070 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.490954 16488 raft_consensus.cc:2368] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:48.491617 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.495391 15980 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
W20260709 12:24:48.495826 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 140281us
I20260709 12:24:48.448149 18520 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:48.501307 18520 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.503623 18520 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.482261 18546 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.500156 15979 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:48.508029 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:48.508673 15905 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:48.457472 18515 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.477963 18445 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.504810 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:48.447585 18405 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.508994 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.487522 18551 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.487589 18489 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.510157 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.511066 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.518352 16487 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:48.523027 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1015) took 2031 ms. Trace:
I20260709 12:24:48.504741 18517 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.524331 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:48.526000 15979 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:24:48.523406 15985 rpcz_store.cc:276] 0709 12:24:46.491998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.856377 (+364379us) service_pool.cc:224] Handling call
0709 12:24:47.419314 (+562937us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:47.528537 (+109223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.528575 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:47.548318 (+ 19743us) log.cc:844] Serialized 52 byte log entry
0709 12:24:48.174279 (+625961us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.290716 (+116437us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.294030 (+  3314us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.307293 (+ 13263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.307455 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.522836 (+215381us) raft_consensus.cc:1685] finished
0709 12:24:48.522853 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.522976 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121251,"prepare.queue_time_us":35361,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2223,"raft.queue_time_us":129021,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9312,"spinlock_wait_cycles":7366272,"thread_start_us":698550,"threads_started":2,"wal-append.queue_time_us":740185}
I20260709 12:24:48.505141 18498 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.518402 18117 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.533013 18424 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:48.533497 18424 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.538877 18490 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:48.541246 15835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2520) took 3365 ms (client timeout 1527 ms). Trace:
I20260709 12:24:48.541447 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:48.541643 15835 rpcz_store.cc:269] 0709 12:24:45.176241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.996926 (+820685us) service_pool.cc:224] Handling call
0709 12:24:48.541085 (+2544159us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b540033d1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:48.541180 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38687616}
I20260709 12:24:48.542546 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.542740 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:48.543378 15835 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:48.543608 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.544272 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.544576 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.510367 18546 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.553815 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:48.557585 15988 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1023) took 1989 ms (client timeout 1819 ms). Trace:
I20260709 12:24:48.558310 16457 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:48.557955 15988 rpcz_store.cc:269] 0709 12:24:46.568370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.590026 (+ 21656us) service_pool.cc:224] Handling call
0709 12:24:48.557432 (+1967406us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5400013bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:48.557519 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4232064}
I20260709 12:24:48.562273 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.563055 16488 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:48.565244 18552 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:48.565852 18552 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:48.567056 18492 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.524682 18551 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:48.572403 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.577493 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:48.589416 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.589515 15833 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:48.576941 16495 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:48.594154 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.594671 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:48.594792 16489 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:48.596230 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.594718 16487 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:48.596473 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 431) took 1056 ms. Trace:
I20260709 12:24:48.594669 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.597308 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.566790 18552 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.489722 18549 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.599435 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.599895 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:48.600368 16488 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:48.597324 16489 rpcz_store.cc:276] 0709 12:24:47.539784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.353231 (+813447us) service_pool.cc:224] Handling call
0709 12:24:48.596399 (+243168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:48.527978 18517 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:48.602670 16492 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:48.602864 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:46.032416 15832 rpcz_store.cc:276] 0709 12:24:43.427754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.973748 (+1545994us) service_pool.cc:224] Handling call
0709 12:24:44.976744 (+  2996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.980418 (+  3674us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:45.262322 (+281904us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.031520 (+769198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.031605 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:46.031674 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.031770 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.031916 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33131,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":100,"thread_start_us":1031241,"threads_started":2}
W20260709 12:24:48.605595 15802 leader_election.cc:336] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.575s (SENT)
I20260709 12:24:48.606227 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:48.606832 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.569991 18458 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.602396 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.570521 18449 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.616288 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:48.637208 15802 leader_election.cc:336] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.745s (SENT)
I20260709 12:24:48.637665 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:48.601719 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.545944 18500 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.619735 18173 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:48.646957 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2381) took 3722 ms. Trace:
W20260709 12:24:48.617265 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.622102 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:48.650880 15905 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:48.615352 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.609925 18415 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.623663 18325 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:24:48.610061 18498 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:48.632704 18334 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:48.644490 18546 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.620456 18458 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:48.644500 15952 leader_election.cc:336] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.975s (SENT)
I20260709 12:24:48.647362 15908 rpcz_store.cc:276] 0709 12:24:44.924789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.322752 (+3397963us) service_pool.cc:224] Handling call
0709 12:24:48.337394 (+ 14642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.341958 (+  4564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.341991 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.364351 (+ 22360us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.504755 (+140404us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.522964 (+ 18209us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.523223 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.523289 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.646754 (+123465us) raft_consensus.cc:1685] finished
0709 12:24:48.646775 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.646901 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4202,"prepare.queue_time_us":15417,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1237,"raft.queue_time_us":18085,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17508,"spinlock_wait_cycles":8886144,"thread_start_us":96410,"threads_started":1,"wal-append.queue_time_us":217563}
I20260709 12:24:48.643083 18490 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:48.673857 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.639958 18470 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:48.697872 15877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 449) took 2028 ms. Trace:
I20260709 12:24:48.695416 15952 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:48.697217 15876 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items
I20260709 12:24:48.642477 18520 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:48.666324 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.702766 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 134902us
W20260709 12:24:48.705119 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60647.8us
W20260709 12:24:48.709638 18555 log.cc:927] Time spent T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:24:48.694854 18498 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:48.710260 18551 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.710999 18549 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.712112 18515 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.704156 15877 rpcz_store.cc:276] 0709 12:24:46.669828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.697820 (+2027992us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:24:48.713538 15986 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:48.729157 15986 pending_rounds.cc:85] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 3
I20260709 12:24:48.729314 18539 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.622998 18492 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:24:48.730226 16457 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:48.730965 18557 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.721624 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:48.724393 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.732963 15988 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:48.733287 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.735885 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.739010 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.702903 18470 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:48.716871 18174 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.659097 18442 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.746167 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.746492 15913 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.729399 15986 pending_rounds.cc:107] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:48.746959 15986 raft_consensus.cc:2889] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:48.747654 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.748140 18442 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.748770 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2371) took 3899 ms. Trace:
I20260709 12:24:48.739888 16489 raft_consensus.cc:2368] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:48.704320 15876 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1122)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
I20260709 12:24:48.749017 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1028) took 2157 ms. Trace:
I20260709 12:24:48.787901 15986 rpcz_store.cc:276] 0709 12:24:46.591286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.180206 (+1588920us) service_pool.cc:224] Handling call
0709 12:24:48.180494 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.747394 (+566900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.748745 (+  1351us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400229054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:48.748944 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225085440}
W20260709 12:24:48.758824 15802 leader_election.cc:336] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.930s (SENT)
W20260709 12:24:48.742545 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.724700 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:48.743546 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.740689 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:48.726518 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.636673 18238 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:24:48.758396 18470 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:48.765841 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.892292 15986 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.857568 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.862881 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.866936 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.848963 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 440) took 2603 ms. Trace:
I20260709 12:24:48.894548 15906 rpcz_store.cc:276] 0709 12:24:46.245599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.346641 (+2101042us) service_pool.cc:224] Handling call
0709 12:24:48.347878 (+  1237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.357494 (+  9616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.848749 (+491255us) spinlock_profiling.cc:243] Waited 8.95 ms on lock 0x7b54001964d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:48.848907 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20577664}
I20260709 12:24:48.848263 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1561) took 3723 ms. Trace:
I20260709 12:24:48.896361 15834 rpcz_store.cc:276] 0709 12:24:45.127962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.167154 (+3039192us) service_pool.cc:224] Handling call
0709 12:24:48.186257 (+ 19103us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:48.230273 (+ 44016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.848072 (+617799us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b540027f1d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:48.848205 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42911616}
I20260709 12:24:48.893925 15979 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:48.762018 15988 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
W20260709 12:24:48.891476 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 150916us
I20260709 12:24:48.777060 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2367) took 4133 ms. Trace:
I20260709 12:24:48.898921 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:48.899147 15909 rpcz_store.cc:276] 0709 12:24:44.643244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.855620 (+2212376us) service_pool.cc:224] Handling call
0709 12:24:46.855976 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.537857 (+681881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.776740 (+1238883us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54001c3c54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:48.776968 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171500800}
I20260709 12:24:48.899982 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:48.861475 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.893407 15987 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:48.852069 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2524) took 3522 ms. Trace:
I20260709 12:24:48.761114 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1581) took 3708 ms. Trace:
I20260709 12:24:48.902004 15983 rpcz_store.cc:276] 0709 12:24:45.052697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.052826 (+   129us) service_pool.cc:224] Handling call
0709 12:24:45.053246 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.168876 (+3115630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.760803 (+591927us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b540011a3d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:48.761025 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5801263360}
I20260709 12:24:48.901374 15837 rpcz_store.cc:276] 0709 12:24:45.329374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.279566 (+2950192us) service_pool.cc:224] Handling call
0709 12:24:48.295134 (+ 15568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.324532 (+ 29398us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:48.535905 (+211373us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.641011 (+105106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.641580 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.641747 (+   167us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.641779 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.641850 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.851893 (+210043us) raft_consensus.cc:1685] finished
0709 12:24:48.851912 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.852017 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17765,"raft.queue_time_us":36080,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":11992,"thread_start_us":104728,"threads_started":1,"wal-append.queue_time_us":245822}
I20260709 12:24:48.782095 15905 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
W20260709 12:24:48.903061 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 144282us
W20260709 12:24:48.907398 15802 leader_election.cc:336] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.973s (SENT)
I20260709 12:24:48.906076 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.877137 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:48.909134 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:48.909534 15980 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:48.906548 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.749172 15904 rpcz_store.cc:276] 0709 12:24:44.849717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.857022 (+2007305us) service_pool.cc:224] Handling call
0709 12:24:46.857386 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.857779 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.857814 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.905154 (+ 47340us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.814917 (+909763us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.151596 (+336679us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.283031 (+131435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.284310 (+  1279us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.744056 (+459746us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b2400299798. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c903c9c4 00007f03c903aacb 00007f03c91f5dc9 00007f03c91f5a55 00007f03c91f4fb0 00007f03cbe6b488 00007f03cbe6bbe8 00007f03cbe43398 00007f03cbe3e76a 00007f03cbe3dbb6
0709 12:24:48.748509 (+  4453us) raft_consensus.cc:1685] finished
0709 12:24:48.748595 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.748715 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1762,"prepare.queue_time_us":393753,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":154116,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":4948,"spinlock_wait_cycles":26024832,"thread_start_us":835213,"threads_started":3,"wal-append.queue_time_us":1271329}
I20260709 12:24:48.759287 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.867578 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:48.757404 18424 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.911509 18539 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.916050 18402 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:48.911679 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:48.910801 16460 connection.cc:256] RPC call timeout handler was delayed by -2.9048716639999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2514s for a response
W20260709 12:24:48.941650 16460 connection.cc:256] RPC call timeout handler was delayed by -1.8713181920002171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:24:48.942116 16460 connection.cc:256] RPC call timeout handler was delayed by -1.6085181920002469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2396s for a response
W20260709 12:24:48.942281 15952 leader_election.cc:336] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.214s (SENT)
W20260709 12:24:48.942942 15952 leader_election.cc:336] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.229s (SENT)
I20260709 12:24:48.943836 18424 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.943908 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:48.944773 15835 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:48.769232 18435 log.cc:927] Time spent T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 4.250s	user 0.017s	sys 0.039s
I20260709 12:24:48.913389 18470 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:48.916515 15950 connection.cc:256] RPC call timeout handler was delayed by -2.2464807290002682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
I20260709 12:24:48.920565 15879 leader_election.cc:400] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:48.924786 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.925444 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.950477 15879 leader_election.cc:403] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:48.951169 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.764518 18445 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.932360 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.924321 18442 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:24:48.937769 16489 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:48.752944 18490 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.850330 18557 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.956525 16488 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:48.768335 18417 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:48.764796 18308 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.946342 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:48.954353 18429 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:24:48.958019 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:48.951769 15833 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:48.934978 18542 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:48.959071 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.960094 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.960676 15833 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:48.961566 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:48.920598 18515 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.952375 15837 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:24:48.965113 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:48.965837 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:48.966207 15836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2536) took 2310 ms (client timeout 2200 ms). Trace:
I20260709 12:24:48.966879 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:48.966562 15836 rpcz_store.cc:269] 0709 12:24:46.655460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.856429 (+200969us) service_pool.cc:224] Handling call
0709 12:24:48.966056 (+2109627us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001365d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:48.966147 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67444608}
I20260709 12:24:48.967609 15837 raft_consensus.cc:2410] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:48.952694 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.956928 15985 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:48.958096 18308 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:48.951865 15950 connection.cc:256] RPC call timeout handler was delayed by -2.09280154399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 12:24:48.972040 15950 connection.cc:256] RPC call timeout handler was delayed by -2.0813100860000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 12:24:48.972366 15950 connection.cc:256] RPC call timeout handler was delayed by -2.0673807290004333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
I20260709 12:24:48.972604 15837 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:48.972684 15950 connection.cc:256] RPC call timeout handler was delayed by -1.989510085999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:24:48.973233 15950 connection.cc:256] RPC call timeout handler was delayed by -1.5251100860000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
W20260709 12:24:48.973560 15950 connection.cc:256] RPC call timeout handler was delayed by -1.2677282110003034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:24:48.973851 15950 connection.cc:256] RPC call timeout handler was delayed by -1.1462100859998827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2963s for a response
I20260709 12:24:48.983588 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:48.963186 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:48.945740 18402 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:48.970590 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1536) took 6138 ms. Trace:
I20260709 12:24:48.965859 18500 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.989581 15838 rpcz_store.cc:276] 0709 12:24:42.836955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.424880 (+1587925us) service_pool.cc:224] Handling call
0709 12:24:44.454254 (+ 29374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.537340 (+3083086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.966525 (+1429185us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b540024efd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:48.966688 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7088605952}
I20260709 12:24:48.993939 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:48.954584 18409 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.995410 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:48.996239 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.996701 18539 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.996948 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.996732 18325 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:48.997591 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:48.996663 18417 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:48.998179 18174 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:48.777580 18498 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:48.959095 18542 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.005493 15985 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.994490 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:49.003840 18344 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:49.006842 18174 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.008389 18351 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:49.010505 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:48.993264 18402 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.012830 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.028281 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:48.971845 18308 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:24:49.014303 15911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2361) took 4374 ms (client timeout 2229 ms). Trace:
I20260709 12:24:49.014895 15910 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:48.993139 18117 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:49.005013 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:49.034351 15911 rpcz_store.cc:269] 0709 12:24:44.639924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.867818 (+227894us) service_pool.cc:224] Handling call
0709 12:24:49.014011 (+4146193us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400420ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:49.014194 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676343552}
I20260709 12:24:49.019124 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:49.021066 18324 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:49.022302 15988 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:49.004369 18412 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:24:49.023288 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.023682 18243 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.023963 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:49.029183 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:49.047217 15906 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:24:48.999941 18228 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:49.033370 15980 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:48.999140 18238 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:24:49.034411 15910 pending_rounds.cc:85] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 4
I20260709 12:24:49.055765 15910 pending_rounds.cc:107] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:49.056104 15910 raft_consensus.cc:2889] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:49.056354 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.019735 18542 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.033365 18539 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:49.061501 18539 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.061874 18238 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:49.062400 18238 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:49.063541 18539 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.063374 18238 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.023057 15984 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:49.066978 16486 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:24:49.067323 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.026117 18417 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:49.057806 18243 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.042084 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.030012 18174 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.084544 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.086469 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.086685 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.087492 15984 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:49.088698 15987 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:49.052639 18445 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:48.728794 15877 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1099)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1121)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1122)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
I20260709 12:24:49.089970 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.060182 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.090817 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.051623 18324 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.097357 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:49.064780 18238 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.055334 18117 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:49.135737 18117 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.093825 15906 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:49.137759 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.139061 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.133304 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.139777 15906 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:49.140391 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:49.133327 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.143980 15904 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:49.133972 15979 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:49.087005 18391 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:49.110476 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:49.110469 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.111953 18324 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:49.142186 18517 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:49.187747 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.191228 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:49.175496 15876 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:37350 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1134)
I20260709 12:24:49.197701 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:49.140918 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.204419 15906 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
W20260709 12:24:49.105670 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.205405 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.205819 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.142398 18409 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5.
I20260709 12:24:49.090826 15877 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1097)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455)
I20260709 12:24:49.160444 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.160768 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:49.208021 15911 raft_consensus.cc:2410] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:49.161599 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:49.208684 15980 raft_consensus.cc:2376] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7. Re-sending same reply.
I20260709 12:24:49.207947 15988 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:49.163122 18351 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:49.165719 18324 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:49.169902 15833 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:24:49.175063 15982 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:49.180162 18458 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:49.180903 18560 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:24:49.182016 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 443) took 2935 ms. Trace:
I20260709 12:24:49.181699 18308 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.183064 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.227619 15904 raft_consensus.cc:2368] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:49.183678 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1562) took 4055 ms. Trace:
I20260709 12:24:49.231326 15831 rpcz_store.cc:276] 0709 12:24:45.128291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.178832 (+3050541us) service_pool.cc:224] Handling call
0709 12:24:48.179119 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.347560 (+168441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.183398 (+835838us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400136fd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:49.183603 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378935680}
W20260709 12:24:49.206393 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 60087.9us
I20260709 12:24:49.233773 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:49.208097 18517 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.213752 18391 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.211427 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:49.212749 15985 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:49.210605 15877 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1137)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2418)
I20260709 12:24:49.168347 18174 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.216926 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.242105 15911 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:49.219012 15833 pending_rounds.cc:85] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 7
I20260709 12:24:49.243181 15833 pending_rounds.cc:107] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:49.243526 15833 raft_consensus.cc:2889] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.222044 15913 rpcz_store.cc:276] 0709 12:24:46.246299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.373417 (+2127118us) service_pool.cc:224] Handling call
0709 12:24:48.373696 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.746860 (+373164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.181734 (+434874us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400074254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:49.181948 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856986880}
I20260709 12:24:49.209906 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.242244 15877 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 456)
I20260709 12:24:49.246260 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.209661 18442 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.252277 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:49.227509 18409 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.265810 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:49.263139 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.268545 18539 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:49.269380 18499 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:49.269727 18499 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:49.264556 18520 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:24:49.264601 18413 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:49.217912 18455 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:24:49.265358 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 67723.8us
I20260709 12:24:49.241102 18036 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.276814 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:49.240314 18517 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.221599 18461 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:24:49.221735 18450 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:24:49.240101 18324 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:49.255750 15876 leader_election.cc:336] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.902s (SENT)
I20260709 12:24:49.256510 15829 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:49.265774 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:49.285718 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:49.291965 15904 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:49.278414 15877 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2421)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2423)
W20260709 12:24:49.309397 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 43675.4us
I20260709 12:24:49.310173 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:49.267078 18409 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:49.316900 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.320169 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:49.321262 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:49.322235 18499 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:49.323653 18499 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.282401 18517 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.235383 18243 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.266027 18482 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:24:49.336108 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:49.336504 18562 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.313235 18297 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:49.319779 18409 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.344471 18520 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:49.347813 15983 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:49.328052 18413 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:49.264765 18442 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:24:49.326973 18450 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.336045 18461 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:49.357252 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.376475 16490 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:49.358060 18370 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:49.377856 15834 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:49.345230 18562 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.362732 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:49.320874 18498 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:49.339227 18373 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:49.373574 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.315828 18557 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:49.379879 15835 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:49.380779 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:49.405956 18566 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:24:49.412446 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.414578 18515 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:49.414697 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.415026 18515 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:49.415324 15835 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:49.416146 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.415820 18515 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:49.382670 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 126999us
I20260709 12:24:49.394039 15987 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.396561 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.398797 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.402853 15829 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:49.428946 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.420809 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.433939 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:49.460884 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.420893 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:49.470484 16494 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:24:49.430692 15912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2389) took 4459 ms (client timeout 1527 ms). Trace:
W20260709 12:24:49.471920 15912 rpcz_store.cc:269] 0709 12:24:44.971459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.971559 (+   100us) service_pool.cc:224] Handling call
0709 12:24:49.430492 (+4458933us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540010bb54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:49.430622 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025255296}
I20260709 12:24:49.420634 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.368513 18413 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:49.473573 16494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 426) took 2955 ms (client timeout 1804 ms). Trace:
I20260709 12:24:49.443387 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:49.474135 15835 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:49.474072 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.481653 16496 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.377893 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 690) took 2623 ms. Trace:
I20260709 12:24:49.444413 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:49.468683 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:49.439182 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2379) took 4519 ms. Trace:
I20260709 12:24:49.469770 15837 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:49.394604 18351 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.480412 16494 rpcz_store.cc:269] 0709 12:24:46.518325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.163245 (+644920us) service_pool.cc:224] Handling call
0709 12:24:49.420768 (+2257523us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:49.473507 (+ 52739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41861888}
W20260709 12:24:49.481966 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 217848us
W20260709 12:24:49.490618 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.503496 15910 rpcz_store.cc:276] 0709 12:24:44.919455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.178002 (+3258547us) service_pool.cc:224] Handling call
0709 12:24:49.014673 (+836671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.056556 (+ 41883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.432994 (+376438us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b5400420ed0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:49.439120 (+  6126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870087424}
I20260709 12:24:49.505926 15980 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:24:49.514223 15952 leader_election.cc:336] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.843s (SENT)
I20260709 12:24:49.432698 18243 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.398000 18562 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.482065 15912 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:49.427850 18174 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.422474 18297 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:49.416993 18515 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:49.552248 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.494753 18413 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.435479 18498 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:49.495327 18442 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:49.619529 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 344035us
I20260709 12:24:49.679234 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:49.515358 18351 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.482023 18542 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.632308 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:49.380355 18568 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.154s
W20260709 12:24:49.666903 18402 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.003s
W20260709 12:24:49.657622 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 186615us
W20260709 12:24:49.687399 15876 connection.cc:256] RPC call timeout handler was delayed by -4.585475272000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:24:49.687922 15876 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.591s (SENT)
I20260709 12:24:49.689222 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:49.696453 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.674774 18297 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.712142 18571 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:49.720814 18445 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:49.721370 18445 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:49.722142 18445 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.725106 18402 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.727525 18402 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.728817 18498 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:49.735575 18568 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.735968 18568 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:49.736694 18568 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:49.738010 18568 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:49.738818 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 421437us
I20260709 12:24:49.739617 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:49.740163 16492 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:49.741125 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:49.742353 15910 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:49.745913 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404) took 1093 ms. Trace:
I20260709 12:24:49.771552 15910 rpcz_store.cc:276] 0709 12:24:48.652757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.510730 (+857973us) service_pool.cc:224] Handling call
0709 12:24:49.745843 (+235113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.777091 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.660542 16496 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:49.663149 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.830536 15910 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:49.494680 16490 rpcz_store.cc:276] 0709 12:24:46.754644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.777494 (+ 22850us) service_pool.cc:224] Handling call
0709 12:24:49.358850 (+2581356us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917eeee 000000000036eb39 00007f03d11f21e0 00007f03d12bb0c4 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:24:49.375854 (+ 17004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.377311 (+  1457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.377760 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207572864}
W20260709 12:24:49.656287 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 145175us
I20260709 12:24:49.659081 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:49.833595 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.686525 18442 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.836040 15984 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:49.657701 15952 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.465s (SENT)
I20260709 12:24:49.812893 18542 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.813956 18351 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.815074 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:49.855979 16495 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:49.816044 18517 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:49.818025 18570 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:49.837383 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:49.838646 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.019s	sys 0.024s
W20260709 12:24:49.915570 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.019s	sys 0.024s
I20260709 12:24:49.915899 15987 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:24:49.916697 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.917671 15985 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:49.917919 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.918736 15910 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
W20260709 12:24:49.921897 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 264212us
I20260709 12:24:49.925311 18351 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.926827 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.927574 15910 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:49.928820 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:49.929572 15910 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:49.930112 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408) took 1276 ms. Trace:
I20260709 12:24:49.930531 15910 rpcz_store.cc:276] 0709 12:24:48.653393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.928353 (+1274960us) service_pool.cc:224] Handling call
0709 12:24:49.930027 (+  1674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:49.944977 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:49.945869 15910 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
W20260709 12:24:49.931033 18228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.021s	sys 0.049s
I20260709 12:24:49.938896 18517 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:49.943164 18413 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:49.949533 18413 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:49.950214 18228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.021s	sys 0.049s
I20260709 12:24:49.855314 18479 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:24:49.953953 18479 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.954383 18479 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:49.955359 18479 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:49.958516 18036 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 12:24:49.959012 18036 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:49.921756 18542 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.961436 18542 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.961864 18542 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.965659 16486 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:49.971117 18391 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.001s
I20260709 12:24:49.972070 15907 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:49.972486 15907 pending_rounds.cc:85] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 3
I20260709 12:24:49.972741 15907 pending_rounds.cc:107] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:49.973011 15907 raft_consensus.cc:2889] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.946779 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:49.977293 15910 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.847791 18476 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.989675 18579 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:49.989874 18583 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.993393 18579 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:49.994597 18579 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:49.995055 18476 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:49.985183 18577 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:24:50.008227 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.012877 18445 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.013520 18445 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.044373 18297 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.047751 18297 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:49.956772 18479 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:50.062791 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 320270us
I20260709 12:24:50.111038 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.112057 18583 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.113685 18583 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:50.114645 18391 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.115113 18391 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:50.116510 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.117481 15981 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:24:50.064388 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 385999us
W20260709 12:24:50.089574 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.106554 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.119558 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.121112 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.122051 15985 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:50.116058 18391 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:50.123293 18391 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.133271 15910 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:50.353657 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 457) took 1078 ms. Trace:
I20260709 12:24:50.354331 15910 rpcz_store.cc:276] 0709 12:24:49.275360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.946504 (+671144us) service_pool.cc:224] Handling call
0709 12:24:50.353274 (+406770us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.340801 15787 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.001s	sys 0.005s
I20260709 12:24:50.153007 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:50.356185 15787 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.001s	sys 0.006s
I20260709 12:24:50.205216 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.153752 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.357883 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 534) took 1421 ms. Trace:
I20260709 12:24:50.358453 15833 rpcz_store.cc:276] 0709 12:24:48.935961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.992094 (+ 56133us) service_pool.cc:224] Handling call
0709 12:24:48.992448 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.244027 (+251579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.357177 (+1113150us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540003b1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:50.357611 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407127936}
W20260709 12:24:50.181591 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.116987 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.167342 15987 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:24:50.181977 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 172389us
I20260709 12:24:50.348059 15834 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:50.342830 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.342788 15876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.004s
W20260709 12:24:50.343093 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.181895 18409 consensus_meta.cc:287] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.005s
W20260709 12:24:50.370635 16488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 544) took 1624 ms (client timeout 1999 ms). Trace:
I20260709 12:24:50.212720 18476 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.370443 18409 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.209156 18515 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
W20260709 12:24:50.371191 16488 rpcz_store.cc:269] 0709 12:24:48.745799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.745930 (+   131us) service_pool.cc:224] Handling call
0709 12:24:50.370119 (+1624189us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540071cad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:50.370386 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482401664}
I20260709 12:24:50.372244 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.213507 18445 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:50.372824 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.149348 18449 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:50.374899 18449 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.375820 15876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.004s	sys 0.004s
I20260709 12:24:50.208423 18542 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.378060 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 690093us
I20260709 12:24:50.378635 15985 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
W20260709 12:24:50.379674 15876 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 3.003s (SENT)
I20260709 12:24:50.380216 18542 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.380767 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:50.168184 18562 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 12:24:50.370072 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.373556 15912 raft_consensus.cc:2410] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:50.381801 18445 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:50.382385 18222 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.382314 15984 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:50.382265 18562 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:50.383651 18445 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:50.362924 18479 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:50.384196 15909 raft_consensus.cc:2368] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8.
W20260709 12:24:50.361713 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2401) took 1709 ms (client timeout 1589 ms). Trace:
W20260709 12:24:50.384456 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.386091 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.386364 18479 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.386971 15981 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.393708 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:50.394698 15910 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:24:50.394924 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.395100 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108) took 1953 ms. Trace:
I20260709 12:24:50.395499 15910 rpcz_store.cc:276] 0709 12:24:48.441375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.393078 (+1951703us) service_pool.cc:224] Handling call
0709 12:24:50.395031 (+  1953us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.395764 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403) took 1743 ms (client timeout 2214 ms). Trace:
W20260709 12:24:50.396229 15904 rpcz_store.cc:269] 0709 12:24:48.652616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.394424 (+1741808us) service_pool.cc:224] Handling call
0709 12:24:50.395695 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.396713 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:50.397472 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.399804 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2375) took 5505 ms. Trace:
I20260709 12:24:50.400282 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:50.384804 15905 rpcz_store.cc:269] 0709 12:24:48.652273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.360290 (+1708017us) service_pool.cc:211] Skipping call since client already timed out
0709 12:24:50.361424 (+  1134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:24:50.400216 15907 rpcz_store.cc:276] 0709 12:24:44.894112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.539624 (+2645512us) service_pool.cc:224] Handling call
0709 12:24:47.539913 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.973544 (+2433631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.399287 (+425743us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54001c3754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:50.399570 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5592522496}
I20260709 12:24:50.400918 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.401177 15831 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:50.401929 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115) took 1890 ms. Trace:
I20260709 12:24:50.401861 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.402290 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.402449 15904 rpcz_store.cc:276] 0709 12:24:48.518796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.396995 (+1878199us) service_pool.cc:224] Handling call
0709 12:24:50.401844 (+  4849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.402949 15905 raft_consensus.cc:2410] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:50.403424 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128) took 1402 ms. Trace:
I20260709 12:24:50.403661 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:50.403767 15905 rpcz_store.cc:276] 0709 12:24:49.001402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.401426 (+1400024us) service_pool.cc:224] Handling call
0709 12:24:50.403367 (+  1941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.404579 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1054) took 1037 ms. Trace:
I20260709 12:24:50.383574 18222 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.404981 15980 rpcz_store.cc:276] 0709 12:24:49.367498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.367697 (+   199us) service_pool.cc:224] Handling call
0709 12:24:49.505684 (+137987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.510668 (+  4984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.404170 (+893502us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000c7950. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:50.404399 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303621504}
I20260709 12:24:50.403439 15907 raft_consensus.cc:2410] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:50.407156 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406) took 1754 ms. Trace:
I20260709 12:24:50.407575 15907 rpcz_store.cc:276] 0709 12:24:48.653069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.401913 (+1748844us) service_pool.cc:224] Handling call
0709 12:24:50.407098 (+  5185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.408109 16495 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:50.408807 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.409843 15907 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:24:50.397560 15910 raft_consensus.cc:2368] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9.
I20260709 12:24:50.384197 18445 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:50.412766 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2424) took 1148 ms. Trace:
I20260709 12:24:50.413296 15907 rpcz_store.cc:276] 0709 12:24:49.264598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.408490 (+1143892us) service_pool.cc:224] Handling call
0709 12:24:50.412691 (+  4201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.404935 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.380277 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.417800 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2422) took 1157 ms. Trace:
I20260709 12:24:50.427979 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.439867 15910 rpcz_store.cc:276] 0709 12:24:49.258940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.396329 (+1137389us) service_pool.cc:224] Handling call
0709 12:24:50.416664 (+ 20335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.426038 15904 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.437134 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.449575 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.449779 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.451414 15980 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.451615 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.451908 16494 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:50.423521 18445 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.453980 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.454638 15910 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:50.455128 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123) took 1839 ms. Trace:
I20260709 12:24:50.455449 15910 rpcz_store.cc:276] 0709 12:24:48.623325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.453604 (+1830279us) service_pool.cc:224] Handling call
0709 12:24:50.455063 (+  1459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.456444 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.457144 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409) took 1803 ms. Trace:
I20260709 12:24:50.457446 15910 rpcz_store.cc:276] 0709 12:24:48.653528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.456106 (+1802578us) service_pool.cc:224] Handling call
0709 12:24:50.457096 (+   990us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.448168 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.457916 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:50.458429 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.420220 18409 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.463558 15907 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:50.464088 15981 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:50.461364 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.419407 15953 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.416105 18542 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:50.438117 18562 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:50.423339 18584 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.434402 18579 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.433843 18593 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:50.466760 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 47774.5us
I20260709 12:24:50.467090 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405) took 1811 ms. Trace:
I20260709 12:24:50.469540 15907 rpcz_store.cc:276] 0709 12:24:48.652899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.414222 (+1761323us) service_pool.cc:224] Handling call
0709 12:24:50.464677 (+ 50455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.419106 18594 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:24:50.470568 15980 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:24:50.471920 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.467321 15905 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:24:50.442819 18188 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.474525 18579 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:50.477188 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:50.475793 18117 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:50.471941 18398 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.475558 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.480957 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.481400 18398 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:50.481616 15906 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:50.481757 16494 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:50.479759 18188 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.482312 15906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109) took 2017 ms (client timeout 2400 ms). Trace:
I20260709 12:24:50.478837 18117 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:50.482910 18398 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.484131 18117 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.480144 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 100622us
I20260709 12:24:50.478192 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1138) took 1245 ms. Trace:
I20260709 12:24:50.485873 15905 rpcz_store.cc:276] 0709 12:24:49.228545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.404574 (+1176029us) service_pool.cc:224] Handling call
0709 12:24:50.473749 (+ 69175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.484833 18188 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.486361 15910 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:50.487618 18373 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:50.482762 15906 rpcz_store.cc:269] 0709 12:24:48.464843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.475066 (+2010223us) service_pool.cc:224] Handling call
0709 12:24:50.482248 (+  7182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.488682 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.489352 18222 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.490723 18479 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.491572 18579 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:50.493053 18510 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:50.494861 18117 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.503432 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:50.504230 15833 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:50.505077 18442 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:50.505715 18442 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:50.507040 18442 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.508030 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.508343 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.501179 15981 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.515163 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.515923 15906 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:50.516527 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129) took 1498 ms. Trace:
I20260709 12:24:50.516848 15906 rpcz_store.cc:276] 0709 12:24:49.019921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.513171 (+1493250us) service_pool.cc:224] Handling call
0709 12:24:50.516465 (+  3294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.517264 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.517627 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.518069 15982 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
W20260709 12:24:50.515996 15876 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 3.191s (SENT)
I20260709 12:24:50.519167 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.519975 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.518792 18542 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.523731 18542 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.524256 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.524670 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.531438 15907 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:50.532092 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415) took 1442 ms. Trace:
I20260709 12:24:50.532519 15907 rpcz_store.cc:276] 0709 12:24:49.089917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.471572 (+1381655us) service_pool.cc:224] Handling call
0709 12:24:50.532017 (+ 60445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.538141 15904 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:50.533461 18575 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.540802 18459 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.541240 18459 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:50.546481 18449 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:50.546710 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.547912 15907 raft_consensus.cc:2410] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:50.548357 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110) took 2075 ms. Trace:
I20260709 12:24:50.549274 15906 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:50.550413 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.550531 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:50.551348 15906 raft_consensus.cc:2410] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:50.551813 18594 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.545500 15905 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:50.552287 18594 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:50.552763 18594 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.553929 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.554303 15835 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.554889 18542 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:50.555190 15876 connection.cc:256] RPC call timeout handler was delayed by -4.2965752720001547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:24:50.555739 15876 connection.cc:256] RPC call timeout handler was delayed by -4.24437527200007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 12:24:50.555598 18542 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.556156 15876 connection.cc:256] RPC call timeout handler was delayed by -4.1093752720003067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 12:24:50.556005 18557 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:50.556694 15876 connection.cc:256] RPC call timeout handler was delayed by -3.2867752720003409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2998s for a response
I20260709 12:24:50.557029 18557 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:50.548676 15907 rpcz_store.cc:276] 0709 12:24:48.472638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.541532 (+2068894us) service_pool.cc:224] Handling call
0709 12:24:50.548300 (+  6768us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.557073 15876 connection.cc:256] RPC call timeout handler was delayed by -3.2621015700005955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 12:24:50.552419 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.557462 18557 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:50.559887 18542 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:50.560796 15908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1124) took 1922 ms (client timeout 1638 ms). Trace:
W20260709 12:24:50.561362 15908 rpcz_store.cc:269] 0709 12:24:48.638195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.560434 (+1922239us) service_pool.cc:211] Skipping call since client already timed out
0709 12:24:50.560578 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:24:50.563009 15908 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.563756 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394) took 4070 ms. Trace:
I20260709 12:24:50.564103 15908 rpcz_store.cc:276] 0709 12:24:46.492816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.562164 (+4069348us) service_pool.cc:224] Handling call
0709 12:24:50.562667 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.563465 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.563682 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.565696 15908 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:50.566397 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448) took 3909 ms. Trace:
I20260709 12:24:50.566793 15908 rpcz_store.cc:276] 0709 12:24:46.660141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.564913 (+3904772us) service_pool.cc:224] Handling call
0709 12:24:50.565491 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.566144 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.566348 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.568689 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450) took 3762 ms. Trace:
I20260709 12:24:50.560577 18557 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.570623 15876 connection.cc:256] RPC call timeout handler was delayed by -3.1235015700003714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 12:24:50.571012 15876 connection.cc:256] RPC call timeout handler was delayed by -2.9282015700005104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:24:50.571314 15876 connection.cc:256] RPC call timeout handler was delayed by -2.905701570000474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:24:50.571583 15876 connection.cc:256] RPC call timeout handler was delayed by -2.7152752720003264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3633s for a response
W20260709 12:24:50.571887 15876 connection.cc:256] RPC call timeout handler was delayed by -2.4647015700002157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2617s for a response
I20260709 12:24:50.579348 18459 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:50.582316 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:50.583119 15911 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
W20260709 12:24:50.583614 15911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1116) took 2062 ms (client timeout 2195 ms). Trace:
W20260709 12:24:50.583989 15911 rpcz_store.cc:269] 0709 12:24:48.520704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.581798 (+2061094us) service_pool.cc:224] Handling call
0709 12:24:50.583554 (+  1756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.586815 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:50.587147 15909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1120) took 2025 ms (client timeout 1745 ms). Trace:
I20260709 12:24:50.588781 15908 rpcz_store.cc:276] 0709 12:24:46.805934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.567581 (+3761647us) service_pool.cc:224] Handling call
0709 12:24:50.567984 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.568317 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.568347 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.568405 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:50.568441 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.568516 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.568634 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.557978 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410) took 1884 ms. Trace:
I20260709 12:24:50.590013 15904 rpcz_store.cc:276] 0709 12:24:48.653669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.403275 (+1749606us) service_pool.cc:224] Handling call
0709 12:24:50.538513 (+135238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.552798 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1135) took 1378 ms. Trace:
I20260709 12:24:50.593668 15905 rpcz_store.cc:276] 0709 12:24:49.174493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.507823 (+1333330us) service_pool.cc:224] Handling call
0709 12:24:50.552736 (+ 44913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.595292 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:24:50.587546 15909 rpcz_store.cc:269] 0709 12:24:48.561594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.428630 (+867036us) service_pool.cc:224] Handling call
0709 12:24:50.586890 (+1158260us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b540038fc54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:50.587044 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104508160}
W20260709 12:24:50.597440 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.598172 18542 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:50.598706 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104) took 2200 ms. Trace:
I20260709 12:24:50.600778 15911 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.599653 15909 rpcz_store.cc:276] 0709 12:24:48.398751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.597642 (+2198891us) service_pool.cc:224] Handling call
0709 12:24:50.598007 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.598370 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.598400 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.598458 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:50.598493 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.598544 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.598654 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.602918 15906 raft_consensus.cc:2410] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:50.603188 15981 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:50.603462 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126) took 1668 ms. Trace:
I20260709 12:24:50.603833 15906 rpcz_store.cc:276] 0709 12:24:48.935029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.552088 (+1617059us) service_pool.cc:224] Handling call
0709 12:24:50.603405 (+ 51317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.604672 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.598611 18542 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:50.611701 15904 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.612349 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101) took 2214 ms. Trace:
I20260709 12:24:50.612677 15904 rpcz_store.cc:276] 0709 12:24:48.397880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.601454 (+2203574us) service_pool.cc:224] Handling call
0709 12:24:50.607167 (+  5713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.612082 (+  4915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.612266 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.605810 18459 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.618876 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.619436 15904 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.607806 18542 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.621601 15910 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:50.622750 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111) took 2138 ms. Trace:
I20260709 12:24:50.623001 15904 rpcz_store.cc:276] 0709 12:24:48.481243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.613471 (+2132228us) service_pool.cc:224] Handling call
0709 12:24:50.613805 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.619792 (+  5987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.619960 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.624828 18445 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.624867 18510 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:24:50.632761 18510 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:50.633426 18510 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:50.634651 18510 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.636013 18510 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.637683 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.628546 15906 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.637609 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451) took 3819 ms. Trace:
I20260709 12:24:50.639433 15911 rpcz_store.cc:276] 0709 12:24:46.817947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.584653 (+3766706us) service_pool.cc:224] Handling call
0709 12:24:50.588567 (+  3914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.601190 (+ 12623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.637385 (+ 36195us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b540010b154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:50.637533 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27701120}
W20260709 12:24:50.645226 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 94947.1us
W20260709 12:24:50.646471 15802 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.638s (SENT)
I20260709 12:24:50.646905 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.646968 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.654070 15904 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:50.654920 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112) took 2167 ms. Trace:
I20260709 12:24:50.628186 18557 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.662891 15904 rpcz_store.cc:276] 0709 12:24:48.487282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.626589 (+2139307us) service_pool.cc:224] Handling call
0709 12:24:50.653842 (+ 27253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.654602 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.654854 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.672060 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 78824.6us
I20260709 12:24:50.674340 15908 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:24:50.682538 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.682919 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100) took 2282 ms. Trace:
I20260709 12:24:50.685367 15908 rpcz_store.cc:276] 0709 12:24:48.397659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.601692 (+2204033us) service_pool.cc:224] Handling call
0709 12:24:50.626972 (+ 25280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:50.679638 (+ 52666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.679909 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.690920 18522 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.691510 18571 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:50.692634 18571 raft_consensus.cc:3055] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.692966 18571 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:50.693974 18571 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.695194 18571 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:50.695977 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51274.1us
I20260709 12:24:50.697453 15911 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.704679 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:50.700479 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396) took 2049 ms. Trace:
W20260709 12:24:50.705467 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.705320 15911 rpcz_store.cc:276] 0709 12:24:48.651136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.661515 (+2010379us) service_pool.cc:224] Handling call
0709 12:24:50.682810 (+ 21295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.699504 (+ 16694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.700426 (+   922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.707315 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454) took 1639 ms. Trace:
I20260709 12:24:50.707700 15911 rpcz_store.cc:276] 0709 12:24:49.068184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.706300 (+1638116us) service_pool.cc:224] Handling call
0709 12:24:50.706647 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.706899 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.706929 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.707018 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:50.707061 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.707124 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.707220 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.708467 15904 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:50.709056 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397) took 2057 ms. Trace:
I20260709 12:24:50.709252 18416 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:50.709434 15904 rpcz_store.cc:276] 0709 12:24:48.651395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.673959 (+2022564us) service_pool.cc:224] Handling call
0709 12:24:50.708121 (+ 34162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.708824 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.708992 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.709877 18416 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.709169 18522 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.719314 18606 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:24:50.719565 18600 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:24:50.719744 18522 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.723089 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.723752 15980 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:50.725375 18522 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.725998 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392) took 4233 ms. Trace:
I20260709 12:24:50.726363 15910 rpcz_store.cc:276] 0709 12:24:46.492338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.601342 (+4109004us) service_pool.cc:224] Handling call
0709 12:24:50.621450 (+ 20108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.622526 (+  1076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.725792 (+103266us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b54001c4150. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:50.725917 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9172352}
I20260709 12:24:50.710062 15908 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:50.702332 18579 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.732293 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400) took 2080 ms. Trace:
I20260709 12:24:50.732674 15908 rpcz_store.cc:276] 0709 12:24:48.652093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.700311 (+2048218us) service_pool.cc:224] Handling call
0709 12:24:50.709769 (+  9458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.727420 (+ 17651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.732242 (+  4822us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.731869 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 45043.9us
I20260709 12:24:50.735128 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391) took 4221 ms. Trace:
I20260709 12:24:50.735755 15910 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:50.736352 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 456) took 1499 ms. Trace:
I20260709 12:24:50.736644 15910 rpcz_store.cc:276] 0709 12:24:49.236863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.727232 (+1490369us) service_pool.cc:224] Handling call
0709 12:24:50.734384 (+  7152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.736097 (+  1713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.736282 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.728935 18416 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.746693 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2423) took 1487 ms. Trace:
I20260709 12:24:50.747062 15908 rpcz_store.cc:276] 0709 12:24:49.259214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.745602 (+1486388us) service_pool.cc:224] Handling call
0709 12:24:50.745930 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.746353 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:50.746380 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.746434 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:50.746471 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.746525 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.746619 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.748680 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2426) took 1436 ms. Trace:
I20260709 12:24:50.749341 18513 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:24:50.750938 18457 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:50.754083 18594 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:50.754823 18416 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.756134 18594 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:50.757021 18416 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:50.757436 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 107152us
I20260709 12:24:50.758261 15904 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:24:50.765079 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.748971 15908 rpcz_store.cc:276] 0709 12:24:49.316089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.747905 (+1431816us) service_pool.cc:224] Handling call
0709 12:24:50.748210 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.748388 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.748413 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.748463 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:50.748497 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.748542 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.748636 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.758827 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1134) took 1584 ms. Trace:
W20260709 12:24:50.767304 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 70603.4us
I20260709 12:24:50.767494 15904 rpcz_store.cc:276] 0709 12:24:49.174224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.710421 (+1536197us) service_pool.cc:224] Handling call
0709 12:24:50.728342 (+ 17921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.758601 (+ 30259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.758779 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.741272 18398 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.773916 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.776602 15906 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.777105 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107) took 2350 ms. Trace:
I20260709 12:24:50.777627 15906 rpcz_store.cc:276] 0709 12:24:48.426782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.608642 (+2181860us) service_pool.cc:224] Handling call
0709 12:24:50.627052 (+ 18410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.776894 (+149842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.777019 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.781868 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.781941 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.782660 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.784564 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.785821 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.788120 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.788667 16488 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:50.791165 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 86614.7us
I20260709 12:24:50.792469 18594 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:50.792748 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:50.793896 18457 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.794426 15952 leader_election.cc:400] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9.
I20260709 12:24:50.794729 15952 leader_election.cc:403] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:50.794788 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102) took 2396 ms. Trace:
I20260709 12:24:50.796217 15952 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:50.796816 18457 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9.
I20260709 12:24:50.797010 18594 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.799885 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.802021 18188 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.803009 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.795171 15905 rpcz_store.cc:276] 0709 12:24:48.398275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.601478 (+2203203us) service_pool.cc:224] Handling call
0709 12:24:50.620918 (+ 19440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:50.624219 (+  3301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.624247 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:50.625064 (+   817us) log.cc:844] Serialized 52 byte log entry
0709 12:24:50.665767 (+ 40703us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:50.701589 (+ 35822us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.701871 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.701944 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.794593 (+ 92649us) raft_consensus.cc:1685] finished
0709 12:24:50.794611 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.794736 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76558,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":13534,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":1133,"thread_start_us":62720,"threads_started":2,"wal-append.queue_time_us":59253}
I20260709 12:24:50.809345 15910 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:50.809582 16488 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:50.809976 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2421) took 1563 ms. Trace:
I20260709 12:24:50.810294 15910 rpcz_store.cc:276] 0709 12:24:49.246540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.740676 (+1494136us) service_pool.cc:224] Handling call
0709 12:24:50.768073 (+ 27397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.809744 (+ 41671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.809928 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.810809 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.735507 15907 rpcz_store.cc:276] 0709 12:24:46.492072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.585139 (+4093067us) service_pool.cc:224] Handling call
0709 12:24:50.585698 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.586330 (+   632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.586371 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.586979 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.615079 (+ 28100us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:50.701098 (+ 86019us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.701338 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.701407 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.712868 (+ 11461us) raft_consensus.cc:1685] finished
0709 12:24:50.713170 (+   302us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.713305 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":294,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"thread_start_us":78033,"threads_started":2,"wal-append.queue_time_us":91017}
I20260709 12:24:50.815457 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:50.820662 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44468us
I20260709 12:24:50.776373 18398 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:50.777849 18373 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.825574 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 107101us
I20260709 12:24:50.832005 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.822321 18416 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.837446 18429 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.837811 18188 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.838451 18224 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.839025 18224 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.841110 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105) took 2442 ms. Trace:
I20260709 12:24:50.841646 15909 rpcz_store.cc:276] 0709 12:24:48.398966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.605022 (+2206056us) service_pool.cc:224] Handling call
0709 12:24:50.620623 (+ 15601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.704326 (+ 83703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.704368 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.704441 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.704484 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.840804 (+136320us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b540010cf54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:50.840871 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.841017 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175790464}
I20260709 12:24:50.842653 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:50.847262 18542 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.849334 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 63620.8us
I20260709 12:24:50.851193 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.852227 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:50.852944 18409 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:50.853009 18515 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.853546 18409 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:50.853332 18373 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.854131 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 58017.8us
I20260709 12:24:50.854522 18409 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.855547 18373 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:50.854918 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:50.856388 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82877.4us
I20260709 12:24:50.856670 18222 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.857163 18222 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:50.857581 18413 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.857615 18222 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.858304 18413 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.858731 18413 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.860402 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 709) took 1417 ms. Trace:
I20260709 12:24:50.856333 15911 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:50.861783 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.823179 18398 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.836800 18416 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:50.869069 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.830827 18442 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.872457 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.872713 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:50.873318 16488 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:50.865301 16486 rpcz_store.cc:276] 0709 12:24:49.443297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.473372 (+ 30075us) service_pool.cc:224] Handling call
0709 12:24:49.662587 (+189215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.966214 (+303627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.859969 (+893755us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:50.860219 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687018240}
I20260709 12:24:50.875572 18575 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.871419 18593 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.877876 15904 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:50.878849 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.880198 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.877719 18515 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.874044 18445 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:24:50.885775 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.885180 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:50.887761 15835 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:50.889328 18575 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.916414 18351 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:50.917404 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:50.917688 18594 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.918123 18594 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:50.918659 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:50.919380 15983 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:50.919095 18594 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:50.920441 18594 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:50.921175 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 145173us
I20260709 12:24:50.921927 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:50.922740 18515 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.923280 15876 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.924059 18515 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.914529 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.885345 18416 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:50.933862 18458 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.071s	user 0.015s	sys 0.034s
W20260709 12:24:50.934234 18458 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.015s	sys 0.034s
I20260709 12:24:50.911482 18542 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:50.945709 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:50.948570 18373 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:50.949363 18373 consensus_queue.cc:1243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:50.950745 18537 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.950949 18398 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:50.951371 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:50.955101 15983 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:50.926615 18575 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:50.962534 18575 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:50.963200 18569 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.297s	user 0.015s	sys 0.025s
W20260709 12:24:50.967238 15913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2416) took 1876 ms (client timeout 1746 ms). Trace:
I20260709 12:24:50.967947 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:50.956801 15980 raft_consensus.cc:1217] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[3.4-7.6]   Dedup: 3.4->[5.5-7.6]
W20260709 12:24:50.975407 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.973225 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:50.967690 15913 rpcz_store.cc:269] 0709 12:24:49.090146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.966853 (+1876707us) service_pool.cc:211] Skipping call since client already timed out
0709 12:24:50.966999 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:24:50.973853 15980 pending_rounds.cc:85] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 4
W20260709 12:24:50.984021 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53065.7us
I20260709 12:24:50.960784 18536 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:50.989244 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46296.9us
I20260709 12:24:50.983153 15980 pending_rounds.cc:107] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:50.992584 15980 raft_consensus.cc:2889] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.982637 18188 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:51.002751 15982 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.003494 15835 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:50.999711 15803 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 2.010s (SENT) [suppressed 61 similar messages]
I20260709 12:24:50.975009 18537 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:50.985194 18522 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:50.990106 18536 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.006664 18522 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.992897 18579 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.003346 18398 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:50.985586 18373 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:51.011682 18536 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.017304 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 538) took 1907 ms. Trace:
I20260709 12:24:51.018211 15984 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:51.004418 18188 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:51.011590 18522 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.022039 18413 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:51.023082 18616 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 12:24:51.023232 15987 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:51.020747 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52958.2us
I20260709 12:24:51.019543 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2529) took 5034 ms. Trace:
I20260709 12:24:51.027186 18459 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:51.035807 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:51.040068 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:51.006435 18222 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.030809 18188 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.028258 15836 rpcz_store.cc:276] 0709 12:24:49.095092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.104374 (+  9282us) service_pool.cc:224] Handling call
0709 12:24:49.104653 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.104958 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.104985 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.146627 (+ 41642us) log.cc:844] Serialized 26 byte log entry
0709 12:24:49.358502 (+211875us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:49.358546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.358648 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.962348 (+1603700us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:24:50.973322 (+ 10974us) raft_consensus.cc:1685] finished
0709 12:24:50.973349 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.002144 (+ 28795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":434,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":21009,"spinlock_wait_cycles":23857024,"thread_start_us":131754,"threads_started":1,"wal-append.queue_time_us":369745}
I20260709 12:24:51.044819 18383 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:51.041777 18479 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:24:51.047333 18413 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:51.033087 15830 rpcz_store.cc:276] 0709 12:24:45.985218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.356889 (+2371671us) service_pool.cc:224] Handling call
0709 12:24:49.184838 (+827949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.185102 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:49.225421 (+ 40319us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.649958 (+424537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.650008 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:49.650049 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.650121 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.016864 (+1366743us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400136fd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:51.019367 (+  2503us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":151601,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":58465,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":11705,"spinlock_wait_cycles":1903405824,"thread_start_us":405732,"threads_started":2,"wal-append.queue_time_us":483620,"wal-append.run_cpu_time_us":1882,"wal-append.run_wall_time_us":1305252}
I20260709 12:24:51.050614 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:51.051002 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.051266 15984 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.051868 18413 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.045245 18383 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:51.044056 18416 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:51.056160 15986 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1041) took 2016 ms (client timeout 2010 ms). Trace:
W20260709 12:24:51.056756 15986 rpcz_store.cc:269] 0709 12:24:49.025631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.025953 (+   322us) service_pool.cc:224] Handling call
0709 12:24:51.029772 (+2003819us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002c5954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:51.041956 (+ 12184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101777792}
W20260709 12:24:51.056212 15912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117) took 2532 ms (client timeout 2397 ms). Trace:
I20260709 12:24:51.061837 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:51.062413 15912 rpcz_store.cc:269] 0709 12:24:48.524021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.658774 (+1134753us) service_pool.cc:224] Handling call
0709 12:24:51.041003 (+1382229us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400431054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:51.056121 (+ 15118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240912768}
I20260709 12:24:51.051167 18308 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.077323 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:51.077629 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:51.078786 18594 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:51.084662 15836 raft_consensus.cc:2368] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:51.088378 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455) took 2019 ms. Trace:
I20260709 12:24:51.093166 18325 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:51.094003 18325 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:51.094364 18325 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:51.075573 18416 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:51.095355 18325 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.095932 18416 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.051858 18537 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.098686 18222 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:51.101675 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.088743 15911 rpcz_store.cc:276] 0709 12:24:49.068452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.708581 (+1640129us) service_pool.cc:224] Handling call
0709 12:24:50.708912 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.865796 (+156884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.088150 (+222354us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400196ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:51.088302 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338590592}
I20260709 12:24:51.114614 18383 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.115626 15988 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.115960 18383 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.280530 15878 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50336 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1117)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1108)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1128)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1126)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2400)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2421)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2423)
W20260709 12:24:51.117642 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63526.9us
W20260709 12:24:51.125612 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.129549 15834 raft_consensus.cc:2410] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:24:51.134276 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.124998 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.141599 15984 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
W20260709 12:24:51.134323 15952 leader_election.cc:336] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:24:51.185341 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:51.194721 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.128876 18117 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:24:51.127400 18224 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:51.126304 18476 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:24:51.199617 18476 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:51.199991 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.200913 15913 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:51.202103 18376 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.202656 18376 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.203526 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.203929 18522 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.204692 18579 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.130707 18479 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.129968 18297 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.194862 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:51.211936 15984 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:51.212280 15904 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:51.222764 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:51.205194 18579 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.221057 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:51.226497 15913 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:51.135020 18351 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:24:51.210141 18575 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.200024 18476 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:51.207412 18479 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:51.204787 18376 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:51.235915 15984 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:51.216928 18458 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:51.237309 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 103082us
I20260709 12:24:51.244854 15906 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:24:51.230182 18579 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.209055 18537 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:24:51.253170 18537 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.253556 18537 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:51.249588 18383 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.254477 18537 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.255647 18537 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.230583 18413 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.257540 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:51.258102 15904 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:51.258350 15912 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:51.258001 18413 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.260267 18413 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:51.261761 18325 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.262760 18536 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.265795 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:51.266027 18476 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.265898 15733 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 6, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.267282 18476 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.249732 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:51.269465 15911 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:51.267828 15733 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 3 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:24:51.299058 15732 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 277) took 21105 ms (client timeout 15000 ms). Trace:
I20260709 12:24:51.297590 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:51.323921 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:51.326478 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:51.336460 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.336567 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:51.337545 15913 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:51.340591 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.320518 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:51.301326 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 91387.3us
I20260709 12:24:51.341552 15988 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:51.342141 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.342599 15911 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.298420 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:51.299196 18222 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.344189 15733 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 5, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.290293 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:51.301549 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:51.355924 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.282464 18117 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:51.359007 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 153045us
I20260709 12:24:51.320650 18536 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:51.395074 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.326037 18417 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.329430 18522 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:51.285216 18575 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:24:51.413395 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:51.422642 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:51.377198 18117 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:51.424453 15876 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:51.426144 15802 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.753s (SENT)
I20260709 12:24:51.426681 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.413419 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:51.429378 15904 raft_consensus.cc:2410] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:51.428670 15909 raft_consensus.cc:2376] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5. Re-sending same reply.
W20260709 12:24:51.434218 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 85538.7us
I20260709 12:24:51.434864 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:51.348109 18188 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.279506 18479 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.429225 18117 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.420697 18416 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.455822 15835 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:51.410993 18222 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.434360 18575 consensus_queue.cc:1243] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:51.460485 15912 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:51.479710 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:51.450306 18409 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.478469 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:51.499426 18571 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:51.500137 18571 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.501372 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.502380 18571 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:51.502530 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.505722 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52779.4us
I20260709 12:24:51.494288 15905 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.518561 15986 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:51.476406 18522 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.516220 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:51.535020 15982 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:51.534860 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:51.535712 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 50164.9us
W20260709 12:24:51.323022 15732 rpcz_store.cc:269] 0709 12:24:30.247351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.284898 (+ 37547us) service_pool.cc:224] Handling call
0709 12:24:51.298766 (+21013868us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:41.162982 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:41.163605 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:41.163661 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:24:41.163678 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:41.302617 (+138939us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:41.311651 (+  9034us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:41.313448 (+  1797us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:24:41.412262 (+ 98814us) tablet.cc:701] Row locks acquired
0709 12:24:41.412314 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:24:41.412481 (+   167us) write_op.cc:270] Start()
0709 12:24:41.412638 (+   157us) write_op.cc:276] Timestamp: P: 1783599881412417 usec, L: 0
0709 12:24:41.412661 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:41.498904 (+ 86243us) log.cc:844] Serialized 6427 byte log entry
0709 12:24:42.826652 (+1327748us) op_driver.cc:464] REPLICATION: finished
0709 12:24:42.955988 (+129336us) write_op.cc:301] APPLY: starting
0709 12:24:42.956139 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:42.956644 (+   505us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:42.967112 (+ 10468us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:42.979247 (+ 12135us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:42.979638 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:24:42.979687 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:42.980115 (+   428us) log.cc:844] Serialized 113 byte log entry
0709 12:24:42.980310 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:42.980461 (+   151us) write_op.cc:454] Released schema lock
0709 12:24:42.980525 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:42.980953 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:42.980984 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13392,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":124023,"apply.run_cpu_time_us":4903,"apply.run_wall_time_us":24975,"num_ops":16,"prepare.queue_time_us":568359,"prepare.run_cpu_time_us":15257,"prepare.run_wall_time_us":518160,"raft.queue_time_us":232843,"raft.run_cpu_time_us":22724,"raft.run_wall_time_us":42481,"replication_time_us":1413835,"thread_start_us":564310,"threads_started":4,"wal-append.queue_time_us":235833,"wal-append.run_cpu_time_us":35969,"wal-append.run_wall_time_us":2258063}]]}
W20260709 12:24:51.542184 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 140970us
W20260709 12:24:51.536547 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 57692.8us
I20260709 12:24:51.550017 18417 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.559942 15909 pending_rounds.cc:85] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 2
I20260709 12:24:51.571187 15909 pending_rounds.cc:107] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:51.571463 15909 raft_consensus.cc:2889] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:51.575219 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 173448us
W20260709 12:24:51.586056 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 124922us
W20260709 12:24:51.588176 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 132688us
I20260709 12:24:51.571355 18416 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.611370 18188 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:51.614148 18442 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:51.615244 15904 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:51.617390 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.618371 18442 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.619849 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.621191 18442 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.622795 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.541325 18429 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:24:51.629386 15911 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:51.578974 15733 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 5 to 3, leader changed from <none> to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65), VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66), VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67), VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.634311 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:51.636039 18651 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:51.635492 15733 catalog_manager.cc:5697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 4, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 4 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.636375 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.637276 18655 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:51.638479 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:51.638862 18653 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:51.639719 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:51.640277 18655 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.640625 15829 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:51.640684 18655 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:51.641227 18655 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.640547 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:51.641639 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:51.642143 15835 raft_consensus.cc:2410] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:51.643282 15835 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.639742 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.646428 18479 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.646822 15835 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:51.648214 15835 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:51.633702 15913 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:51.651404 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:51.652400 15829 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:51.653733 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.655216 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:24:51.655521 15802 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.962s (SENT)
I20260709 12:24:51.656298 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:51.603807 18373 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:51.603227 18416 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.659772 15952 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:51.631536 18442 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.667905 18571 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:51.669299 15733 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 5, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 5 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.681980 15988 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:24:51.668728 18416 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.690956 15906 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:51.668211 18557 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:51.691648 15906 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:51.600569 18643 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:24:51.679675 18594 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.679872 18398 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:51.673270 18373 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:51.693794 15906 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.664207 15832 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.701225 15906 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.698633 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:51.700138 18594 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.700309 18575 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.720515 15733 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 5, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 5 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:24:51.700305 18398 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:51.725081 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.730473 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:51.736330 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 103020us
W20260709 12:24:51.737968 15802 leader_election.cc:336] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 3.070s (SENT)
W20260709 12:24:51.738265 18644 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.344s	user 0.004s	sys 0.000s
I20260709 12:24:51.738411 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.740373 18510 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.740484 18442 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.723407 18222 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:51.719772 18458 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:51.724355 18594 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.729467 18398 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.749822 15733 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 3, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.752185 18458 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:51.763080 18579 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.764173 15907 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:51.769816 15906 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:24:51.770358 15906 pending_rounds.cc:85] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 8
I20260709 12:24:51.770699 15906 pending_rounds.cc:107] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:24:51.771054 15906 raft_consensus.cc:2889] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:51.728910 18655 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.777714 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.778576 15833 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:51.797717 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.749809 18417 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:51.804008 18656 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:24:51.809130 18594 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.812017 18579 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:51.813443 18537 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.002s
I20260709 12:24:51.816155 15831 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
W20260709 12:24:51.817565 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 119044us
I20260709 12:24:51.847462 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:51.748708 15835 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:24:51.842226 15802 leader_election.cc:336] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.072s (SENT)
W20260709 12:24:51.848208 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 70595.6us
I20260709 12:24:51.851125 15830 raft_consensus.cc:2410] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:51.838975 18457 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:51.857965 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 218317us
I20260709 12:24:51.843583 18639 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.866050 18655 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:51.763116 18458 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.859333 15733 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 4, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 4 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.853933 18222 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:51.890092 18222 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:51.890846 18663 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:24:51.891091 18222 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:51.896724 18654 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:24:51.899705 18224 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:51.900099 18224 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:51.900911 18224 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:51.901840 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 59648.2us
I20260709 12:24:51.902061 18224 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:51.902456 15802 leader_election.cc:336] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.108s (SENT)
I20260709 12:24:51.902829 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:51.903975 15802 leader_election.cc:336] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.195s (SENT)
I20260709 12:24:51.904322 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.904515 18413 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:51.905066 18646 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
W20260709 12:24:51.905282 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.909726 16492 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:24:51.910073 16492 pending_rounds.cc:85] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 7
I20260709 12:24:51.910290 16492 pending_rounds.cc:107] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:24:51.910501 16492 raft_consensus.cc:2889] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:51.844221 18373 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.913434 18510 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.913959 18510 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:51.914624 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.915480 18413 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.916026 18510 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:51.918982 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.920176 18308 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.842s	user 0.004s	sys 0.004s
I20260709 12:24:51.921895 16494 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:51.924476 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:51.875746 18639 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.876487 15733 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 3 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.880059 15950 leader_election.cc:400] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:51.928032 15950 leader_election.cc:403] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:24:51.884238 18659 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
I20260709 12:24:51.885403 18594 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:51.885794 18584 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:51.886896 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.859948 18642 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 12:24:51.948781 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:51.932528 15980 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:51.935372 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:51.935703 16492 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:51.937230 16490 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:51.938117 18243 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:51.939138 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:51.941973 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 238026us
W20260709 12:24:51.942641 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.957661 15802 leader_election.cc:336] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.215s (SENT)
I20260709 12:24:51.958200 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:51.951426 18416 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:51.960417 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:51.955801 15979 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
W20260709 12:24:51.961757 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 106157us
I20260709 12:24:51.957242 15733 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 2, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.967684 15733 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 5, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:51.959479 18515 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:24:51.962777 18117 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.971858 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:51.972510 15913 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:51.973224 15981 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.974272 18117 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:51.975782 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:51.977169 18479 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.977456 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:51.978425 15986 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:51.979359 18675 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:51.980327 15983 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:51.969465 18449 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.983258 18449 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.985046 18594 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:51.987344 18398 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:51.989921 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 110243us
I20260709 12:24:51.990906 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.992462 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:51.992625 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:51.993459 18479 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:51.941802 18579 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:24:51.993945 18479 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:51.994854 18479 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:51.946727 18584 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:51.999761 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:52.001874 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:52.002379 15913 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.997795 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:52.011114 16459 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:52.001734 18417 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.005779 18510 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 12:24:52.027432 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 80592.2us
W20260709 12:24:52.027696 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.008512 18413 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:52.038242 15913 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:24:52.048240 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 97919.8us
W20260709 12:24:52.040343 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 48030.1us
W20260709 12:24:52.057358 15802 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.231s (SENT)
I20260709 12:24:52.057934 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:52.059362 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:52.018741 18594 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.008641 18575 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:52.064941 15985 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:52.033485 18429 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:52.045792 18413 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.039666 18351 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:24:52.010165 18642 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:24:52.068360 16459 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:52.059459 18476 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:52.016716 18673 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:24:52.066296 18398 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:52.068380 18579 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.072127 18413 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.071116 18429 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:52.092182 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:52.069113 18383 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:24:52.097901 15802 leader_election.cc:336] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.400s (SENT)
W20260709 12:24:52.103757 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44547.2us
I20260709 12:24:52.105926 15802 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:52.089979 18308 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.114900 18669 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.072739 18515 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:52.100690 18429 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.133104 18677 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:52.135869 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:52.136478 16495 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.115273 18638 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.140938 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:52.093189 18643 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:52.102995 18373 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:52.155498 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.156288 15835 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
W20260709 12:24:52.162922 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 71486.6us
I20260709 12:24:52.162833 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:52.113497 18668 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.168021 15988 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:52.103327 18500 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:24:52.119777 18522 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:52.197587 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:52.200160 15905 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:52.194598 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 121061us
I20260709 12:24:52.172798 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:52.143349 18638 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:52.142835 18639 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.194216 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:52.210479 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:52.211918 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.213120 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.214773 16496 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:52.172147 18479 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.137718 18669 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.236663 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:52.200322 18416 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:52.237447 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 166605us
I20260709 12:24:52.217315 15912 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:24:52.248950 15802 leader_election.cc:336] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.742s (SENT)
I20260709 12:24:52.205776 18571 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.211246 18638 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.273085 16495 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:52.273814 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:52.169872 18668 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:52.171751 18676 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.206s
I20260709 12:24:52.288012 18655 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.297996 18689 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.298066 18655 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.298583 18689 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.298940 18689 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.300302 18655 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.277284 16486 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:52.301322 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:52.302071 16493 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
W20260709 12:24:52.307642 18680 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:24:52.274855 18571 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.308938 18571 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.309342 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 714) took 2360 ms. Trace:
I20260709 12:24:52.309551 18579 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:52.310035 18579 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:52.310096 18416 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:52.277321 18575 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:52.316908 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46593.5us
W20260709 12:24:52.323572 18681 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:52.325255 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 155474us
I20260709 12:24:52.325891 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:52.332262 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:52.270023 18479 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.323988 18449 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.317138 18668 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.331607 18383 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.337548 18243 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.309777 16490 rpcz_store.cc:276] 0709 12:24:49.949111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.949240 (+   129us) service_pool.cc:224] Handling call
0709 12:24:49.949516 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.956096 (+2006580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.309057 (+352961us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400619254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:52.309263 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4541894400}
W20260709 12:24:52.370952 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.373904 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.375762 15838 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:24:52.311088 18579 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.386384 18457 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:52.386795 18457 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:52.387535 18457 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.388548 18457 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.388203 18413 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.406222 18243 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:52.412051 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.367434 18383 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.432814 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:52.441648 18685 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:24:52.442787 18479 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.436370 18687 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:24:52.412844 18522 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.445472 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:52.446125 18694 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.457633 18479 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.434688 18579 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.456950 15980 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:52.460316 15985 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:52.466776 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:52.468514 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:52.477594 15983 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
W20260709 12:24:52.485916 18684 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:24:52.488154 18689 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:52.489307 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63048.6us
I20260709 12:24:52.470356 18243 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.490352 18689 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:52.491092 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:52.497763 18691 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:52.496762 18383 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.501770 18413 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:52.470680 18537 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.504168 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:52.456398 18522 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.510134 16492 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:24:52.458951 18694 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.523784 18694 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.526296 18703 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:52.527256 18703 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:52.527603 18703 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.527951 18703 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:52.529489 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:52.530171 16486 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.468640 18479 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.607739 18703 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.575078 18638 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.517526 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "021499433bf04873a1ec6376aba69864"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:24:52.614755 16490 raft_consensus.cc:606] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:52.615156 16490 raft_consensus.cc:614] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:52.613812 18571 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:52.621591 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 84836.1us
I20260709 12:24:52.622563 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:52.623456 18675 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.624751 15910 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:52.650980 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:52.652050 15906 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:52.661142 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:52.661826 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:52.661839 15911 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:24:52.665751 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.646400 18655 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.623945 18675 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:52.669297 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 143270us
I20260709 12:24:52.669881 18675 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.671332 16490 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:52.620910 18575 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:52.665469 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:52.677206 15912 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.654960 18515 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.679850 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.676635 15904 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:52.677984 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:52.604091 18668 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.687615 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.687804 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.688257 15835 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:52.688596 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.689186 15833 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.675271 18537 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:52.693789 15831 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:52.697443 15834 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:52.710016 15834 pending_rounds.cc:85] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:24:52.710314 15834 pending_rounds.cc:107] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:52.710726 15834 raft_consensus.cc:2889] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:52.704291 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.702071 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.685622 18515 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.714036 15832 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.716013 18515 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:52.705597 18522 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:52.707131 18640 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:52.717128 18640 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:52.717391 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.717967 15837 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.718258 18640 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:52.706636 18683 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.581s	user 0.005s	sys 0.006s
I20260709 12:24:52.710623 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.721516 15831 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.710251 18703 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:52.725848 18429 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.002s
I20260709 12:24:52.730520 15833 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:52.734869 15836 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:24:52.735222 15836 pending_rounds.cc:85] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 5
I20260709 12:24:52.735500 15836 pending_rounds.cc:107] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:52.735798 15836 raft_consensus.cc:2889] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:52.703007 18698 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:24:52.746244 15912 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:52.746800 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:52.760878 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:52.775640 15837 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:52.734030 18571 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.732898 18479 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.676512 18655 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.733577 15832 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:52.743669 18687 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.733400 15831 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:52.726266 18429 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.681058 18575 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.776106 18689 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:52.796340 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.835031 15906 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:52.776161 18351 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.854120 15836 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:52.775991 18243 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:52.791496 18479 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.776684 18522 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:24:52.879593 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.880728 15836 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:24:52.881477 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.792217 16486 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
W20260709 12:24:52.883788 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.856154 18708 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:52.732297 18537 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:52.888931 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 211019us
I20260709 12:24:52.891587 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:52.872751 18351 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:52.899020 18708 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:52.902068 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.793759 18687 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.935900 18687 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:52.921607 18710 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:24:52.929483 18708 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:52.931692 18716 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:52.887894 18479 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.943029 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.907763 18713 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.949270 15907 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:24:52.932689 18351 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.991976 15838 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:52.996030 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.996186 18655 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:52.996683 18655 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.997427 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:52.968482 18575 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.003780 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.968945 18668 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:52.970674 18429 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.981355 15834 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.898537 18584 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:52.987457 18638 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:52.988576 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:53.024922 15835 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:52.990008 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:52.990056 18713 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:52.998250 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:52.954030 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.997126 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:52.898136 18714 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:24:53.004696 18709 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.081501 15838 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.997123 18655 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.081830 15833 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:53.079736 18673 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.083166 18673 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.080248 18575 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.085530 15836 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.991523 18243 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:53.110260 18479 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.143918 15834 raft_consensus.cc:2410] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:53.189816 15912 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:53.191653 15912 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:53.193595 18668 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.194345 18668 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.199249 18668 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:53.284339 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.289780 15834 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:53.257546 15838 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:53.081741 18709 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.296676 15837 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:53.299482 16460 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:53.085237 18575 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:53.317981 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.270191 18668 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.199743 18670 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.279160 18714 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:53.331990 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.315307 18449 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:53.309230 18638 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:24:53.349835 18449 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.350416 18449 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.349871 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.319679 18713 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.336822 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:53.337100 18714 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.333256 18670 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.267660 18243 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.338975 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:53.346374 18689 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:53.347282 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:53.334223 18655 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.353823 15830 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.354341 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:53.357179 15837 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.331029 18668 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.360273 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:53.380632 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 52994.9us
I20260709 12:24:53.364042 18638 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:53.392642 16488 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:53.369359 18673 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.402769 18714 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.406177 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.406364 18575 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.362012 18689 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.411677 15837 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:53.411937 15830 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:53.415594 18670 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.415942 18036 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:53.418262 18689 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.418560 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:53.389444 18638 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.402804 18673 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.427487 18536 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.428632 18668 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.423909 18449 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.474579 15907 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:53.453083 18674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.326s	user 0.028s	sys 0.026s
I20260709 12:24:53.490967 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:53.452767 18584 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:53.497896 18674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.028s	sys 0.029s
I20260709 12:24:53.502938 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:53.432396 18675 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:53.421851 18243 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:53.442054 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:53.504561 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.443181 18714 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.443879 15834 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:53.447460 18688 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:53.497399 18638 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.453501 15836 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
W20260709 12:24:53.467819 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 55340.2us
I20260709 12:24:53.473306 18036 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:53.505028 15906 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:53.448513 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:53.486428 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.516276 15907 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:53.518760 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.502287 18537 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:53.501220 18642 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.503150 18713 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.497997 18673 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.537967 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:53.536202 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.538781 15906 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:53.515172 18708 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:53.521723 18643 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:53.541877 16494 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:53.514276 18536 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:53.595633 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.609822 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.611999 15983 raft_consensus.cc:2410] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:53.577597 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.609550 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.614298 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:53.577350 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 128940us
I20260709 12:24:53.616937 15980 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:53.613763 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.520628 18688 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.622184 15981 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:53.611756 16486 raft_consensus.cc:2410] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:53.624557 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.624619 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.565786 18537 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:24:53.524691 18731 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.623781 16496 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:53.576625 18351 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:53.569867 18708 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.541538 18642 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.537724 18714 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.618564 18036 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.632925 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.566277 18713 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.576856 18643 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.646874 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.629359 18689 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:53.650200 18449 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.651185 18243 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:53.651710 15952 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:53.651974 18642 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.652208 18674 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:53.653465 18643 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.653997 18537 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.655494 18713 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.657709 18476 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:53.658699 18722 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.757s	user 0.000s	sys 0.013s
I20260709 12:24:53.689018 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.689754 18476 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:53.690291 18476 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.662158 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:53.692904 18737 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:53.640322 18036 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.679047 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.698788 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.699816 18714 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.700469 18714 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.641525 18351 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.702031 18476 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.637017 18708 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.701331 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.703653 18351 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:53.692111 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:53.711802 15986 raft_consensus.cc:606] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:53.712292 15986 raft_consensus.cc:614] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:53.720968 18745 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:53.723322 18351 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:53.723966 18351 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:53.680897 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 280079us
I20260709 12:24:53.759778 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.760519 15986 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:53.762035 18740 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.764551 18740 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.684906 18689 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.728510 18536 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.700941 18714 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.788789 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:53.725181 18351 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:53.799674 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:53.800326 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.804191 15832 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:53.804692 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:53.805657 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 154008us
I20260709 12:24:53.777330 18687 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:53.788662 18673 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:53.814785 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:53.814136 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.812814 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:53.817330 15830 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:53.816180 15986 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:53.801240 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:53.820904 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:53.823789 15838 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:53.829059 15986 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:53.817889 18745 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:53.847342 15909 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:53.849131 18690 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:53.849618 18690 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:53.850530 18690 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.812812 18688 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:53.860463 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:53.861059 15986 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:53.862318 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 200221us
I20260709 12:24:53.869658 15980 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:53.870751 18639 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.871310 18639 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.858188 18243 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:53.873453 18243 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.873832 18243 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.878685 18639 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:53.883390 18243 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.883916 18638 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:53.884630 18643 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:53.884079 18036 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:53.852145 18690 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:53.897248 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 75458.1us
I20260709 12:24:53.899144 15986 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:24:53.899951 15802 leader_election.cc:336] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.501s (SENT)
I20260709 12:24:53.900676 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:53.901922 18537 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.901360 18745 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:53.903823 15802 leader_election.cc:336] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.544s (SENT)
I20260709 12:24:53.904492 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:53.905507 18537 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:53.916541 15802 leader_election.cc:336] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.685s (SENT)
I20260709 12:24:53.917419 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:53.864053 18747 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:53.924988 15980 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.929462 16486 raft_consensus.cc:2410] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:53.898911 18429 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:53.944588 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:53.945271 15985 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.863950 18688 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:24:53.962133 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:53.928653 18537 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.944630 18429 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:53.984213 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:53.984678 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68066.4us
W20260709 12:24:54.188723 15802 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.707s (SENT)
I20260709 12:24:54.170948 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:54.189970 15982 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.171481 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:54.005942 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.058918 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 472) took 1820 ms. Trace:
W20260709 12:24:54.052789 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 152784us
W20260709 12:24:54.218253 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.238464 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:54.012605 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:54.077845 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:54.060039 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:54.252074 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:54.256309 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.131971 15985 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
W20260709 12:24:54.258103 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 338701us
I20260709 12:24:54.262176 15984 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:24:54.134258 18760 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
W20260709 12:24:54.141834 18762 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:24:54.142721 18764 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:24:53.967921 18740 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.312397 18740 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:54.212949 18673 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:54.313086 18740 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.313525 18673 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.316052 18673 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.235548 18747 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:54.316840 18740 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:54.296751 18429 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.318171 18429 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.317700 18747 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.298465 18638 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.077575 18714 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.321527 18537 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:54.032789 18755 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:54.323278 18755 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.325416 18755 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:54.054342 18763 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.329399 18763 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.332692 18763 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:54.334867 15982 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
W20260709 12:24:54.347759 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61393.4us
I20260709 12:24:54.028620 18515 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:54.200627 15908 rpcz_store.cc:276] 0709 12:24:52.201475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.201614 (+   139us) service_pool.cc:224] Handling call
0709 12:24:52.236951 (+ 35337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:52.269070 (+ 32119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.269101 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:52.291921 (+ 22820us) log.cc:844] Serialized 52 byte log entry
0709 12:24:52.458291 (+166370us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:52.469017 (+ 10726us) log.cc:844] Serialized 14 byte log entry
0709 12:24:52.605191 (+136174us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180017dd60. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:24:53.886921 (+1281730us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b180017dd60. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cfc9b3c7 00007f03cc2ad9a7 00007f03cc2bd0bf 00007f03cc2bd038
0709 12:24:53.887116 (+   195us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.021490 (+134374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.021596 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.021649 (+    53us) raft_consensus.cc:1685] finished
0709 12:24:54.021666 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.021819 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1406954,"prepare.queue_time_us":1438907,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":86,"raft.queue_time_us":43200,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":41598,"spinlock_wait_cycles":37215232,"thread_start_us":280727,"threads_started":2,"wal-append.queue_time_us":265694,"wal-append.run_cpu_time_us":2916,"wal-append.run_wall_time_us":1016461}
I20260709 12:24:54.082940 18756 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:24:54.338196 18708 consensus_meta.cc:287] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.003s
W20260709 12:24:54.356603 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 167922us
W20260709 12:24:54.357234 15802 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.930s (SENT)
I20260709 12:24:54.357668 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:54.286943 18758 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:24:54.368638 18740 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.367385 18669 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.362820 18537 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.355971 18756 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:54.385407 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:54.407279 18669 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.413175 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 476) took 1795 ms. Trace:
I20260709 12:24:54.359561 18708 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.414471 15913 rpcz_store.cc:276] 0709 12:24:52.617377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.617489 (+   112us) service_pool.cc:224] Handling call
0709 12:24:52.617817 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:52.618173 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.618201 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:52.618624 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.790668 (+172044us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:54.241049 (+1450381us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.412862 (+171813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.412932 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.412971 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:54.412981 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.413123 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1135715,"prepare.queue_time_us":1505607,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":19484,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11283,"thread_start_us":621079,"threads_started":3,"wal-append.queue_time_us":259744,"wal-append.run_cpu_time_us":2149,"wal-append.run_wall_time_us":1121858}
I20260709 12:24:54.355491 18515 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.420107 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:54.420979 16495 raft_consensus.cc:2368] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
W20260709 12:24:54.420828 15802 leader_election.cc:336] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.397s (SENT)
I20260709 12:24:54.419675 18669 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.385716 18740 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.443254 18740 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:54.445011 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1585) took 1542 ms. Trace:
I20260709 12:24:54.445272 18708 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.445453 15834 rpcz_store.cc:276] 0709 12:24:52.902924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.290571 (+387647us) service_pool.cc:224] Handling call
0709 12:24:53.443582 (+153011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.505410 (+ 61828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.444838 (+939428us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540003b6d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:54.444956 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351225600}
W20260709 12:24:54.448604 15910 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.011s
W20260709 12:24:54.449019 15910 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.014s	sys 0.011s
I20260709 12:24:54.453292 18222 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:54.466826 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 484) took 1738 ms. Trace:
I20260709 12:24:54.467298 15912 rpcz_store.cc:276] 0709 12:24:52.728538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.192615 (+464077us) service_pool.cc:224] Handling call
0709 12:24:53.192977 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.201883 (+  8906us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:54.449812 (+1247929us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.466416 (+ 16604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.466478 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:54.466538 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.466632 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.466762 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":750819,"prepare.queue_time_us":1094773,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":135,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":483706,"threads_started":2}
W20260709 12:24:54.474632 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53834.4us
I20260709 12:24:54.476281 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.479316 15835 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:54.483196 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.483763 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.490442 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.491274 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.497577 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.514043 18736 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:54.520936 15802 leader_election.cc:336] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.560s (SENT)
I20260709 12:24:54.478020 18747 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.528620 18708 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.528712 15802 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.145s (SENT)
I20260709 12:24:54.529258 18708 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.531329 18708 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.529400 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:54.481065 18673 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:54.477226 18457 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:24:54.575166 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:54.588965 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2465) took 1934 ms. Trace:
I20260709 12:24:54.524430 18781 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:54.600224 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:54.558774 18760 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:54.601318 15908 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:54.601755 15912 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:54.610466 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:54.611227 15908 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.618264 15913 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:54.638921 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 110244us
I20260709 12:24:54.609503 18708 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.603950 18756 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:54.610469 18781 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.532274 18747 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.559198 18673 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.683923 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2462) took 2065 ms. Trace:
I20260709 12:24:54.659281 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:54.682410 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2467) took 2004 ms. Trace:
I20260709 12:24:54.678398 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:54.718223 15905 rpcz_store.cc:276] 0709 12:24:52.677864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.969778 (+291914us) service_pool.cc:224] Handling call
0709 12:24:52.970100 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.970318 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:54.450301 (+1479983us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.681978 (+231677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.682044 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:54.682119 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.682205 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.682344 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1043948,"prepare.queue_time_us":1326180,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"thread_start_us":667043,"threads_started":2}
I20260709 12:24:54.590449 15904 rpcz_store.cc:276] 0709 12:24:52.654731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.691411 (+ 36680us) service_pool.cc:224] Handling call
0709 12:24:52.745453 (+ 54042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.745705 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:54.349226 (+1603521us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.587858 (+238632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.587997 (+   139us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:54.588181 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.588458 (+   277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.588821 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1172722,"prepare.queue_time_us":1550349,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"thread_start_us":655819,"threads_started":3}
I20260709 12:24:54.717630 15910 rpcz_store.cc:276] 0709 12:24:52.618798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.663726 (+ 44928us) service_pool.cc:224] Handling call
0709 12:24:52.664082 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.664338 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:54.449403 (+1785065us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.683478 (+234075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.683558 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:54.683624 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.683712 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.683850 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1234505,"prepare.queue_time_us":1622406,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":769522,"threads_started":3,"wal-append.queue_time_us":161223}
I20260709 12:24:54.742514 15910 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:54.742893 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:54.743764 15913 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:24:54.757987 18797 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:54.758884 18781 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.693261 18575 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:54.759752 18575 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.760286 18796 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:54.758546 18797 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.763094 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:54.770813 15910 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.760798 18796 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:54.742841 18714 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:54.806059 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2472) took 1488 ms. Trace:
W20260709 12:24:54.775357 18690 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.004s
I20260709 12:24:54.807720 15906 rpcz_store.cc:276] 0709 12:24:53.318132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.545325 (+227193us) service_pool.cc:224] Handling call
0709 12:24:53.545648 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.545884 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:54.412954 (+867070us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.805719 (+392765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.805773 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:54.805826 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.805889 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.806004 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":536817,"prepare.queue_time_us":751197,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":157632,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":713626,"threads_started":3,"wal-append.queue_time_us":361852}
I20260709 12:24:54.793715 18797 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:54.776957 18669 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.805382 18802 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.769289 18740 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:54.823529 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
W20260709 12:24:54.859716 18784 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:54.861184 18747 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:54.864650 18800 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:54.865490 15910 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:54.865501 18715 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:54.866197 18715 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.868274 18715 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:54.890580 18796 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:54.891664 18243 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:54.933374 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.810026 18714 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.892876 18689 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:54.912966 18715 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.956079 18806 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:54.958339 18806 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.938014 18796 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:54.960204 18796 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:54.960588 18806 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:54.961879 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.963207 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:54.964270 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:54.968132 15834 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.963837 15906 raft_consensus.cc:2368] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8.
I20260709 12:24:54.961881 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:54.970655 15910 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:54.996690 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 490) took 1515 ms. Trace:
I20260709 12:24:55.015805 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2470) took 1698 ms. Trace:
I20260709 12:24:55.016381 15907 rpcz_store.cc:276] 0709 12:24:53.317329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.537515 (+220186us) service_pool.cc:224] Handling call
0709 12:24:53.566767 (+ 29252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.567018 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:54.447887 (+880869us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.015325 (+567438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.015406 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.015478 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.015572 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.015729 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":575737,"prepare.queue_time_us":730244,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":22,"raft.queue_time_us":128863,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":58,"thread_start_us":744007,"threads_started":3,"wal-append.queue_time_us":360999}
I20260709 12:24:54.997277 15909 rpcz_store.cc:276] 0709 12:24:53.481733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.655776 (+174043us) service_pool.cc:224] Handling call
0709 12:24:53.656503 (+   727us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:53.708437 (+ 51934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.708481 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:53.729330 (+ 20849us) log.cc:844] Serialized 608 byte log entry
0709 12:24:53.846719 (+117389us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:53.870442 (+ 23723us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.477585 (+607143us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.600346 (+122761us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.961952 (+361606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.962234 (+   282us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.962288 (+    54us) raft_consensus.cc:1685] finished
0709 12:24:54.962304 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.962457 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332948,"prepare.queue_time_us":467039,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":306976,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":73301,"thread_start_us":712006,"threads_started":4,"wal-append.queue_time_us":136000}
I20260709 12:24:54.858608 18740 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:55.033989 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:55.033329 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 212106us
I20260709 12:24:55.034160 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:55.046597 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.047345 15906 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:54.961792 18640 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:54.856967 18802 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:55.035377 18806 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:55.053920 18803 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.056882 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:55.057924 15906 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:24:55.029874 18669 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:55.070947 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.096798 15907 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:55.102257 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.019416 18715 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:55.103724 15834 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:55.064409 18673 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:55.146618 15908 consensus_meta.cc:287] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 12:24:55.147360 15908 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:55.148787 18715 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:55.149048 18709 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:55.070680 18806 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:55.150086 18674 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:55.150513 18674 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:55.151161 18806 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:55.151402 18674 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:55.147859 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:55.103452 18795 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:55.058681 18809 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:55.206137 18809 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:55.207588 15906 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 2.
I20260709 12:24:55.109333 18669 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:55.261646 15907 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:55.065639 18803 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:55.267235 18803 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:55.262084 15907 pending_rounds.cc:85] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:24:55.271447 15907 pending_rounds.cc:107] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:55.271811 15907 raft_consensus.cc:2889] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:55.294297 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:55.213208 18809 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:55.344339 18709 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:55.269068 18674 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.344993 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.351223 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:55.359355 15907 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:55.350666 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.360622 15909 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:55.354002 15908 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:24:55.354439 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.361999 15910 raft_consensus.cc:2410] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:55.356079 15911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.056s	sys 0.136s
W20260709 12:24:55.363855 15911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.056s	sys 0.136s
I20260709 12:24:55.361295 15908 pending_rounds.cc:85] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:24:55.367146 15908 pending_rounds.cc:107] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:24:55.367444 15908 raft_consensus.cc:2889] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:55.367520 15905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.051s
W20260709 12:24:55.367905 15905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.017s	sys 0.051s
W20260709 12:24:55.355099 18807 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 12:24:55.374118 16460 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.075s	sys 0.129s
W20260709 12:24:55.374449 16460 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.075s	sys 0.129s
W20260709 12:24:55.363510 18795 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:55.342023 18796 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:55.357697 18731 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:55.378623 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:55.389673 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.389827 15911 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.390277 15909 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
W20260709 12:24:55.391943 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 363642us
I20260709 12:24:55.383606 15912 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
W20260709 12:24:55.384409 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 419612us
I20260709 12:24:55.386405 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.397918 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.398204 15910 raft_consensus.cc:2410] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:55.387197 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:55.374714 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 560025us
W20260709 12:24:55.388157 18687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.515s	user 0.033s	sys 0.033s
I20260709 12:24:55.368263 18709 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:55.491534 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.212173 18824 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.945945 16458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.062s	sys 0.109s
W20260709 12:24:56.214232 16458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.065s	sys 0.111s
I20260709 12:24:56.215181 18709 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.215664 18571 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:55.432116 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.216218 18571 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.216602 15909 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
W20260709 12:24:56.217000 18687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.354s	user 0.063s	sys 0.077s
I20260709 12:24:56.217664 18802 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:55.485081 18808 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.218253 18571 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.218820 15907 raft_consensus.cc:2393] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:56.218647 18808 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:55.407527 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:56.220249 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 812779us
I20260709 12:24:56.220340 18677 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:55.410204 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.220943 18677 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:55.606637 18715 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.222059 18715 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.222239 18677 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.222880 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:55.393471 18714 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.223934 18715 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:56.225205 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.225266 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:56.225673 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.226397 18822 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:56.226788 18802 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.227114 18822 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:56.227363 18802 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.228235 18822 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.229841 18802 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.220885 18808 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.233681 18571 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.236265 18571 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.239579 18571 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.226424 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.244992 15912 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:56.246224 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.247082 15912 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:56.247951 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:56.248323 15800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.003s
W20260709 12:24:56.248632 15800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.008s	sys 0.003s
I20260709 12:24:56.225234 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:55.810114 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 564) took 2024 ms. Trace:
W20260709 12:24:56.226523 16460 connection.cc:256] RPC call timeout handler was delayed by -1.3472725709998485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 12:24:56.248782 18756 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.248976 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:24:56.254673 16496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 563) took 2729 ms (client timeout 1584 ms). Trace:
W20260709 12:24:56.203907 15911 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.002s
I20260709 12:24:56.256717 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1093) took 2272 ms. Trace:
I20260709 12:24:56.264442 15908 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:56.276692 16486 rpcz_store.cc:276] 0709 12:24:53.786050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.787926 (+  1876us) service_pool.cc:224] Handling call
0709 12:24:55.809829 (+2021903us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b54007044d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:55.810033 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147675392}
I20260709 12:24:56.278641 15911 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:56.281549 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.282420 15911 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:24:56.278030 16460 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 2.109s (SENT) [suppressed 19 similar messages]
W20260709 12:24:55.508033 18819 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:24:55.540441 18816 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:24:56.276899 16496 rpcz_store.cc:269] 0709 12:24:53.524943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.525082 (+   139us) service_pool.cc:224] Handling call
0709 12:24:56.254470 (+2729388us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b5400660154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:56.254573 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189608704}
W20260709 12:24:55.434047 18810 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:24:55.708173 18817 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:24:56.278771 15981 rpcz_store.cc:276] 0709 12:24:53.983954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.984141 (+   187us) service_pool.cc:224] Handling call
0709 12:24:54.192149 (+208008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.324254 (+132105us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:54.461915 (+137661us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.536750 (+ 74835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.536816 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:54.536882 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.255262 (+1718380us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18003e51e0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419
0709 12:24:56.256481 (+  1219us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003156d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:56.256521 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.256634 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":526,"prepare.queue_time_us":351582,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":632,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":40735,"spinlock_wait_cycles":353935104,"thread_start_us":211258,"threads_started":2,"wal-append.queue_time_us":180499,"wal-append.run_cpu_time_us":1107,"wal-append.run_wall_time_us":1001135}
I20260709 12:24:56.292111 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.284117 18823 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:55.449261 18740 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.286783 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.287011 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:55.516295 18731 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.277223 18714 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.277971 18715 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:56.293315 16460 connection.cc:256] RPC call timeout handler was delayed by -1.0908254299997679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 12:24:56.294695 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.264973 18808 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.296677 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.297406 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.297142 18823 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:56.299666 18674 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.001s
I20260709 12:24:56.300287 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2479) took 1722 ms. Trace:
I20260709 12:24:56.284165 18821 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.212834 18824 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.303031 18736 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.301812 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.296670 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.302953 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.303593 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.304517 16495 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:56.313874 15908 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:56.306720 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.307534 15836 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:56.309723 15905 rpcz_store.cc:276] 0709 12:24:54.577600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.744811 (+167211us) service_pool.cc:224] Handling call
0709 12:24:54.802220 (+ 57409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.802533 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.802558 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.806772 (+  4214us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.368227 (+561455us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:55.368263 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.368326 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.299987 (+931661us) raft_consensus.cc:1685] finished
0709 12:24:56.300012 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.300219 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2946,"raft.queue_time_us":93,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3906,"thread_start_us":513640,"threads_started":1,"wal-append.queue_time_us":642236}
W20260709 12:24:56.309458 18640 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.254s	user 0.011s	sys 0.001s
I20260709 12:24:56.317101 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.318274 15905 raft_consensus.cc:2410] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:56.318637 15912 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:56.290701 18756 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.314030 16490 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:56.310781 18808 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.322715 18638 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.322247 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.323635 15911 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:24:56.324088 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:56.319667 18687 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.325189 18826 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.327823 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.328414 15908 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:56.330654 18823 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.320070 18802 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.308082 18715 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.331948 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.332387 15911 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:56.333563 18824 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.317224 18674 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.321885 18571 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.311437 18714 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.339418 18731 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.339859 18714 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.336678 15905 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:56.335297 15911 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:56.342024 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2487) took 1756 ms. Trace:
I20260709 12:24:56.343258 18808 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.342415 15913 rpcz_store.cc:276] 0709 12:24:54.585722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.744380 (+158658us) service_pool.cc:224] Handling call
0709 12:24:54.744662 (+   282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:54.761368 (+ 16706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.761398 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:54.769083 (+  7685us) log.cc:844] Serialized 52 byte log entry
0709 12:24:54.932838 (+163755us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:54.932875 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.933000 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.341818 (+1408818us) raft_consensus.cc:1685] finished
0709 12:24:56.341839 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.341966 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16346,"raft.queue_time_us":47179,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":158041,"threads_started":1,"wal-append.queue_time_us":321676}
I20260709 12:24:56.317651 18736 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.348467 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:56.349134 15913 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.350116 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.328997 18740 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.354377 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.355274 15981 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:24:56.354416 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1100) took 2049 ms. Trace:
W20260709 12:24:56.356236 15802 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.258s (SENT)
I20260709 12:24:56.356580 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.356707 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.357288 15981 raft_consensus.cc:2393] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:56.341476 18571 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.356254 15980 rpcz_store.cc:276] 0709 12:24:54.305554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.349894 (+2044340us) service_pool.cc:224] Handling call
0709 12:24:56.354345 (+  4451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:56.315145 18821 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.359948 15988 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:56.362365 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.362934 15908 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:56.327742 18638 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.331445 18802 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.364404 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.366317 15905 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:24:56.366464 15802 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.733s (SENT)
I20260709 12:24:56.336896 18687 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.361378 15911 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:56.371062 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.372212 15913 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:24:56.374358 15911 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.341938 18674 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.377674 18675 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:56.378166 18675 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.378991 18674 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.379520 18674 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.332154 18826 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.379957 18674 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.362162 18808 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.383462 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.383839 15982 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.384081 15908 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:56.385865 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.386415 15988 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
W20260709 12:24:56.387490 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.389189 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.360169 18740 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.392274 18515 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.392338 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.392611 18736 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.393263 15909 raft_consensus.cc:2410] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:24:56.395800 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.396435 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.400041 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.400264 15908 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:56.380019 18675 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.397768 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.398921 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:56.400744 16486 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:56.398044 18826 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.403291 16493 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:56.404563 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1164) took 1027 ms. Trace:
I20260709 12:24:56.404922 15909 rpcz_store.cc:276] 0709 12:24:55.377677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.217340 (+839663us) service_pool.cc:224] Handling call
0709 12:24:56.392205 (+174865us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:56.404503 (+ 12298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75983232}
I20260709 12:24:56.407591 15982 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:56.409054 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:56.411991 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45553.8us
W20260709 12:24:56.412577 15802 leader_election.cc:336] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.866s (SENT)
I20260709 12:24:56.412914 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.414835 15908 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:56.416946 15803 connection.cc:256] RPC call timeout handler was delayed by -2.0921078729998044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:24:56.417542 15803 connection.cc:256] RPC call timeout handler was delayed by -2.0921078729998044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:24:56.417892 15803 connection.cc:256] RPC call timeout handler was delayed by -1.6716275170001609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
W20260709 12:24:56.418192 15803 connection.cc:256] RPC call timeout handler was delayed by -1.6605964479999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2505s for a response
W20260709 12:24:56.418480 15803 connection.cc:256] RPC call timeout handler was delayed by -1.6050275170000532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:24:56.418748 15803 connection.cc:256] RPC call timeout handler was delayed by -1.5575078729998495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 12:24:56.419713 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.420609 16495 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:56.420575 16486 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:56.422830 15911 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:56.423362 15911 pending_rounds.cc:85] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 4
I20260709 12:24:56.423569 15911 pending_rounds.cc:107] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:56.423794 15911 raft_consensus.cc:2889] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:56.426726 15909 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 12:24:56.429025 16495 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:24:56.432013 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.434346 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1163) took 1053 ms. Trace:
I20260709 12:24:56.434746 15911 rpcz_store.cc:276] 0709 12:24:55.377312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.324221 (+946909us) service_pool.cc:224] Handling call
0709 12:24:56.332290 (+  8069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.424194 (+ 91904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.424349 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:56.435704 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.436283 15911 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:56.485391 16495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
W20260709 12:24:56.490272 15803 connection.cc:256] RPC call timeout handler was delayed by -1.2175375029996758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:24:56.490676 15803 connection.cc:256] RPC call timeout handler was delayed by -1.214856332999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:24:56.490948 15803 connection.cc:256] RPC call timeout handler was delayed by -1.0767673059999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:24:56.491223 15803 connection.cc:256] RPC call timeout handler was delayed by -1.0767673059999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 12:24:56.492035 18709 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.414050 18675 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:24:56.495411 15802 connection.cc:256] RPC call timeout handler was delayed by -1.9164357159997962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2514s for a response
W20260709 12:24:56.495857 15802 connection.cc:256] RPC call timeout handler was delayed by -1.8871478650003155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 12:24:56.425763 18731 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:56.498193 15876 connection.cc:256] RPC call timeout handler was delayed by -2.3208137209999222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:24:56.499738 15876 connection.cc:256] RPC call timeout handler was delayed by -2.0247137209998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 12:24:56.499482 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:24:56.500896 15876 connection.cc:256] RPC call timeout handler was delayed by -2.0157137209998837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
I20260709 12:24:56.441568 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.441243 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.492550 18709 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.500543 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:56.505530 16495 raft_consensus.cc:606] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.508335 16495 raft_consensus.cc:614] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:56.490231 18824 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:56.501518 15876 connection.cc:256] RPC call timeout handler was delayed by -1.9806137209998269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 12:24:56.507844 16459 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:56.512485 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1145) took 1410 ms. Trace:
I20260709 12:24:56.512790 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:56.513576 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:24:56.512828 15906 rpcz_store.cc:276] 0709 12:24:55.101772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.101936 (+   164us) service_pool.cc:224] Handling call
0709 12:24:56.512329 (+1410393us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540029a754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:56.512431 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240337280}
W20260709 12:24:56.511920 15876 connection.cc:256] RPC call timeout handler was delayed by -1.9104137209997134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 12:24:56.517285 15876 connection.cc:256] RPC call timeout handler was delayed by -1.8870137209996756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:24:56.518146 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.519214 15908 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:56.499032 18826 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.498968 18515 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.501088 18756 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:56.520179 15876 connection.cc:256] RPC call timeout handler was delayed by -1.868113720999645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 12:24:56.522670 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.525183 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.525907 18834 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:56.526432 15802 leader_election.cc:336] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.059s (SENT)
I20260709 12:24:56.526850 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.527696 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.527936 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.528493 18803 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.528707 15988 raft_consensus.cc:2410] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:56.529114 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.529851 18803 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.529982 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.530411 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.531126 18803 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.531499 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.531985 18803 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:56.532677 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.532991 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.533438 18834 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:56.520918 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.533941 18834 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:56.533928 15988 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:24:56.534998 18834 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.536346 15988 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.500880 18715 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.537261 15953 leader_election.cc:400] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:56.539700 15953 leader_election.cc:403] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:56.505266 18833 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.540354 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:56.540741 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49050.5us
I20260709 12:24:56.496888 18675 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.512176 18822 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.542555 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.521747 18640 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:56.509964 16493 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:56.524494 18584 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:56.523598 18737 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:56.550639 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.559376 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.558809 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.560134 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.557642 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.538527 18832 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.568102 18832 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.570534 18832 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.571247 15988 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.538318 18838 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.572005 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.543569 18715 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.542353 18833 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.555154 18822 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.566156 15981 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:24:56.586913 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.591177 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.594348 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.603921 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.604485 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.605564 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.596387 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.606383 15985 raft_consensus.cc:2376] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8. Re-sending same reply.
I20260709 12:24:56.556982 18823 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.607589 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.608208 15983 raft_consensus.cc:2376] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8. Re-sending same reply.
I20260709 12:24:56.520016 18824 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.601258 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.537461 18826 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.546195 18731 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.537616 18515 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.560959 18584 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:56.611289 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 69925.6us
I20260709 12:24:56.611706 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.612082 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.630234 15985 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.612967 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.614109 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.607551 18823 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.565289 18687 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.576694 18737 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.621747 18756 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:56.629914 18803 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:56.642567 18677 raft_consensus.cc:2764] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:56.604840 18833 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.657573 18677 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:56.660167 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2482) took 2081 ms. Trace:
I20260709 12:24:56.660537 15904 rpcz_store.cc:276] 0709 12:24:54.578434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.734295 (+155861us) service_pool.cc:224] Handling call
0709 12:24:54.745866 (+ 11571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.755266 (+  9400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.755290 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.755324 (+    34us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.755357 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.659961 (+1904604us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b5400073d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:56.660002 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.660110 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21205888}
I20260709 12:24:56.619226 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.661857 15981 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:56.662312 18824 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.609552 18822 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.645835 18731 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.665208 18740 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.666280 18731 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.630472 18715 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.667197 18821 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.615064 15987 raft_consensus.cc:2376] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9. Re-sending same reply.
I20260709 12:24:56.648154 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.669772 15983 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:56.651356 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:56.653708 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 73506.6us
I20260709 12:24:56.649444 15985 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:56.670984 15979 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:24:56.638761 15988 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:56.602861 18571 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.599385 18802 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.641266 18584 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.598460 18841 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.609091 18838 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.708490 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.701951 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.706424 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.646911 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.713217 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.714824 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.715088 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.715659 15985 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:56.717259 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.719277 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.721282 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.721832 15988 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:56.723292 15985 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:56.653307 18823 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.656311 18674 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.710115 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:56.710577 16489 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:24:56.653651 18714 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.654985 18737 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.739187 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.739686 18709 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.653254 18826 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.740317 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.647243 18515 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.646550 18675 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.655290 18756 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:56.741855 18756 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.745267 18849 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.745348 18737 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.745877 18849 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.747920 18849 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.704648 18824 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:24:56.738304 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.750620 15913 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:56.750873 18838 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.733529 18841 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.704355 18687 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6.
I20260709 12:24:56.707942 18829 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:24:56.753026 18841 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.753377 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2604) took 2260 ms. Trace:
I20260709 12:24:56.753726 15838 rpcz_store.cc:276] 0709 12:24:54.492927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.496654 (+  3727us) service_pool.cc:224] Handling call
0709 12:24:54.534805 (+ 38151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.559513 (+ 24708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.559555 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.560063 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:24:56.503553 (+1943490us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18003717a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:24:56.602250 (+ 98697us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:56.602289 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.602410 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.753100 (+150690us) raft_consensus.cc:1685] finished
0709 12:24:56.753119 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.753324 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25114,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":15486,"spinlock_wait_cycles":3073792,"thread_start_us":98523,"threads_started":1,"wal-append.queue_time_us":2151028}
I20260709 12:24:56.730706 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.748827 18833 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.761572 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.762645 15907 raft_consensus.cc:2410] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:56.763016 18833 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.763099 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1165) took 1385 ms. Trace:
I20260709 12:24:56.763669 15907 rpcz_store.cc:276] 0709 12:24:55.377959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.219392 (+841433us) service_pool.cc:224] Handling call
0709 12:24:56.761379 (+541987us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:56.763036 (+  1657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13128064}
W20260709 12:24:56.765353 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 55289.9us
I20260709 12:24:56.768137 16486 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:56.773900 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:56.775094 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 230727us
I20260709 12:24:56.775228 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:56.705754 18839 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:56.779985 15986 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 498) took 2857 ms (client timeout 2120 ms). Trace:
W20260709 12:24:56.780385 15986 rpcz_store.cc:269] 0709 12:24:53.916474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.916804 (+   330us) service_pool.cc:224] Handling call
0709 12:24:56.773486 (+2856682us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54001b8354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:56.773626 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284182272}
I20260709 12:24:56.794212 18669 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.799774 18638 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.781167 18709 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.779500 18839 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:56.805552 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.776759 18831 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:56.811596 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 101094us
I20260709 12:24:56.781353 18846 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.814086 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:56.778434 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.782044 18571 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:56.834965 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 56632.3us
I20260709 12:24:56.836450 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.836980 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.837785 15830 raft_consensus.cc:2410] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:24:56.836406 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:56.838739 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.839362 15837 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
W20260709 12:24:56.777899 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 254443us
I20260709 12:24:56.779296 18714 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.843108 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.844143 15835 raft_consensus.cc:2410] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:56.845896 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.840505 18858 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.846554 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:56.847129 15836 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.840708 18756 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.846985 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.848420 15832 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:56.849056 18756 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:56.842605 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.849418 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.849961 15829 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:24:56.781598 18845 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:24:56.846848 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.851758 15838 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.851536 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.852154 15831 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:56.853438 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.853952 15831 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:56.811645 18575 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:56.857789 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.858340 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.856662 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:56.838433 18715 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:24:56.811363 18839 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:56.858697 15802 connection.cc:256] RPC call timeout handler was delayed by -1.4574357159999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3024s for a response
I20260709 12:24:56.868906 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:56.869145 15802 connection.cc:256] RPC call timeout handler was delayed by -1.4322357159999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3052s for a response
W20260709 12:24:56.869462 15802 connection.cc:256] RPC call timeout handler was delayed by -1.3088633799998206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3173s for a response
W20260709 12:24:56.869731 15802 connection.cc:256] RPC call timeout handler was delayed by -1.1645586939998793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:24:56.869992 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0286586940001143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 12:24:56.859983 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.870379 15905 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:56.871979 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.863142 15836 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:56.863427 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.872661 15905 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:56.835017 18846 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:56.873816 18846 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.874519 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.876438 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.877101 15913 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:56.878759 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.879647 15913 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:56.867036 15953 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.870283 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.881625 15910 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:56.861819 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.882138 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.882666 15912 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:56.883782 15913 raft_consensus.cc:2393] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:56.884951 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 270937us
I20260709 12:24:56.886195 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.887562 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.887655 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.888247 15911 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:24:56.888304 15838 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:56.864069 18837 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:24:56.890501 18715 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.891031 18715 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.893282 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:56.893150 18822 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.893659 18866 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:56.893904 15907 raft_consensus.cc:2376] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6. Re-sending same reply.
I20260709 12:24:56.894163 18866 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:56.895222 18822 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.845157 18571 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:56.896122 18866 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.896320 18571 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.889266 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:56.897889 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.886979 15913 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:56.840335 18640 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:56.896651 18866 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:56.906805 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:56.857846 18858 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.867945 18831 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:56.915012 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.917796 15836 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:56.897286 18731 raft_consensus.cc:2764] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:56.886411 18308 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:56.919013 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:56.919400 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.924814 15838 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:56.924768 15904 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:56.926129 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.927330 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.928364 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.928891 15986 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:24:56.929750 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.930877 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.932425 15981 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.934916 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.936409 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.939406 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.942334 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.901974 18862 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:56.943120 15984 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:56.943420 18862 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.943934 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.944667 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.923090 18308 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.945779 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.946317 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.946909 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.947459 15836 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:24:56.922963 18584 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:56.948269 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.948822 15838 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 2.
I20260709 12:24:56.949625 18584 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:56.949707 18715 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:56.951288 15984 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:56.949684 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.959144 15832 raft_consensus.cc:2410] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:56.955957 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:56.959793 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.959416 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.960371 15834 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:24:56.960471 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:56.960846 15836 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
W20260709 12:24:56.961225 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 89514.9us
I20260709 12:24:56.957888 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.962787 15986 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:56.962692 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.964138 15831 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:24:56.857594 18824 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:24:56.886639 18638 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:24:56.967664 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.968413 15835 raft_consensus.cc:2410] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:56.965317 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.966858 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.923786 18831 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.969868 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:56.979089 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 75389.1us
I20260709 12:24:56.969512 15979 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:56.962767 15802 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:56.980165 15830 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:56.978958 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.980743 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:56.981993 15879 connection.cc:256] RPC call timeout handler was delayed by -1.4946194260000993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 12:24:56.982407 15879 connection.cc:256] RPC call timeout handler was delayed by -1.4457776829999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 12:24:56.985769 15838 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:56.958201 18849 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:56.923614 18736 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:56.988296 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:24:56.988579 15879 connection.cc:256] RPC call timeout handler was delayed by -1.346880365999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:24:56.988986 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.996320 15979 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:56.997048 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.997707 15835 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:24:56.979373 18858 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:57.022547 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.999859 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:57.046226 15830 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:24:56.970438 18709 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.017947 18675 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:24:56.967163 18853 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:24:57.040714 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.054260 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.055349 15876 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:57.056360 15984 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:57.000921 15838 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 2.
W20260709 12:24:57.037533 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53309us
I20260709 12:24:57.057698 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.037659 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.038792 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:57.059021 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.039768 15834 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:57.059841 18821 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:57.041440 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:56.982643 18831 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.060650 15836 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
W20260709 12:24:57.061357 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 148421us
I20260709 12:24:57.065447 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:57.066357 18870 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:57.066769 18870 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.067092 18870 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.068092 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.995942 18808 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.042533 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:56.954231 18859 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.048544 18714 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:57.049261 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.051476 15835 raft_consensus.cc:2410] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:57.000010 18669 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:57.060251 18821 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.082358 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:57.084324 15831 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:57.043381 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.065377 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:56.993942 18849 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:57.093420 18821 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.093807 18849 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.095023 18849 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.995601 18584 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 12:24:57.092515 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 55008.6us
I20260709 12:24:57.070809 18808 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:57.098994 18808 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.067888 18638 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:24:57.101578 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.014s	sys 0.000s
I20260709 12:24:57.101461 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.071772 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.071053 18851 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.102789 18851 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.102954 18575 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.103204 18851 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.068176 18856 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.075678 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:57.045717 18858 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.109952 18858 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.111156 18308 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:57.113619 18832 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.114002 18832 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:57.114334 18846 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.114856 18832 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.115998 18832 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.116479 18846 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:57.090794 18669 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:57.119397 18669 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.120576 18669 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.122071 16496 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.092578 16495 raft_consensus.cc:2410] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:57.073839 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 464) took 3589 ms. Trace:
I20260709 12:24:57.123606 16488 rpcz_store.cc:276] 0709 12:24:53.484422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.495271 (+ 10849us) service_pool.cc:224] Handling call
0709 12:24:53.495670 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.498447 (+  2777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.498482 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.345749 (+2847267us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18003a0300. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a
0709 12:24:56.791198 (+445449us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b2c0009bf18. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:24:56.791799 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:24:56.886220 (+ 94421us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:56.886270 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.886552 (+   282us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.073649 (+187097us) raft_consensus.cc:1685] finished
0709 12:24:57.073668 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.073785 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2406,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3807,"spinlock_wait_cycles":16774784,"thread_start_us":94012,"threads_started":1,"wal-append.queue_time_us":203232}
I20260709 12:24:57.078209 18860 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:57.101888 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.000s
W20260709 12:24:57.138625 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 625056us
I20260709 12:24:57.069468 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:57.140065 16459 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.072194 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.141326 15984 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:24:57.141855 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.071200 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:57.143296 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72182.7us
I20260709 12:24:57.070225 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.108850 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.075968 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:57.125905 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:57.126595 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:57.146711 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.147253 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.148756 15830 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:57.149802 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 80402.7us
I20260709 12:24:57.091805 18841 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:57.151345 18871 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:57.153095 18846 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.153501 18846 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:57.153852 18846 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.077081 18862 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:57.159422 18858 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.160827 18515 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.125316 18856 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:57.161476 18856 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.162635 18515 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.105942 18834 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.082944 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:57.165880 16490 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:24:57.166875 16486 raft_consensus.cc:2368] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:57.020211 18640 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.167963 15879 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.169230 18826 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.170092 18803 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.170465 18803 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:57.170849 18803 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.137735 18823 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.175143 18823 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:57.175923 16494 raft_consensus.cc:2368] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:57.180006 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:57.144321 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.182251 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:57.182934 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:57.183837 15953 leader_election.cc:400] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:57.184098 15953 leader_election.cc:403] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:57.185844 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.086678 18859 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:57.187294 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:57.187907 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 117744us
I20260709 12:24:57.188774 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.192637 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.191783 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:57.193642 15986 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.191095 16496 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.197672 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.198871 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:57.201682 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 316032us
I20260709 12:24:57.204193 15986 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:57.192790 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:57.208091 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:57.211340 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.215471 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:57.216256 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.216692 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:57.217336 18308 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:57.217842 18308 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:57.218761 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.218609 18308 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.186371 18823 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.221323 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.190975 18861 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.236720 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.190310 18826 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.192199 18834 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:57.187183 18845 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.245096 15984 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:24:57.247316 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.125438 18839 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:57.248047 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:57.249444 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 50631us
I20260709 12:24:57.250147 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.246454 18826 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:57.261963 18826 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:57.262522 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 52960.2us
I20260709 12:24:57.245137 18715 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.250684 18866 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.199374 18802 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.221450 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:57.190310 18859 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.245997 18845 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.190549 18875 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.279724 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:57.280063 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 65276us
I20260709 12:24:57.280791 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.280754 15952 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:57.265026 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 58750.2us
I20260709 12:24:57.271987 18826 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:57.220161 18855 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.273138 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:57.203317 18862 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.203389 18809 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.203110 18575 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.285225 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:57.191814 18714 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:24:57.285820 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 67125.6us
I20260709 12:24:57.285836 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:57.294940 15910 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.288151 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.287388 15983 raft_consensus.cc:2376] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8. Re-sending same reply.
I20260709 12:24:57.244335 18861 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.203536 18822 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:24:57.246362 18731 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.251343 18824 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.296758 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:57.315758 15907 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.297119 15987 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.215101 18841 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:24:57.299091 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:57.298159 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.319160 15984 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:24:57.298614 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:57.320143 15913 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:24:57.286469 18709 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.304808 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:57.245221 18736 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:24:57.241587 18838 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:24:57.306077 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 113501us
I20260709 12:24:57.307060 18861 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.286823 18845 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.298254 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:57.327426 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.329854 15911 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.330349 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.331104 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.303277 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:57.286186 18858 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:57.291667 18853 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.284132 18834 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:57.290735 18675 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.291158 18855 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:57.290009 18809 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:57.289443 18882 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.293798 18687 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.306401 18802 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.314380 15910 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:57.357501 15911 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:24:57.315176 18731 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:57.336148 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.315212 18674 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:57.336436 18853 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.333731 15907 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:57.352172 18882 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:57.347482 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:57.316493 18715 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:24:57.349767 18675 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.352638 18855 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:57.365995 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 71331.3us
I20260709 12:24:57.352370 18809 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.328788 18808 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:57.354446 18802 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:57.347222 18575 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:57.358875 18731 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.362854 18853 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.357965 18885 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:57.388212 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.391503 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.347095 18863 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:57.365553 18879 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:57.362545 18882 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.373939 18675 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:57.405486 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74459.8us
I20260709 12:24:57.406754 15832 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:57.408478 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:24:57.387835 18802 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:57.490950 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 99503.1us
I20260709 12:24:57.397446 18885 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:57.405821 18879 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:57.495919 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:58.070670 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 574806us
I20260709 12:24:58.071456 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.071787 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:58.022727 15980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.002s
W20260709 12:24:58.072686 15980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.008s	sys 0.003s
W20260709 12:24:57.826252 18883 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.450s	user 0.001s	sys 0.000s
I20260709 12:24:58.073179 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:58.010106 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:58.074188 16487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661598743dad4055844a0b0f97c07156"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
W20260709 12:24:57.690735 18831 consensus_meta.cc:287] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.630s	user 0.005s	sys 0.004s
I20260709 12:24:58.077239 18831 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.078092 15911 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:58.079393 18831 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.053422 18900 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:57.489162 18834 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.080721 18900 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:58.081180 18900 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:58.050354 18851 consensus_meta.cc:287] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.947s	user 0.008s	sys 0.003s
I20260709 12:24:58.083405 18851 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:58.084872 18846 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.931s	user 0.008s	sys 0.000s
I20260709 12:24:58.085394 18846 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.086172 18851 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:24:58.060343 18849 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.965s	user 0.008s	sys 0.000s
I20260709 12:24:58.087831 15985 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:24:58.079450 15910 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:58.091043 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.088481 18846 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:57.998530 16486 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:58.022006 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:57.772085 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.110510 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
W20260709 12:24:57.497272 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 158809us
I20260709 12:24:57.998106 16488 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:58.111510 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:58.113191 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:57.501336 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:58.114836 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.116894 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:24:58.023010 15879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.005s	sys 0.005s
W20260709 12:24:58.117796 15879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.005s	sys 0.006s
W20260709 12:24:58.118158 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 842170us
W20260709 12:24:57.524103 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 115691us
I20260709 12:24:58.032910 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:58.119458 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.122807 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:58.125790 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 54417.8us
I20260709 12:24:58.126880 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:58.127813 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:24:58.064031 18832 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.948s	user 0.010s	sys 0.001s
I20260709 12:24:58.132017 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1124) took 1079 ms. Trace:
W20260709 12:24:58.022641 18669 consensus_meta.cc:287] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.902s	user 0.008s	sys 0.002s
W20260709 12:24:58.114940 18860 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.963s	user 0.005s	sys 0.006s
I20260709 12:24:57.526065 18826 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.026665 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:58.149803 18866 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.862s	user 0.009s	sys 0.000s
I20260709 12:24:58.170688 18866 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:58.039367 18895 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:24:57.746074 18888 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.109203 18879 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.134653 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:24:57.827020 18884 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.337s	user 0.000s	sys 0.000s
W20260709 12:24:58.026520 18823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.000s	sys 0.009s
I20260709 12:24:57.833122 18893 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:58.030228 18856 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.008s
I20260709 12:24:57.482118 18863 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:24:58.120980 18803 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.950s	user 0.006s	sys 0.006s
I20260709 12:24:58.209249 18824 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:58.209321 18803 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.210575 15910 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.130018 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:58.211717 18845 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.005s
I20260709 12:24:58.124161 18736 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.212226 18736 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.212144 18845 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.212829 18736 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.830506 18808 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:58.188735 18823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.001s	sys 0.010s
I20260709 12:24:58.214058 18808 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.214514 18808 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.214910 18808 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.143114 18876 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.537824 18714 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:58.006953 18870 consensus_meta.cc:287] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.939s	user 0.005s	sys 0.013s
W20260709 12:24:58.219012 18855 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.004s
I20260709 12:24:58.218837 18870 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.219446 18855 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.220400 16487 raft_consensus.cc:606] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:58.220784 16487 raft_consensus.cc:614] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:58.136493 16496 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:58.173861 18866 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.221598 18855 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:58.221912 18866 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.222360 18866 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.175854 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:58.225697 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 49921us
I20260709 12:24:58.227613 15879 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:57.545902 18892 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.228281 18892 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:58.140980 18864 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 1.092s	user 0.008s	sys 0.010s
I20260709 12:24:58.123188 18885 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:58.169633 18821 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.076s	user 0.006s	sys 0.011s
I20260709 12:24:58.136575 18846 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:58.129297 18515 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:24:58.148475 18861 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.803s	user 0.001s	sys 0.007s
W20260709 12:24:58.142808 18859 consensus_meta.cc:287] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.001s
I20260709 12:24:58.182442 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:58.182672 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:58.183553 15908 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:58.184657 15906 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:58.186866 18903 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:58.155550 18809 consensus_meta.cc:287] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.000s
I20260709 12:24:58.177958 18905 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.190884 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:58.191319 18882 consensus_meta.cc:287] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.000s
I20260709 12:24:58.188680 18893 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:24:58.172369 18860 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:58.192819 18856 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.194199 18863 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.196270 18737 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:57.520144 18886 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.657s
W20260709 12:24:58.197196 18853 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.000s
W20260709 12:24:58.197564 18844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.018s	sys 0.034s
I20260709 12:24:58.177716 18826 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.202483 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:58.202906 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:58.203570 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:58.204227 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:24:58.205453 15733 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 279) took 19386 ms (client timeout 15000 ms). Trace:
I20260709 12:24:58.206497 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.208364 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 528) took 1098 ms. Trace:
I20260709 12:24:58.141243 18901 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.174399 18888 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:24:58.121258 18802 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.001s
I20260709 12:24:58.209843 18824 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:24:58.212340 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 82410us
I20260709 12:24:58.216718 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.227770 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1125) took 1182 ms. Trace:
I20260709 12:24:58.177546 15911 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:57.521505 18839 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:58.132581 15980 rpcz_store.cc:276] 0709 12:24:57.044174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.044578 (+   404us) service_pool.cc:224] Handling call
0709 12:24:57.044842 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.045159 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.045185 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.184056 (+138871us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b180041ba20. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a
0709 12:24:57.249231 (+ 65175us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b2c00013588. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:24:57.278121 (+ 28890us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.123486 (+845365us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:58.123543 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.123619 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.123679 (+    60us) raft_consensus.cc:1685] finished
0709 12:24:58.123698 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.123853 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3607,"raft.queue_time_us":6201,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":14092,"spinlock_wait_cycles":29446784,"thread_start_us":749499,"threads_started":1,"wal-append.queue_time_us":791894}
I20260709 12:24:58.228806 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.231066 16495 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:58.218853 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1130) took 1005 ms. Trace:
I20260709 12:24:57.930755 18731 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:58.151338 18675 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.004s
I20260709 12:24:58.229507 15835 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:58.350069 16494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 743) took 1917 ms (client timeout 1803 ms). Trace:
I20260709 12:24:58.238104 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:58.413614 15987 rpcz_store.cc:276] 0709 12:24:57.046978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.048567 (+  1589us) service_pool.cc:224] Handling call
0709 12:24:57.048850 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.316774 (+267924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.227552 (+910778us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54001b8d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:58.227715 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565458304}
I20260709 12:24:58.228683 18892 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.409605 15985 rpcz_store.cc:276] 0709 12:24:57.213135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.215997 (+  2862us) service_pool.cc:224] Handling call
0709 12:24:58.218672 (+1002675us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54002c5954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:58.218771 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003004160}
I20260709 12:24:58.408689 15981 rpcz_store.cc:276] 0709 12:24:57.109489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.125551 (+ 16062us) service_pool.cc:224] Handling call
0709 12:24:57.125844 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:57.126219 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:57.190543 (+ 64324us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.316691 (+126148us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:57.321506 (+  4815us) log.cc:844] Serialized 52 byte log entry
0709 12:24:57.321711 (+   205us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:57.322848 (+  1137us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.325938 (+  3090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.326037 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.208173 (+882136us) raft_consensus.cc:1685] finished
0709 12:24:58.208190 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.208313 (+   123us) inbound_call.cc:177] Queueing success response
0709 12:24:58.221676 (+ 13363us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003f45a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
Metrics: {"mutex_wait_us":2803,"prepare.queue_time_us":64293,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":80,"raft.queue_time_us":15530,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":32832,"spinlock_wait_cycles":5853440,"thread_start_us":96830,"threads_started":1,"wal-append.queue_time_us":166600}
I20260709 12:24:58.418247 15910 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
W20260709 12:24:58.401927 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 275129us
I20260709 12:24:58.409678 15838 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.293601 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:58.423413 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:58.411198 15829 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.256887 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:58.360358 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 615) took 1380 ms. Trace:
I20260709 12:24:58.354415 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.412370 15834 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.287586 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:24:58.414445 15907 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:58.414908 15979 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.409518 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:24:58.239866 18875 consensus_meta.cc:287] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.942s	user 0.005s	sys 0.013s
I20260709 12:24:58.423940 15910 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:58.409371 18844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.019s	sys 0.040s
I20260709 12:24:58.471527 15832 rpcz_store.cc:276] 0709 12:24:56.980123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.980255 (+   132us) service_pool.cc:224] Handling call
0709 12:24:56.994613 (+ 14358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.408300 (+413687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.353013 (+944713us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54001266d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:58.360299 (+  7286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947455744}
I20260709 12:24:58.479602 15831 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:58.488328 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 77363.1us
I20260709 12:24:58.424014 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.484475 15829 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
W20260709 12:24:58.501847 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.518955 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 95081.2us
I20260709 12:24:58.470867 15982 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:58.442649 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72302.9us
W20260709 12:24:58.516433 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 405007us
I20260709 12:24:58.520205 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:58.410135 15733 rpcz_store.cc:269] 0709 12:24:38.818951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.819185 (+   234us) service_pool.cc:224] Handling call
0709 12:24:58.205359 (+19386174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:52.493418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:52.494090 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:52.494148 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:24:52.494169 (+    21us) tablet.cc:662] Decoding operations
0709 12:24:52.495334 (+  1165us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:52.495410 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:52.495444 (+    34us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:24:52.496663 (+  1219us) tablet.cc:701] Row locks acquired
0709 12:24:52.496709 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:24:52.496881 (+   172us) write_op.cc:270] Start()
0709 12:24:52.497027 (+   146us) write_op.cc:276] Timestamp: P: 1783599892496812 usec, L: 0
0709 12:24:52.512784 (+ 15757us) op_driver.cc:348] REPLICATION: starting
0709 12:24:52.675934 (+163150us) log.cc:844] Serialized 5054 byte log entry
0709 12:24:53.336547 (+660613us) op_driver.cc:464] REPLICATION: finished
0709 12:24:53.450841 (+114294us) write_op.cc:301] APPLY: starting
0709 12:24:53.451078 (+   237us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:53.451893 (+   815us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:53.452013 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:53.475936 (+ 23923us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:53.476280 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:24:53.476330 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:53.476735 (+   405us) log.cc:844] Serialized 89 byte log entry
0709 12:24:53.476933 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.477103 (+   170us) write_op.cc:454] Released schema lock
0709 12:24:53.477176 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:53.477585 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.477619 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":728619,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":114014,"apply.run_cpu_time_us":3867,"apply.run_wall_time_us":26720,"num_ops":12,"prepare.queue_time_us":163840,"prepare.run_cpu_time_us":18990,"prepare.run_wall_time_us":398516,"raft.queue_time_us":355677,"raft.run_cpu_time_us":3790,"raft.run_wall_time_us":49523,"replication_time_us":822977,"thread_start_us":472664,"threads_started":4,"wal-append.queue_time_us":182088,"wal-append.run_cpu_time_us":11770,"wal-append.run_wall_time_us":1596950}]]}
I20260709 12:24:58.237515 18575 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.214521 18881 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.211730 18803 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:58.417876 16494 rpcz_store.cc:269] 0709 12:24:56.432780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.432925 (+   145us) service_pool.cc:224] Handling call
0709 12:24:56.701805 (+268880us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:24:58.349843 (+1648038us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54007044d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:58.349982 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093440000}
I20260709 12:24:58.239028 18870 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:58.357106 18904 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:24:58.293133 18905 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.334789 18845 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.409394 18737 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:58.532892 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:58.283844 18903 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:58.419059 18888 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.546459 15912 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:58.547078 15913 raft_consensus.cc:2368] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:58.479081 18731 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.554880 15909 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:58.408694 18826 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.479755 18837 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.482072 18860 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.421108 18802 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.484795 18875 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 4.
I20260709 12:24:58.293309 18809 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.548687 15838 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:58.592682 15834 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:58.256927 18861 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.564219 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.256302 18515 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:58.596377 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 367626us
I20260709 12:24:58.332330 18879 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.568564 18857 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.568748 18898 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.362119 18866 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.569528 18737 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.570465 18880 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.561836 18903 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.532344 18709 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.574563 15982 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:24:58.575881 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.631842 15985 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:58.580474 15910 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:24:58.632730 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:58.633311 15910 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.349602 18847 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.204s
I20260709 12:24:58.635332 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:58.364995 18885 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.228655 18900 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.585561 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:58.543901 18714 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:58.585942 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:24:58.646512 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60648.6us
I20260709 12:24:58.647228 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:24:58.590341 15981 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:58.419066 18882 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:58.575781 18833 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.010s	sys 0.027s
I20260709 12:24:58.475907 18736 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.308437 18846 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:58.552256 18905 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.249087 18821 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.526311 18858 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:24:58.649215 18833 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.010s	sys 0.027s
I20260709 12:24:58.284566 18859 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.575548 18845 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.444103 18675 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.480912 18808 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.571921 18674 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:24:58.571722 18881 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:58.557379 18584 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:24:58.623872 15905 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:24:58.624262 15876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.026s
I20260709 12:24:58.623812 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:58.711040 15876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.026s
I20260709 12:24:58.588490 18575 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.583392 18826 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.626469 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:58.602240 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:58.714810 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:58.593735 18838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.012s	sys 0.035s
I20260709 12:24:58.481572 18824 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.637473 15984 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:24:58.598685 18862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.243s	user 0.016s	sys 0.051s
I20260709 12:24:58.602568 18731 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.650008 15910 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:24:58.640050 18886 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:24:58.702781 18845 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:58.679809 15912 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:58.651286 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:58.686677 15907 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.418984 18853 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.645576 18737 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.728920 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.473866 18893 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.730446 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.730747 18893 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.631055 18709 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.625936 18860 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:24:58.645001 18870 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.630725 18880 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.709929 18669 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:58.629680 18898 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.639786 18868 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.733814 18845 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.671554 18715 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.645473 18831 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:58.590607 18837 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:58.711763 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 592345us
I20260709 12:24:58.763800 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.712746 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:58.645321 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:58.543444 18889 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:24:58.719200 15988 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:58.623687 18857 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.720609 15983 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:58.626132 18875 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:58.770292 18880 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.770103 18875 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.728856 18881 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.720762 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:24:58.773308 15910 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:58.723111 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48138.2us
I20260709 12:24:58.675777 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:58.725263 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 98853.1us
I20260709 12:24:58.671322 18714 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:24:58.718989 18862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.017s	sys 0.055s
W20260709 12:24:58.718713 18838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.013s	sys 0.036s
I20260709 12:24:58.712484 18575 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.720842 18887 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:58.697293 15986 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:58.752993 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:58.736800 18709 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.699244 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:24:58.757058 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 508) took 1474 ms (client timeout 1580 ms). Trace:
I20260709 12:24:58.710469 18674 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.765014 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.772920 18875 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.763197 18715 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:24:58.785177 18831 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:58.791913 18882 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.767329 15979 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:24:58.789280 18575 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.749347 18731 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.818199 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:58.774222 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.783700 15910 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:24:58.736060 18687 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:58.785852 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:58.758556 18868 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.770646 18808 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.752213 18856 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.731778 18876 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:24:58.770103 18515 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.822173 18802 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.844048 18715 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.792217 18809 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.765326 15909 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.982026 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:58.982816 16492 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:24:58.983883 18908 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:58.984321 18908 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.984762 18908 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.800774 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:24:58.795177 18909 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:24:58.985538 15982 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:24:58.788705 18887 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:58.986479 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.986755 18887 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.987653 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.988255 18887 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.752100 18870 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.988739 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:58.990273 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:24:58.856904 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 157756us
I20260709 12:24:58.969141 18866 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:58.847084 15904 rpcz_store.cc:269] 0709 12:24:57.282758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.284161 (+  1403us) service_pool.cc:224] Handling call
0709 12:24:58.751328 (+1467167us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54004213d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:58.756962 (+  5634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935082240}
I20260709 12:24:58.993759 18853 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.993980 15904 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:58.867864 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.995658 15910 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:58.996206 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:24:58.996806 15981 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:58.869622 18925 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.006s
I20260709 12:24:58.869784 18822 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.869666 18674 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:58.791375 18914 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:58.871320 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 106379us
I20260709 12:24:59.022064 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.872617 15979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:24:59.023806 15979 raft_consensus.cc:606] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:58.761339 18846 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.874415 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:58.768455 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45999.6us
I20260709 12:24:58.833228 18920 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:58.882994 18917 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:24:58.884138 18584 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:59.035506 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:24:58.888073 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1142) took 1633 ms. Trace:
I20260709 12:24:58.888464 18879 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.889362 18860 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.991818 18859 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.890137 18839 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:58.897332 18837 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.898207 18861 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.899048 18736 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:58.899946 18885 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.900755 18821 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:24:58.901849 18900 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.903578 18831 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:58.905717 18714 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.907250 18898 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:24:58.909163 18675 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:24:58.911113 15985 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:59.058583 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:24:58.911953 18857 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:58.901850 15988 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 531) took 1776 ms (client timeout 1616 ms). Trace:
I20260709 12:24:58.840637 18638 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:24:58.806377 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:24:59.032613 18822 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:59.070866 15984 raft_consensus.cc:2410] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:58.846074 18921 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:24:58.873704 15980 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:24:58.919866 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 145709us
W20260709 12:24:58.957405 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 171627us
I20260709 12:24:58.951778 18731 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:58.958982 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:24:58.962811 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:24:59.075855 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 116959us
W20260709 12:24:59.076170 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 113447us
I20260709 12:24:59.076725 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:59.077862 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:58.967815 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:58.970857 15986 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:58.874890 18882 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.894038 18826 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:58.970255 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:58.977281 18923 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:24:58.979786 18808 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:58.990789 18870 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:58.795841 18911 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:24:59.002897 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:59.128245 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:59.129639 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:59.003798 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:24:59.131368 15831 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:59.070246 18876 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.966540 18868 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.015017 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:59.025804 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:59.031493 15910 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.033603 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:24:59.037246 15983 rpcz_store.cc:276] 0709 12:24:57.254702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.367144 (+112442us) service_pool.cc:224] Handling call
0709 12:24:57.386953 (+ 19809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.768218 (+1381265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.887746 (+119528us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003151d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:24:58.887996 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3063848704}
I20260709 12:24:58.986703 15731 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 4 to 6, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:24:59.041603 16457 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:24:59.059262 15982 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:59.059782 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.035957 18709 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:59.065505 15981 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:59.023028 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:24:59.068456 15988 rpcz_store.cc:269] 0709 12:24:57.124994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.125694 (+   700us) service_pool.cc:224] Handling call
0709 12:24:58.901666 (+1775972us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400139054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:24:58.901787 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3608416128}
I20260709 12:24:59.081130 18731 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.039565 18839 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:24:59.040596 18737 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:59.083737 15952 leader_election.cc:400] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:24:59.035235 18584 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:24:59.092417 16487 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.040685 18833 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:24:59.057199 18837 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.111984 18677 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.124790 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:24:59.125012 18928 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:24:59.125617 18913 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.127245 18923 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:59.007592 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:58.999702 15987 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:24:59.135449 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:24:59.041064 18687 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:24:59.066952 18640 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:24:59.048096 15909 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:24:59.065444 18860 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:24:59.091737 18714 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:24:59.185173 15837 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:00.072417 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1143) took 1955 ms. Trace:
I20260709 12:25:00.079226 15980 rpcz_store.cc:276] 0709 12:24:58.117171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.527857 (+410686us) service_pool.cc:224] Handling call
0709 12:24:58.813128 (+285271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.080807 (+267679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.072164 (+991357us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400205b50. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:00.072342 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655236864}
I20260709 12:25:00.074467 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:24:59.759675 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:24:59.759160 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 733361us
I20260709 12:25:00.080920 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 576) took 1074 ms. Trace:
I20260709 12:25:00.082589 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:00.082445 16486 rpcz_store.cc:276] 0709 12:24:59.006036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.006154 (+   118us) service_pool.cc:224] Handling call
0709 12:25:00.074287 (+1068133us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:25:00.080777 (+  6490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22346112}
I20260709 12:25:00.083451 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1675) took 1127 ms. Trace:
I20260709 12:25:00.081207 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 580) took 1064 ms. Trace:
I20260709 12:25:00.083851 15981 rpcz_store.cc:276] 0709 12:24:58.955868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.995940 (+ 40072us) service_pool.cc:224] Handling call
0709 12:25:00.083397 (+1087457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.084159 16494 rpcz_store.cc:276] 0709 12:24:59.017075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.083389 (+ 66314us) service_pool.cc:224] Handling call
0709 12:25:00.081141 (+997752us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.084770 15912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.007s	sys 0.012s
W20260709 12:25:00.084892 15909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 524) took 1456 ms (client timeout 1760 ms). Trace:
I20260709 12:24:59.758697 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 541) took 1396 ms. Trace:
W20260709 12:25:00.086135 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 1.00148e+06us
I20260709 12:24:59.094365 18912 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:00.086103 15982 rpcz_store.cc:276] 0709 12:24:58.362786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.034149 (+671363us) service_pool.cc:224] Handling call
0709 12:24:59.059101 (+ 24952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.141849 (+ 82748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.758609 (+616760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.112147 18808 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.151214 15906 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.114907 18675 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:59.114018 18900 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.088713 15952 leader_election.cc:403] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:59.091571 18898 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:00.088773 15836 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:00.088881 15981 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:59.736503 15908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.002s	sys 0.013s
W20260709 12:25:00.087073 15909 rpcz_store.cc:269] 0709 12:24:58.635208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.698482 (+ 63274us) service_pool.cc:224] Handling call
0709 12:25:00.084836 (+1386354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.090902 18920 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:59.951416 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.21738e+06us
I20260709 12:24:59.531555 15831 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:24:59.759093 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 681273us
W20260709 12:24:59.838084 18575 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.872s	user 0.007s	sys 0.002s
W20260709 12:24:59.876768 15979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.006s	sys 0.024s
W20260709 12:25:00.085371 15912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.008s	sys 0.012s
W20260709 12:25:00.157788 15979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.006s	sys 0.028s
I20260709 12:24:59.957531 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43658 (request call id 88) took 1472 ms. Trace:
W20260709 12:24:59.527820 15950 leader_election.cc:336] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.595s (SENT)
I20260709 12:25:00.158325 15985 rpcz_store.cc:276] 0709 12:24:58.477598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.125315 (+647717us) service_pool.cc:224] Handling call
0709 12:24:59.949781 (+824466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.202847 18851 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:59.162961 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 121423us
I20260709 12:25:00.119051 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 646) took 1084 ms. Trace:
I20260709 12:25:00.160163 15834 rpcz_store.cc:276] 0709 12:24:59.005203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.007302 (+  2099us) service_pool.cc:224] Handling call
0709 12:25:00.089630 (+1082328us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.160897 15908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.003s	sys 0.018s
W20260709 12:24:59.742414 15904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.016s	sys 0.014s
W20260709 12:25:00.054541 18903 consensus_meta.cc:287] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.414s	user 0.010s	sys 0.000s
W20260709 12:24:59.961241 18892 consensus_meta.cc:287] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.437s	user 0.010s	sys 0.001s
I20260709 12:25:00.119477 18808 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.131891 16490 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:59.720876 18925 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 12:25:00.122557 16489 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:59.838588 18888 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.270s	user 0.007s	sys 0.003s
W20260709 12:25:00.052861 18887 consensus_meta.cc:287] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.064s	user 0.004s	sys 0.004s
I20260709 12:25:00.146819 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1148) took 1596 ms. Trace:
I20260709 12:25:00.172621 15986 rpcz_store.cc:276] 0709 12:24:58.550310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.087226 (+1536916us) service_pool.cc:224] Handling call
0709 12:25:00.146185 (+ 58959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.146386 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.146423 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.146481 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:00.146533 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.146617 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.146752 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.155485 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:00.155603 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.156173 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 645) took 1155 ms. Trace:
I20260709 12:25:00.028630 18826 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.046087 18889 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.418686 18674 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.158839 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 631017us
W20260709 12:25:00.091815 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2504) took 1798 ms (client timeout 1919 ms). Trace:
I20260709 12:25:00.180313 18826 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.180773 18839 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.181190 18826 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.182068 18839 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.183930 18826 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.184594 18826 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.169417 18892 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.185140 18889 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.186048 18737 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:00.186550 18737 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.186998 18892 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.187530 18892 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.187933 18892 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:24:59.150754 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:00.178701 18920 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:00.188998 18920 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:00.189559 18920 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:00.180447 15905 rpcz_store.cc:269] 0709 12:24:58.293176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.293315 (+   139us) service_pool.cc:224] Handling call
0709 12:25:00.091632 (+1798317us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540010cf54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:00.091760 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408581376}
I20260709 12:25:00.188898 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 579) took 1181 ms. Trace:
I20260709 12:25:00.194474 15905 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:00.195168 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 528) took 1462 ms. Trace:
I20260709 12:25:00.195588 15905 rpcz_store.cc:276] 0709 12:24:58.732964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.194038 (+1461074us) service_pool.cc:224] Handling call
0709 12:25:00.194316 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.194874 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.195102 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.822114 18881 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:00.179102 18888 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.180826 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.201243 15907 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:59.577977 18822 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:24:59.861941 18845 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.086s	user 0.010s	sys 0.001s
W20260709 12:25:00.161592 15904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.017s	sys 0.019s
I20260709 12:25:00.145744 18837 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.206215 18923 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:00.206627 18837 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:00.206956 18923 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5.
I20260709 12:25:00.200467 16493 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:00.209219 18860 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.209988 18860 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:00.210525 18860 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:00.211603 18860 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.175963 18929 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:00.217432 15980 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:00.218205 18929 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:00.218667 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.178369 18898 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:00.222098 18893 consensus_meta.cc:287] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.491s	user 0.006s	sys 0.006s
I20260709 12:25:00.222743 18893 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.222860 18898 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.223323 18893 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.161837 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 542) took 1786 ms. Trace:
I20260709 12:25:00.158202 18900 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.164505 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2612) took 1079 ms. Trace:
I20260709 12:25:00.257608 15836 rpcz_store.cc:276] 0709 12:24:59.085452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.088011 (+  2559us) service_pool.cc:224] Handling call
0709 12:25:00.164442 (+1076431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.161837 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1669) took 1534 ms. Trace:
I20260709 12:25:00.258647 15981 rpcz_store.cc:276] 0709 12:24:58.627220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.088456 (+1461236us) service_pool.cc:224] Handling call
0709 12:25:00.088727 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.161630 (+ 72903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.161787 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.092976 18912 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:00.166091 15909 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:00.260215 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2521) took 1539 ms. Trace:
I20260709 12:25:00.260710 15909 rpcz_store.cc:276] 0709 12:24:58.720729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.163009 (+1442280us) service_pool.cc:224] Handling call
0709 12:25:00.165920 (+  2911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.259892 (+ 93972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.260146 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:59.263247 18886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.033s
W20260709 12:24:59.837625 18905 consensus_meta.cc:287] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.149s	user 0.010s	sys 0.000s
I20260709 12:24:59.162688 18879 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:00.169780 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:00.124297 18914 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.353534 18736 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:00.173952 15837 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:00.275647 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2620) took 1082 ms. Trace:
I20260709 12:25:00.275964 15837 rpcz_store.cc:276] 0709 12:24:59.193745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.093458 (+899713us) service_pool.cc:224] Handling call
0709 12:25:00.275592 (+182134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:59.697932 15731 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 3 to 4, leader changed from <none> to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 4 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:00.173741 15831 rpcz_store.cc:276] 0709 12:24:59.000689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.003498 (+  2809us) service_pool.cc:224] Handling call
0709 12:25:00.156114 (+1152616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.171084 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2608) took 1099 ms. Trace:
I20260709 12:25:00.085860 18913 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:24:59.162451 18916 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:00.188090 18889 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:24:59.260749 18917 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:25:00.194089 16495 rpcz_store.cc:276] 0709 12:24:59.007106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.150518 (+143412us) service_pool.cc:224] Handling call
0709 12:25:00.188838 (+1038320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.188743 18737 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:24:59.839900 18715 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.000s
I20260709 12:25:00.163586 18575 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.229816 15979 rpcz_store.cc:276] 0709 12:24:58.375623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.057453 (+681830us) service_pool.cc:224] Handling call
0709 12:24:59.057722 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.057899 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:59.084035 (+ 26136us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.161565 (+1077530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.161609 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:00.161652 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.161698 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.161781 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3290,"prepare.queue_time_us":32191,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":49090,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":1073953,"threads_started":1,"wal-append.queue_time_us":1128932}
I20260709 12:24:59.391942 18908 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.168040 18903 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.272917 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:00.273623 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.277138 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2518) took 1573 ms. Trace:
I20260709 12:25:00.277177 15833 rpcz_store.cc:276] 0709 12:24:59.072195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.074391 (+  2196us) service_pool.cc:224] Handling call
0709 12:24:59.074774 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.075036 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:59.757145 (+682109us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.170645 (+413500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.170692 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:00.170745 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.170810 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.170911 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":681659,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":37,"raft.queue_time_us":47244,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":413214,"threads_started":1}
I20260709 12:25:00.279595 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:00.269882 18886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.518s	user 0.023s	sys 0.044s
I20260709 12:25:00.218703 18929 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:00.216985 16490 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:00.289680 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.304342 15837 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:00.284950 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.200736 18826 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.281656 18913 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.200977 18674 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.301828 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:00.302107 15834 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:00.280455 18677 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:00.303409 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.271638 18887 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:00.204139 18881 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.312609 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 635) took 2075 ms. Trace:
I20260709 12:25:00.324306 15911 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:00.266490 18845 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.317262 18893 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:00.319546 18868 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.134s	user 0.006s	sys 0.001s
I20260709 12:25:00.334440 18868 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.336529 18868 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.320372 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.338323 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.338582 15829 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:00.339635 15834 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:00.339775 18934 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:00.340209 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2615) took 1253 ms. Trace:
I20260709 12:25:00.271855 18905 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.340911 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2513) took 1661 ms. Trace:
I20260709 12:25:00.342607 15838 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:00.342788 18905 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.324477 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.344509 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2618) took 1210 ms. Trace:
I20260709 12:25:00.344832 15831 rpcz_store.cc:276] 0709 12:24:59.138358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.343819 (+1205461us) service_pool.cc:224] Handling call
0709 12:25:00.344059 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.344215 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.344237 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.344277 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:00.344309 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.344355 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.344460 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.346050 15831 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.346541 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2621) took 1110 ms. Trace:
I20260709 12:25:00.346835 15831 rpcz_store.cc:276] 0709 12:24:59.235862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.345658 (+1109796us) service_pool.cc:224] Handling call
0709 12:25:00.345896 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.346348 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.346497 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.347875 15831 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.324435 15830 rpcz_store.cc:276] 0709 12:24:58.237280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.237401 (+   121us) service_pool.cc:224] Handling call
0709 12:24:58.239020 (+  1619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.239350 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.239379 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.257119 (+ 17740us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.650298 (+393179us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:58.721441 (+ 71143us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.745971 (+ 24530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.746038 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.310687 (+1564649us) raft_consensus.cc:1685] finished
0709 12:25:00.310712 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.312561 (+  1849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4145,"prepare.queue_time_us":137816,"prepare.run_cpu_time_us":209,"prepare.run_wall_time_us":12174,"raft.queue_time_us":34022,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":56809,"thread_start_us":264305,"threads_started":3,"wal-append.queue_time_us":412388}
I20260709 12:25:00.329584 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.351191 15837 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:00.351241 18888 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.330358 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:00.333958 18845 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.341475 15904 rpcz_store.cc:276] 0709 12:24:58.679278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.994820 (+315542us) service_pool.cc:224] Handling call
0709 12:24:58.995154 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.999741 (+  4587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.999770 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.000177 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.204690 (+1204513us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:00.204746 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.204839 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.340663 (+135824us) raft_consensus.cc:1685] finished
0709 12:25:00.340692 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.340839 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4196,"raft.queue_time_us":19839,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":1188901,"threads_started":1,"wal-append.queue_time_us":1259144}
I20260709 12:25:00.340553 15834 rpcz_store.cc:276] 0709 12:24:59.086437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.339160 (+1252723us) service_pool.cc:224] Handling call
0709 12:25:00.339477 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.339992 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.340153 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:00.357309 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 274782us
I20260709 12:25:00.357941 15834 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.358057 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:00.310931 18889 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:00.315135 18886 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.360436 15834 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:00.282295 18736 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.374109 15837 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:00.322435 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.348865 15831 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:00.416711 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:00.280967 18914 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:00.415295 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56010.1us
I20260709 12:25:00.418174 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:00.418493 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.419078 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.33541e+06us
I20260709 12:25:00.420060 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2619) took 1265 ms. Trace:
I20260709 12:25:00.420428 15833 rpcz_store.cc:276] 0709 12:24:59.154599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.322135 (+1167536us) service_pool.cc:224] Handling call
0709 12:25:00.420004 (+ 97869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.421460 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:00.422489 18737 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:00.320477 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 759) took 1359 ms. Trace:
I20260709 12:25:00.293401 18715 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.319844 18674 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:00.423799 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 262651us
I20260709 12:25:00.338272 18903 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.319700 18731 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.403882 18888 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:00.428864 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.430722 16496 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.425755 16490 rpcz_store.cc:276] 0709 12:24:58.955148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.966928 (+ 11780us) service_pool.cc:224] Handling call
0709 12:25:00.314626 (+1347698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.428141 18929 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.428108 18923 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.433390 18881 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.315433 18920 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.424429 18893 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:00.434394 18736 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.434912 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2520) took 1715 ms. Trace:
I20260709 12:25:00.430039 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:00.485082 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 55114.8us
I20260709 12:25:00.437114 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2519) took 1722 ms. Trace:
I20260709 12:25:00.473300 15731 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 1 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:25:00.679570 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.568264 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2627) took 1052 ms. Trace:
W20260709 12:25:00.681057 15803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.024s
W20260709 12:25:00.681684 15803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.016s	sys 0.024s
I20260709 12:25:00.681428 15830 rpcz_store.cc:276] 0709 12:24:59.515347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.349547 (+834200us) service_pool.cc:224] Handling call
0709 12:25:00.349874 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.350046 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:00.460867 (+110821us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.567663 (+106796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.567741 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:00.567842 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.567968 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.568178 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":288648,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":25214,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5739,"thread_start_us":178220,"threads_started":2,"wal-append.queue_time_us":169403}
I20260709 12:25:00.683923 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:00.684974 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:00.555069 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:00.687212 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:00.687959 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 155882us
I20260709 12:25:00.688731 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:00.562259 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.691491 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2609) took 1618 ms. Trace:
I20260709 12:25:00.691944 15832 rpcz_store.cc:276] 0709 12:24:59.072503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.072646 (+   143us) service_pool.cc:224] Handling call
0709 12:24:59.112798 (+ 40152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.124666 (+1011868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.124710 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.125252 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.418510 (+293258us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:00.418575 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.418653 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.690945 (+272292us) raft_consensus.cc:1685] finished
0709 12:25:00.690996 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.691297 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1011386,"raft.queue_time_us":1049538,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":3207,"thread_start_us":240699,"threads_started":1,"wal-append.queue_time_us":274540}
I20260709 12:25:00.529253 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.530786 15834 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:00.559209 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 118510us
I20260709 12:25:00.695588 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:00.696632 15837 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:00.528837 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:00.698676 15879 leader_election.cc:336] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 1.837s (SENT)
I20260709 12:25:00.699222 15836 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:00.699414 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:00.472798 15835 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:00.557205 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:00.707134 15905 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:00.531327 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:00.483477 15907 rpcz_store.cc:276] 0709 12:24:58.719387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.089545 (+1370158us) service_pool.cc:224] Handling call
0709 12:25:00.148313 (+ 58768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.201727 (+ 53414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.434686 (+232959us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b5400420ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.434852 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121294080}
I20260709 12:25:00.709126 15979 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:00.709687 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:00.710446 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:00.711472 15907 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:00.711578 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:00.565519 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.623404 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:00.445580 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 265603us
I20260709 12:25:00.711503 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:00.714339 15985 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:00.714718 15904 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:00.623859 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:00.716818 15982 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:00.568671 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.714735 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.530784 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:00.727320 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 196466us
I20260709 12:25:00.728243 18943 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:00.728466 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:00.530784 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:00.723875 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:00.723609 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:00.729931 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:00.530594 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:00.742273 15905 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:00.466054 16495 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:00.531467 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:00.743856 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 60288.7us
I20260709 12:25:00.744136 16494 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:00.568747 18640 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.516291 18675 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:00.745383 15985 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.746210 18952 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.747047 18675 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.747294 18952 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.423457 18709 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.625224 18575 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.749529 18845 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:00.750020 18709 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:00.597393 18715 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.750950 18845 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:00.532204 18736 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:25:00.751487 18845 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:00.752796 18736 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.429082 18737 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:00.755501 18960 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:00.756060 18960 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:00.756587 18737 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.757498 18960 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.620869 18826 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.760200 18826 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.422192 18839 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:25:00.745390 18640 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.301206 15910 rpcz_store.cc:276] 0709 12:24:58.703582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.150461 (+446879us) service_pool.cc:224] Handling call
0709 12:24:59.759513 (+609052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.759761 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:00.055530 (+295769us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.276473 (+220943us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.276689 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.276749 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:00.276822 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.276906 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.277056 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":309084,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":37856,"raft.run_wall_time_us":1646,"spinlock_wait_cycles":2036096,"thread_start_us":506489,"threads_started":2}
I20260709 12:25:00.770314 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:00.771467 18640 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.431617 18851 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:00.753661 18736 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.774037 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1665) took 2154 ms. Trace:
I20260709 12:25:00.774642 18851 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.775887 18736 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:00.776252 15987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1667) took 2150 ms (client timeout 1837 ms). Trace:
I20260709 12:25:00.424139 18886 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:00.777614 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 58161.4us
I20260709 12:25:00.779629 18886 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.779757 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1672) took 2105 ms. Trace:
I20260709 12:25:00.482205 18888 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.570811 18892 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.616623 18893 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:00.807957 18893 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.563980 18898 consensus_queue.cc:1059] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:00.579036 18900 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.529735 18903 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.638180 18908 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:00.916988 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 189074us
I20260709 12:25:00.300122 18912 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.928829 18912 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.435981 18913 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.931761 18839 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:25:00.933867 18913 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:00.934736 18941 consensus_queue.cc:1175] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:00.629132 18914 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.467180 18923 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.937240 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:00.937651 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.938293 18855 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:00.938709 18923 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:00.939152 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.646953 18920 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.941161 18687 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:00.941617 18687 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.521133 18929 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:00.596712 18940 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:25:00.437767 18942 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:00.968152 18942 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:00.968494 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2507) took 2548 ms. Trace:
I20260709 12:25:00.584154 18944 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.588888 18949 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:00.968684 18903 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.647501 18955 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.637761 18962 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.889050 18886 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:25:00.649596 18967 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:00.712889 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:00.563069 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 82207.8us
I20260709 12:25:01.019744 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.020535 15981 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.729074 18961 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.729466 18966 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:01.021220 18822 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:01.021807 18961 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:01.021984 18966 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.023497 18889 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:00.728763 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:01.023907 18889 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:00.739661 18860 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:00.740123 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 642) took 1740 ms. Trace:
I20260709 12:25:00.741703 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2613) took 1655 ms. Trace:
I20260709 12:25:01.024710 18860 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.025177 18889 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:00.742400 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:01.026384 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.026605 18889 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.027303 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:00.630887 18731 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.759251 18960 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.750494 18575 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:01.029263 18967 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.029676 18575 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.031597 18967 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:00.489179 15908 rpcz_store.cc:276] 0709 12:24:58.714442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.149270 (+434828us) service_pool.cc:224] Handling call
0709 12:24:59.149554 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.149764 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:00.161292 (+1011528us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.436319 (+275027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.436367 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:00.436864 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.436929 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.437028 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12505,"prepare.queue_time_us":893521,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":19848,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":28019,"thread_start_us":1273401,"threads_started":2,"wal-append.queue_time_us":281984}
I20260709 12:25:00.766004 18826 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.780117 18808 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.011s
I20260709 12:25:00.782491 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:00.786057 18876 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:00.797468 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 754) took 2417 ms. Trace:
W20260709 12:25:00.798799 16493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 758) took 1846 ms (client timeout 1765 ms). Trace:
I20260709 12:25:00.780318 18674 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:25:00.800323 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 755) took 2420 ms. Trace:
I20260709 12:25:00.806447 18892 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:00.774487 15980 rpcz_store.cc:276] 0709 12:24:58.619942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.087222 (+1467280us) service_pool.cc:224] Handling call
0709 12:25:00.087507 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.217843 (+130336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.773440 (+555597us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400012cd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.773780 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297934720}
I20260709 12:25:00.752981 18845 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:00.776676 15987 rpcz_store.cc:269] 0709 12:24:58.625402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.713206 (+ 87804us) service_pool.cc:224] Handling call
0709 12:24:58.818017 (+104811us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:25:00.775870 (+1957853us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54002f62d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:00.776039 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198930432}
I20260709 12:25:00.780320 15988 rpcz_store.cc:276] 0709 12:24:58.673832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.093138 (+1419306us) service_pool.cc:224] Handling call
0709 12:25:00.093507 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.151529 (+ 58022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.151588 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.151642 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:00.151683 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.779289 (+627606us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b54002c6354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.779360 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.779572 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132914048}
I20260709 12:25:00.910849 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:00.811108 18946 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.891672 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 193280us
I20260709 12:25:00.949438 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:00.892238 18833 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:00.941985 18687 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:00.894233 15950 leader_election.cc:336] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.562s (SENT)
I20260709 12:25:00.896129 18875 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:00.798805 18952 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:00.938719 18855 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.893815 18866 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:00.971287 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:00.971827 15904 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:25:00.969627 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:00.978561 15985 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:00.897156 18861 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:00.968930 15906 rpcz_store.cc:276] 0709 12:24:58.419480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.419824 (+   344us) service_pool.cc:224] Handling call
0709 12:24:58.420122 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.118275 (+1698153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.967970 (+849695us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400112e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.968268 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680863616}
I20260709 12:25:00.880250 18943 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.968730 18942 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.973493 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:00.807071 18584 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.009466 15910 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:01.010998 18962 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.017271 18955 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:00.735603 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 577) took 1729 ms. Trace:
I20260709 12:25:01.025331 15838 rpcz_store.cc:276] 0709 12:24:59.085800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.130643 (+ 44843us) service_pool.cc:224] Handling call
0709 12:24:59.130928 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.342990 (+1212062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.741170 (+398180us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000901d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.741517 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786224384}
I20260709 12:25:00.787335 18888 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.020610 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:01.170796 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 442211us
I20260709 12:25:01.172137 16457 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:01.083303 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2610) took 2010 ms. Trace:
I20260709 12:25:01.167085 16489 rpcz_store.cc:276] 0709 12:24:59.006349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.148897 (+142548us) service_pool.cc:224] Handling call
0709 12:24:59.757124 (+608227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.175861 (+418737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.734139 (+558278us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400494154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.735275 (+  1136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839956864}
I20260709 12:25:01.167599 16496 rpcz_store.cc:276] 0709 12:24:58.380127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.380368 (+   241us) service_pool.cc:224] Handling call
0709 12:24:58.380712 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.441681 (+2060969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.799833 (+358152us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400522954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.800150 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4714109184}
I20260709 12:25:01.025206 15829 rpcz_store.cc:276] 0709 12:24:58.999631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.000862 (+  1231us) service_pool.cc:224] Handling call
0709 12:24:59.001153 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.338921 (+1337768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.739624 (+400703us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400126bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.739958 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075405696}
I20260709 12:25:01.172825 18903 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.197817 18584 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.201288 18898 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.201759 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.203078 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.203814 15984 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:01.204679 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.205627 15836 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.209775 18939 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:01.210316 18924 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:01.210460 18939 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:01.210780 18924 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:01.211491 18894 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:01.211968 18894 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:01.211802 18939 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.204656 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.167896 16487 rpcz_store.cc:276] 0709 12:24:58.379795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.380260 (+   465us) service_pool.cc:224] Handling call
0709 12:24:58.482551 (+102291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.084514 (+1601963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.796919 (+712405us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400660154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:00.797269 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401962240}
I20260709 12:25:01.179123 15835 rpcz_store.cc:276] 0709 12:24:59.072846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.072989 (+   143us) service_pool.cc:224] Handling call
0709 12:24:59.073264 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.700333 (+1627069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.082894 (+382561us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400136ad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:01.083130 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3218270080}
W20260709 12:25:01.086373 18979 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:01.220542 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.222276 15907 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:01.222880 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.186550 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.168285 18861 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.175040 18855 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.083446 18837 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:01.167680 18833 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:01.235357 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.174773 18875 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.240406 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.179152 18923 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:01.184156 18808 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.031733 18575 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.184278 18826 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.247100 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:01.247917 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.243774 18837 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.248783 18731 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:01.278102 18731 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.279647 18808 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.280427 18731 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.211968 18924 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.281162 18837 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.282280 18924 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:01.283170 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 262882us
W20260709 12:25:01.251132 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 71616.7us
I20260709 12:25:01.284895 18640 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:01.251742 18822 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:01.181146 18876 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.243760 18952 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.279654 15984 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.289484 18952 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.290632 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.292055 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.292403 18952 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.247504 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:01.266443 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 296865us
W20260709 12:25:01.272643 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 299313us
I20260709 12:25:01.296115 15832 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:01.311168 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.296368 15835 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:01.298370 15837 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:01.299649 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.306651 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.307318 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.267334 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.277969 18946 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.307372 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 543) took 2593 ms. Trace:
I20260709 12:25:01.304865 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.294983 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2511) took 2671 ms. Trace:
I20260709 12:25:01.329200 15910 raft_consensus.cc:2410] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:01.301681 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.301183 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:01.292995 15984 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.306540 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.341684 15904 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:01.308452 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.299038 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.261286 18923 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.344621 15834 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.168115 18866 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:01.348717 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.349323 15908 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:01.168248 16493 rpcz_store.cc:269] 0709 12:24:58.952760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.969934 (+ 17174us) service_pool.cc:224] Handling call
0709 12:25:00.798402 (+1828468us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540039c1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:00.798573 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245013888}
I20260709 12:25:01.077479 18944 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.293548 18961 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:01.348757 15982 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.308171 18845 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.307281 18677 raft_consensus.cc:3055] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.293637 18886 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:01.356390 15905 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.366369 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.371801 15981 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:01.373008 18677 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:01.340545 18860 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:01.328074 15983 rpcz_store.cc:276] 0709 12:24:58.713664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.092683 (+1379019us) service_pool.cc:224] Handling call
0709 12:25:00.092931 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.435292 (+342361us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:00.572695 (+137403us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.880114 (+307419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.888236 (+  8122us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:00.888366 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.306921 (+418555us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000942d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:01.306968 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.307177 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187843,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":583,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"spinlock_wait_cycles":783098240,"thread_start_us":351544,"threads_started":2,"wal-append.queue_time_us":387316}
I20260709 12:25:01.328316 15912 rpcz_store.cc:276] 0709 12:24:58.623717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.774032 (+150315us) service_pool.cc:224] Handling call
0709 12:24:58.774332 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:59.058441 (+284109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.058470 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:59.069747 (+ 11277us) log.cc:844] Serialized 52 byte log entry
0709 12:25:00.158135 (+1088388us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:00.158190 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.294330 (+1136140us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400153bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:01.294402 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.294472 (+    70us) raft_consensus.cc:1685] finished
0709 12:25:01.294485 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.294793 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8879,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":14893,"spinlock_wait_cycles":652568832,"thread_start_us":995091,"threads_started":1,"wal-append.queue_time_us":1197271}
I20260709 12:25:01.301821 18949 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:01.383996 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.340888 18893 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:01.389467 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.299937 18846 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:25:01.221405 18894 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.367559 18640 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:01.302488 18833 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.307495 18876 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.367105 18961 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:01.386209 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.392686 18983 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:01.367179 18575 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.422637 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.418052 16492 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:01.418169 15913 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:01.420141 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.375089 18886 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:01.447613 15983 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:01.413494 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:01.463632 18976 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:25:01.465885 18916 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.505052 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 762) took 2476 ms. Trace:
I20260709 12:25:01.420481 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.421391 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.413820 15831 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:01.468492 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.469494 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 575489us
I20260709 12:25:01.470611 18966 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:01.471616 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.413189 15911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2505) took 3069 ms (client timeout 1776 ms). Trace:
I20260709 12:25:01.473935 18640 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.421636 18949 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.467172 18833 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.485890 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:01.486758 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.419553 18985 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:01.488107 18923 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.397464 18677 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.419678 18946 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.491034 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.412837 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.502287 18575 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.504508 18916 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.467823 15906 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:01.542338 15983 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:01.506326 16492 rpcz_store.cc:276] 0709 12:24:59.001147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.001293 (+   146us) service_pool.cc:224] Handling call
0709 12:25:00.102640 (+1101347us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:25:00.102825 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.475575 (+1372750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.477743 (+  2168us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002baf54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:01.477968 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957765248}
I20260709 12:25:01.417536 18861 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.522703 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.543825 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.529487 15830 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:25:01.396920 18944 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.476090 18959 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:01.532107 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:01.533028 15911 rpcz_store.cc:269] 0709 12:24:58.309958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.409253 (+ 99295us) service_pool.cc:224] Handling call
0709 12:25:01.327733 (+2918480us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b540029a254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:01.378885 (+ 51152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4265140096}
I20260709 12:25:01.487087 18826 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.427572 18955 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:01.448086 18983 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:01.541432 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.544813 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.544224 15912 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.565074 15909 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:01.538934 15982 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:25:01.552789 15904 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:01.562893 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 77127.9us
I20260709 12:25:01.566366 15983 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:01.531504 18886 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:01.569957 15950 leader_election.cc:336] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.658s (SENT)
I20260709 12:25:01.570398 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:01.556761 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.557402 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:01.573395 15908 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.555840 18959 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.577488 15910 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:01.569670 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 268629us
I20260709 12:25:01.574235 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.405325 18875 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.574926 15982 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:01.398372 18866 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.579013 15830 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.569509 15980 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:01.580682 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.569798 18826 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:01.569880 18923 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.578150 18861 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.567260 18983 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.566944 18985 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.581079 18966 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:25:01.579460 18959 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.586337 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.590575 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.531451 18961 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.598017 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.600558 15909 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.601075 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.589469 18990 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.604770 18987 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:25:01.591424 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.593353 18575 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.606043 15982 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:01.609159 18826 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:01.609772 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44250.3us
I20260709 12:25:01.610551 18888 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:01.612144 18967 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:01.593618 18866 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:01.638628 15950 leader_election.cc:336] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.699s (SENT)
W20260709 12:25:01.614578 18929 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.003s
I20260709 12:25:01.591032 18875 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.617650 15980 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.623015 15910 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:01.630415 15905 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:01.632546 15911 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:01.632782 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.590770 18886 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.634382 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.635311 15904 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:01.600430 18960 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.642217 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2526) took 1080 ms. Trace:
I20260709 12:25:01.640650 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.639197 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:01.594471 18949 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:01.649747 18961 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.651307 18837 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.653436 15980 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:01.653523 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.654970 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.655449 18916 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.656086 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.656642 15911 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:01.656833 18986 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:01.657354 18986 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.642699 15905 rpcz_store.cc:276] 0709 12:25:00.562221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.811761 (+249540us) service_pool.cc:224] Handling call
0709 12:25:01.642162 (+830401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.647732 15982 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:01.648165 18967 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.644084 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:01.662438 15906 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 3: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:01.665143 15836 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.665582 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.667236 15830 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.667794 18990 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:01.669664 15950 leader_election.cc:336] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.822s (SENT)
I20260709 12:25:01.670128 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:01.670962 18736 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.672720 18826 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.677397 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:01.677670 18894 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.678856 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:01.679864 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:01.680285 15836 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 3.
I20260709 12:25:01.680555 16488 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:01.644055 18575 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.681866 16494 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:25:01.682941 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 522) took 3084 ms. Trace:
I20260709 12:25:01.683166 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.683408 15913 rpcz_store.cc:276] 0709 12:24:58.599140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.733407 (+134267us) service_pool.cc:224] Handling call
0709 12:25:01.355742 (+2622335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.475255 (+119513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.682712 (+207457us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b540029a250. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:01.682873 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5995316992}
I20260709 12:25:01.684448 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.664790 18986 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.685971 18984 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:01.686244 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:01.686731 18986 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.687652 18674 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:01.688057 18674 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:01.681528 18575 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.698765 15909 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:01.688107 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:01.684871 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.705251 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.706166 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.671594 18990 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:01.708746 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.697330 18941 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.703001 18984 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:01.715566 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.777585 15836 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.698489 18962 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.717864 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.696633 18943 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:01.718302 18575 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:01.721249 15913 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:01.721980 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.723507 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.725488 18674 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:01.730423 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2522) took 1172 ms. Trace:
I20260709 12:25:01.731503 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2527) took 1169 ms. Trace:
W20260709 12:25:01.734300 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.735215 18894 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:01.742837 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.743283 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.787453 15910 rpcz_store.cc:276] 0709 12:25:00.562526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.422264 (+859738us) service_pool.cc:224] Handling call
0709 12:25:01.731353 (+309089us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001969d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:01.731444 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267457792}
I20260709 12:25:01.788201 16486 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:01.743973 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.789098 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:01.779654 18941 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.750938 16487 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:01.781689 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:01.784163 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63507.6us
W20260709 12:25:01.784582 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.783550 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.786098 15831 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:01.786866 15907 rpcz_store.cc:276] 0709 12:25:00.558433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.712389 (+153956us) service_pool.cc:224] Handling call
0709 12:25:01.730253 (+1017864us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b54001536d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:01.730364 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63880448}
W20260709 12:25:01.774881 18687 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 12:25:01.752909 18675 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.750516 15912 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:01.795811 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.796344 15912 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.714576 18944 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:25:01.790201 16488 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:01.779402 18984 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.798794 15911 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.801647 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:01.801795 18898 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.003s
I20260709 12:25:01.803247 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.803499 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.804987 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.808565 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:01.809669 18982 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.555s	user 0.005s	sys 0.000s
W20260709 12:25:01.810278 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 122245us
I20260709 12:25:01.812140 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.813388 18674 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.815153 18967 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:01.816723 18942 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 12:25:01.783387 18846 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:25:01.753178 16490 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:01.797217 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:01.829286 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.665153 18985 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.833624 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 554) took 1092 ms. Trace:
W20260709 12:25:01.904451 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.843807 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:01.961264 15905 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.858780 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.895699 15836 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:01.896930 15984 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:01.842033 16492 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:01.865219 15829 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:01.961202 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.866055 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.837621 15912 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:01.880218 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.842500 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:01.964720 15906 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
W20260709 12:25:01.960417 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.965602 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.846444 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:01.961699 15910 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:01.963764 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.966710 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.967166 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.896082 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:01.967561 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.967967 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.967907 15908 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:01.859838 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.962271 16486 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:01.863463 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.963198 15829 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:01.866688 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:01.968998 15913 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:01.865659 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.964720 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.869163 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.863860 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.897469 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:01.887337 18941 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:01.827463 18687 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:01.994546 15905 raft_consensus.cc:2410] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:01.994897 15838 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.997061 18898 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.856493 18959 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:01.840701 18924 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.005s
I20260709 12:25:01.971655 18984 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.997983 15837 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.992776 15833 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:01.998406 15830 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:01.993625 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:01.999238 15907 raft_consensus.cc:2393] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:02.044672 15905 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:02.044780 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 202405us
I20260709 12:25:01.999984 15908 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:01.999801 15832 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:02.001016 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.045912 15836 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:02.001470 18990 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.003386 18991 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:02.004293 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.069949 15834 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:02.050369 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.071913 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.054729 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.056804 15838 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:02.061338 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.073945 15833 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:01.963696 15988 rpcz_store.cc:276] 0709 12:25:00.741413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.562859 (+821446us) service_pool.cc:224] Handling call
0709 12:25:01.574222 (+ 11363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.587321 (+ 13099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.587341 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.648775 (+ 61434us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.779922 (+131147us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:01.779964 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.780030 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.833325 (+ 53295us) raft_consensus.cc:1685] finished
0709 12:25:01.833353 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.833534 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605,"raft.queue_time_us":15762,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":27341,"thread_start_us":130733,"threads_started":1,"wal-append.queue_time_us":172267}
I20260709 12:25:02.023944 15904 raft_consensus.cc:2393] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:02.028649 15835 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:02.032223 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 223653us
I20260709 12:25:02.062928 15913 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:02.033541 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:02.075713 15909 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:02.063175 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:02.035987 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:01.895289 18677 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.859184 18929 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:01.859006 18845 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:01.843331 18894 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:01.844096 18876 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:02.002866 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.047636 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1202) took 1345 ms. Trace:
I20260709 12:25:01.847443 18966 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.024205 18967 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.090405 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:01.992460 18983 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:02.044369 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50869.6us
W20260709 12:25:02.065389 18855 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.005s
I20260709 12:25:02.062371 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.065150 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:02.078578 16496 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:02.065382 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.065649 15986 raft_consensus.cc:2368] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
I20260709 12:25:02.050110 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2524) took 1483 ms. Trace:
I20260709 12:25:02.116655 15905 rpcz_store.cc:276] 0709 12:25:00.561653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.034169 (+1472516us) service_pool.cc:224] Handling call
0709 12:25:02.044511 (+ 10342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.045129 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.045286 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.052150 15829 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.049139 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.080125 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.112226 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.118863 15838 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:02.056864 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 534) took 1558 ms. Trace:
I20260709 12:25:02.119606 15908 rpcz_store.cc:276] 0709 12:25:00.487070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.999395 (+1512325us) service_pool.cc:224] Handling call
0709 12:25:01.999772 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.045517 (+ 45745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.045680 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.068746 15911 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:02.115697 15837 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:02.121001 15911 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.977656 18889 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:25:02.081374 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2529) took 1512 ms. Trace:
I20260709 12:25:02.121722 15905 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:02.121872 15913 rpcz_store.cc:276] 0709 12:25:00.563564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.040420 (+1476856us) service_pool.cc:224] Handling call
0709 12:25:02.062749 (+ 22329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.075306 (+ 12557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.075466 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.082748 15831 raft_consensus.cc:2410] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:25:02.082617 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.123045 15830 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:02.085383 15907 rpcz_store.cc:276] 0709 12:25:00.702333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.797554 (+1095221us) service_pool.cc:224] Handling call
0709 12:25:02.047558 (+250004us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:02.089986 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.090178 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:01.971026 18942 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.048125 18923 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:02.093559 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.050202 18638 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:25:02.119390 15834 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:25:02.127779 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.123561 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.130336 18942 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.127043 15981 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.131870 15907 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:02.077840 18886 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.054489 18687 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.142884 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.145932 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.146628 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2531) took 1558 ms. Trace:
I20260709 12:25:02.147140 15905 rpcz_store.cc:276] 0709 12:25:00.564136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.117658 (+1553522us) service_pool.cc:224] Handling call
0709 12:25:02.118087 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.122300 (+  4213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.122511 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.149552 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2535) took 1094 ms. Trace:
I20260709 12:25:02.150187 15909 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:02.150853 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2537) took 1123 ms. Trace:
I20260709 12:25:02.151260 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:02.151605 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.152307 16489 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.083346 18986 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:02.081153 18894 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:02.154026 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:02.154901 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 89877.8us
I20260709 12:25:02.150004 15911 rpcz_store.cc:276] 0709 12:25:01.027080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.120596 (+1093516us) service_pool.cc:224] Handling call
0709 12:25:02.120857 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.121412 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.121623 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.158493 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.062029 18846 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:02.057870 18961 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:25:02.177830 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.176688 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.151144 15909 rpcz_store.cc:276] 0709 12:25:01.027659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.149649 (+1121990us) service_pool.cc:224] Handling call
0709 12:25:02.149957 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.150612 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.150798 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.165263 15838 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:02.185194 15829 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.185345 15832 raft_consensus.cc:2393] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:02.185701 15833 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:02.111977 18962 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:02.184727 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.187610 15904 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: [5.4-8.6]
I20260709 12:25:02.189590 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2530) took 1625 ms. Trace:
I20260709 12:25:02.191363 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.191996 15984 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:02.187286 16495 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:02.194080 16459 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:02.190011 15904 rpcz_store.cc:276] 0709 12:25:00.563853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.089212 (+1525359us) service_pool.cc:224] Handling call
0709 12:25:02.187349 (+ 98137us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:02.189305 (+  1956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.189512 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.198285 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:02.161213 18981 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:02.071447 18990 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.083926 18929 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.240890 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:02.201687 15837 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:25:02.203549 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 121088us
I20260709 12:25:02.205669 15913 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:25:02.206557 15910 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:02.210500 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.221606 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.176146 18924 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:02.225302 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.225483 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.247169 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.226002 18942 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.233752 15838 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:25:02.257546 15838 pending_rounds.cc:85] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 5
I20260709 12:25:02.235329 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.191875 18876 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.236783 18986 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:02.265175 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 216908us
I20260709 12:25:02.177014 18845 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.179947 18949 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.225739 18737 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.250177 15830 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:02.257835 15838 pending_rounds.cc:107] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 12:25:02.251504 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.202184 18923 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.146095 18966 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.258282 15980 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:02.236361 15982 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:25:02.258621 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 80852.5us
I20260709 12:25:02.240254 18956 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:02.261006 18924 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:02.261210 15979 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:02.152681 18886 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.139907 18855 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:02.263381 15986 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1682) took 1524 ms (client timeout 1898 ms). Trace:
I20260709 12:25:02.187014 18941 raft_consensus.cc:2764] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:02.239886 18995 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.268260 15829 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.269824 15838 raft_consensus.cc:2889] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.270416 15908 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:25:02.260051 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:02.298485 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:02.257361 18898 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:02.223160 18962 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.278007 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:02.303797 15986 rpcz_store.cc:269] 0709 12:25:00.738942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.910329 (+171387us) service_pool.cc:224] Handling call
0709 12:25:02.263190 (+1352861us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003147d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:02.263317 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020604672}
I20260709 12:25:02.271268 18923 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.325845 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:02.313839 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.314873 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.325879 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:02.305958 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 252729us
I20260709 12:25:02.317759 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.330376 15908 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:25:02.313200 18737 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.318634 15984 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:02.332087 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54275.7us
I20260709 12:25:02.336120 16494 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:25:02.329833 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1151) took 1762 ms. Trace:
I20260709 12:25:02.315474 18638 raft_consensus.cc:2764] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:02.339041 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.316164 18995 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.338871 16493 raft_consensus.cc:2368] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
I20260709 12:25:02.341823 15913 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:02.276378 18939 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 12:25:02.342585 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 96001.5us
I20260709 12:25:02.348332 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.327638 18923 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:02.349440 15953 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.68:43743 timed out after 1.576s (SENT) [suppressed 41 similar messages]
I20260709 12:25:02.350363 15986 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:25:02.351491 15986 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:02.309407 18942 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:25:02.353685 18999 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:02.354127 18687 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:02.313028 18956 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.339918 18949 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.357928 18949 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.358299 18949 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.361991 18929 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.362195 18924 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.362563 18894 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.329335 18985 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:25:02.365186 18966 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:02.365403 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 117439us
I20260709 12:25:02.361269 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2528) took 1798 ms. Trace:
I20260709 12:25:02.367571 15912 rpcz_store.cc:276] 0709 12:25:00.562795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.044436 (+1481641us) service_pool.cc:224] Handling call
0709 12:25:02.050645 (+  6209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.051016 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.051042 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.051494 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.247930 (+196436us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:02.247984 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.248065 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.360972 (+112907us) raft_consensus.cc:1685] finished
0709 12:25:02.360992 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.361190 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6281,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":195927,"threads_started":1,"wal-append.queue_time_us":307705}
I20260709 12:25:02.314306 18674 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:25:02.369843 18674 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:02.370832 18983 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:02.371284 18674 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:02.371517 18941 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:02.371644 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:02.372412 15913 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:02.372578 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:02.373207 18855 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.373123 18949 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.373946 18986 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.375703 18949 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.370047 18845 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.346627 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.341845 18995 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.363880 18894 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.377744 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.382830 15983 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:02.383350 15984 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:02.271474 18887 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.288s
I20260709 12:25:02.381898 15835 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:02.334385 18946 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.403015 15836 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.402865 18923 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.404675 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.405259 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:02.405668 16492 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:02.406432 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:02.406760 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.407516 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:02.414163 15911 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:02.384410 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:02.387027 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.376427 18942 consensus_queue.cc:1243] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:02.417922 15986 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:02.326275 18898 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.383898 18866 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:02.371683 18674 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:02.395349 18944 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.428002 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:02.429167 18675 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.377017 18959 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.423774 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2536) took 1396 ms. Trace:
I20260709 12:25:02.422138 18845 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.441681 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:02.443228 15907 rpcz_store.cc:276] 0709 12:25:01.027397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.124224 (+1096827us) service_pool.cc:224] Handling call
0709 12:25:02.124594 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.132337 (+  7743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.423527 (+291190us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b54001522d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:02.423705 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16192384}
I20260709 12:25:02.431917 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:02.453392 15909 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:02.457768 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 154476us
W20260709 12:25:02.458164 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 108741us
I20260709 12:25:02.432845 18929 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:02.467772 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:02.468623 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:02.466572 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.472465 16496 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.454664 18942 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.454757 18923 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:02.443109 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:02.494798 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.496866 15907 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:02.467065 18956 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.443912 18944 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.462885 18675 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:25:02.466722 18985 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:25:02.521795 15909 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:02.525934 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:02.526654 15907 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:02.527828 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 188213us
I20260709 12:25:02.533641 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:02.534399 15909 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:02.514281 18960 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:02.502789 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 69356.4us
I20260709 12:25:02.518265 18923 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.520424 18967 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.545890 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:02.538347 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.517571 18887 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:02.533429 18990 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.558499 15909 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:02.520278 18961 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:25:02.567792 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 100382us
I20260709 12:25:02.559512 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:25:02.584424 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 236189us
I20260709 12:25:02.584698 18898 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.585311 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:02.585662 18831 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:02.586102 18831 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:02.586513 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.586936 18831 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.588021 18831 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.590766 15911 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.591935 15911 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:02.593123 18737 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.593261 15909 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.594514 15909 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:02.595662 15909 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:02.597609 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52156.5us
I20260709 12:25:02.604540 15911 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:02.548842 18962 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:02.610931 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 137621us
W20260709 12:25:02.614971 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.617962 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:02.559593 18687 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:02.559737 18866 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:02.621068 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 207838us
I20260709 12:25:02.548918 18675 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:25:02.604967 18990 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.607132 18986 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:02.641989 15907 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:25:02.619289 19001 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.394s	user 0.003s	sys 0.001s
I20260709 12:25:02.649001 15911 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:25:02.650575 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:02.652356 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.619714 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.657668 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.604775 18960 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:25:02.656275 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:02.643392 18990 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.657466 18898 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:02.647285 18986 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:02.646011 18929 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:02.687448 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74145.2us
I20260709 12:25:02.659825 18924 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:02.689699 18687 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.657825 19022 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:02.693863 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1211) took 1216 ms. Trace:
W20260709 12:25:02.694113 19015 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:02.692302 18929 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.654349 18923 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:25:02.699417 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 102172us
W20260709 12:25:02.685964 18984 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.004s
I20260709 12:25:02.683621 18990 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:02.694941 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 108480us
I20260709 12:25:02.706025 15910 rpcz_store.cc:276] 0709 12:25:01.476955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.270665 (+793710us) service_pool.cc:224] Handling call
0709 12:25:02.311659 (+ 40994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.319104 (+  7445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.319135 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.324231 (+  5096us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.536792 (+212561us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:02.653064 (+116272us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.653505 (+   441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.653588 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.693516 (+ 39928us) raft_consensus.cc:1685] finished
0709 12:25:02.693554 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.693772 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121314,"raft.queue_time_us":11425,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":6360,"spinlock_wait_cycles":21023616,"thread_start_us":276372,"threads_started":2,"wal-append.queue_time_us":344613}
I20260709 12:25:02.721422 15907 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:02.686694 18956 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.728315 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.688452 18898 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:02.731307 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.732452 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53074.2us
I20260709 12:25:02.731940 15910 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:02.698194 19018 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:25:02.702838 19024 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.741328 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.742712 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.743981 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:02.744750 18949 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.698251 18985 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:25:02.735453 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:02.747936 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.752017 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.730095 18944 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.710076 18675 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:25:02.731745 19029 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.756750 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:02.757864 15907 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:25:02.758291 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:02.760922 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 535) took 2241 ms. Trace:
I20260709 12:25:02.762238 15913 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:02.734840 18924 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:02.745359 18962 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:02.761477 15906 rpcz_store.cc:276] 0709 12:25:00.519143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.013253 (+1494110us) service_pool.cc:224] Handling call
0709 12:25:02.067019 (+ 53766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.067425 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.067465 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.068051 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.452966 (+384915us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:02.453023 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.453145 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.760654 (+307509us) raft_consensus.cc:1685] finished
0709 12:25:02.760683 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.760848 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2644,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":15384,"thread_start_us":384487,"threads_started":1,"wal-append.queue_time_us":478742}
I20260709 12:25:02.730526 18984 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.751834 18923 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:02.751670 19022 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:02.751287 18949 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:02.781191 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:02.752635 19026 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:02.730340 18866 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.766561 18924 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:02.749373 19031 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:25:02.773305 18967 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:02.775754 18923 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:02.775190 19030 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:02.750325 19024 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.766119 19029 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.799716 18898 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:02.801005 19021 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:02.798044 19033 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:02.802165 18984 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.802829 19042 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:02.823344 19014 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:25:02.823170 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.826489 19029 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.795918 18924 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.830132 18956 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.830829 19030 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:02.831764 19030 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.800802 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:02.781024 18886 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:02.809214 19023 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:02.785300 18949 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:02.834228 18949 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.834481 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.835669 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:02.836402 19024 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.836628 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 541) took 1170 ms. Trace:
I20260709 12:25:02.837023 18941 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.837661 18941 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:02.838241 18967 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:02.838714 18967 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:02.769047 18944 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:25:02.809446 16496 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:02.795290 18675 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:02.839529 18967 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.840076 18675 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:02.840786 19022 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.841210 18675 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.798738 18960 consensus_queue.cc:1243] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:02.818049 18995 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.736604 18986 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.836966 15908 rpcz_store.cc:276] 0709 12:25:01.665900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.331061 (+665161us) service_pool.cc:224] Handling call
0709 12:25:02.344424 (+ 13363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:02.376549 (+ 32125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.376588 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:02.390241 (+ 13653us) log.cc:844] Serialized 52 byte log entry
0709 12:25:02.548663 (+158422us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.610717 (+ 62054us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.610950 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.611039 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.836424 (+225385us) raft_consensus.cc:1685] finished
0709 12:25:02.836445 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.836572 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24332,"prepare.queue_time_us":187227,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":19877,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":13895,"thread_start_us":117244,"threads_started":2,"wal-append.queue_time_us":281538}
I20260709 12:25:02.842981 18675 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:02.867388 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 86652.3us
W20260709 12:25:02.869305 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 133918us
I20260709 12:25:02.871405 15985 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:02.855115 18959 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.864475 18846 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.874998 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:02.877359 18687 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:02.877718 18687 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:02.878078 18687 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.879232 18995 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.880748 18924 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.896945 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.882859 18959 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.905927 18941 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.914649 18949 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.923383 18924 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.923897 18949 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:02.925299 18990 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.926121 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:02.916237 18959 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:02.885133 18846 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.908926 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.907918 18845 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:02.930904 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.931672 18833 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:02.932328 18833 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:02.932574 18845 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.932780 18846 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:02.933473 18833 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:02.944674 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.931773 15802 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:02.951260 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.952780 15835 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:02.965372 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:02.945159 18990 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:02.976212 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:02.972945 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.970695 15836 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:02.969491 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:02.980481 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:02.975100 19022 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:02.985046 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.991832 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:25:02.993098 18894 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:02.999505 18687 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.000723 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:03.004812 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:03.005133 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.005385 15907 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.008086 18983 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:03.008459 18983 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:03.009357 18983 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.010603 18983 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.013509 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:03.013651 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 81993.6us
I20260709 12:25:03.014362 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.015174 19044 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:03.015671 19044 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:03.016481 15802 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:03.016613 19044 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.016979 18674 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.017937 19047 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.018218 18674 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:03.017408 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52151.6us
I20260709 12:25:03.019762 16490 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:03.020434 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.021344 15912 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:03.021740 15912 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:03.021363 18826 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.969202 18959 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:25:03.023886 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:03.024117 18898 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:03.026926 16493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 584) took 1655 ms (client timeout 1898 ms). Trace:
I20260709 12:25:03.027136 19024 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:25:03.027326 16493 rpcz_store.cc:269] 0709 12:25:01.506440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.531598 (+ 25158us) service_pool.cc:224] Handling call
0709 12:25:03.026743 (+1495145us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540039c1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:03.026871 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754627968}
I20260709 12:25:03.028051 18886 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:03.028453 19024 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:03.029192 19033 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.029592 19033 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:03.029829 19045 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.030372 19045 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.030454 19033 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.031710 19033 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.032452 19028 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:03.032931 19028 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:03.033372 18826 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:03.033772 19028 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.034886 19028 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.035530 18942 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:03.035758 19024 consensus_queue.cc:1243] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:03.035917 18942 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:03.036296 19024 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:03.036634 19024 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:02.956434 18929 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.038093 15837 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 3.
I20260709 12:25:03.034855 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.966586 18845 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.049721 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.032537 19045 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:03.022593 15912 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:02.982409 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.028769 15907 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:03.056191 15913 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:25:03.037832 16460 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:03.057375 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:02.971740 18924 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.060593 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.062533 15912 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.063458 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.063649 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.064033 15980 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:03.060876 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.063241 16494 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:03.036803 18942 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:02.968927 18831 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:25:02.975503 18846 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:25:03.016983 18687 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:03.056548 18949 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:03.059525 18941 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.064883 19029 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:03.076304 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.080214 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:03.078234 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.069002 18939 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.080991 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.060973 18959 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:25:03.066866 18924 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.086735 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.056952 19047 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:25:03.083742 18939 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.092298 18939 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.093739 18924 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.093421 19024 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.094669 19024 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.095690 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.096740 18831 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.097314 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.097960 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.098455 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.098594 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.099504 19029 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:03.099948 15979 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:03.099949 15984 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:03.059656 18929 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.091748 15912 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:03.105348 15912 pending_rounds.cc:85] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
W20260709 12:25:03.105460 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 89064.9us
I20260709 12:25:03.105695 15912 pending_rounds.cc:107] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:03.100937 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.091005 15982 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:03.110874 18924 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.100591 19029 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.110131 18831 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:03.111354 18866 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.116242 19050 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:25:03.069454 18845 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.116439 18942 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.110687 18961 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:03.091235 18949 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.156276 15979 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:25:03.158443 15912 raft_consensus.cc:2889] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.168325 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:03.171103 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.188669 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.176924 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:03.177999 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.189949 16495 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:03.180502 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.181275 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:03.183458 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:03.136747 18939 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.185150 16487 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:03.189855 16496 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:03.180251 15984 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:25:03.191779 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.194152 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 542) took 1528 ms. Trace:
I20260709 12:25:03.196771 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.197623 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:03.196349 15912 rpcz_store.cc:276] 0709 12:25:01.666185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.369486 (+703301us) service_pool.cc:224] Handling call
0709 12:25:02.369826 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.021258 (+651432us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b5400071aa0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc21adc0 00007f03cc2a51c0 00007f03cc2a6231 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c
0709 12:25:03.193939 (+172681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.194101 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113233280}
I20260709 12:25:03.202919 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 657) took 1234 ms. Trace:
I20260709 12:25:03.203486 15982 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.174614 18876 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:03.203325 15834 rpcz_store.cc:276] 0709 12:25:01.967150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.128309 (+161159us) service_pool.cc:224] Handling call
0709 12:25:02.128648 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.324359 (+195711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.324386 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.324418 (+    32us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:02.324446 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.200830 (+876384us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540021ff54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:03.200873 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.200986 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415015808}
I20260709 12:25:03.180930 19022 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.210321 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.208864 18886 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:03.213093 18886 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.213449 18886 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:03.213876 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74654.9us
I20260709 12:25:03.214574 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.215459 19024 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:03.215710 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.215924 19024 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:03.209137 18956 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:03.217344 18986 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.217916 16486 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.219374 18845 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.220783 15983 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
W20260709 12:25:03.202622 18966 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:25:03.224706 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.226425 18986 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:03.209537 18831 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:03.227028 18986 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.227154 18831 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:03.227521 18986 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.227732 18831 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.337492 15987 rpcz_store.cc:276] 0709 12:25:00.567433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.310325 (+742892us) service_pool.cc:224] Handling call
0709 12:25:01.387333 (+ 77008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.410496 (+ 23163us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:01.773859 (+363363us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.329360 (+555501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.329424 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:02.329493 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.329636 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.329767 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5322,"prepare.queue_time_us":450268,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":9397,"thread_start_us":792866,"threads_started":2}
I20260709 12:25:03.180756 18866 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.234002 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 561) took 1018 ms. Trace:
I20260709 12:25:03.234225 18986 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.234416 15988 rpcz_store.cc:276] 0709 12:25:02.215936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.216067 (+   131us) service_pool.cc:224] Handling call
0709 12:25:02.249564 (+ 33497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.756344 (+506780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.756388 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.766842 (+ 10454us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:02.766903 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.233780 (+466877us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54002c5e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:03.233829 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.233946 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140443520}
I20260709 12:25:03.235458 18866 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.202785 18949 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.237367 18986 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.237571 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:03.238795 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:03.239524 18924 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:03.240020 18924 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:03.239854 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.240543 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1168) took 1021 ms. Trace:
I20260709 12:25:03.240849 16489 raft_consensus.cc:2410] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:03.240918 15985 rpcz_store.cc:276] 0709 12:25:02.219097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.219495 (+   398us) service_pool.cc:224] Handling call
0709 12:25:03.240356 (+1020861us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54001b8354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:03.240483 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448000896}
I20260709 12:25:03.241721 19033 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:03.242257 19033 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.242687 19033 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.245003 15910 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:03.246068 15905 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:03.241748 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.247548 16489 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:03.212639 19042 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:03.227191 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:03.216833 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:03.253455 16490 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:03.191118 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.260937 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:03.261940 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.262383 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.269794 15984 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.270196 15986 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:03.273468 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:03.239078 18939 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:03.209750 18675 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.283753 18675 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.280445 18886 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.285492 18923 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.286052 18675 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:03.286484 18923 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.258133 18876 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.286604 18886 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:03.288902 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 78641us
I20260709 12:25:03.288657 19033 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.289758 18876 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.290416 18967 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.291100 18967 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:03.291213 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.279148 18866 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:03.281298 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:03.293490 18866 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:03.293753 15986 raft_consensus.cc:2410] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:03.265493 19063 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:03.294345 19063 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:03.294723 19063 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.291164 19033 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.247716 19045 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.294544 18866 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.295434 19045 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.294813 15986 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:03.217346 19026 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:03.282974 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 66211.1us
I20260709 12:25:03.278821 15908 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:03.216799 19024 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.297971 15980 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:25:03.305384 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45445.3us
W20260709 12:25:03.300519 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 243202us
I20260709 12:25:03.292938 15981 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:25:03.303588 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.303658 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:03.318562 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:03.319257 18831 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.319582 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:03.321134 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.321957 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.323527 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.323766 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.324415 15981 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.333824 15908 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: [5.4-8.6]
I20260709 12:25:03.335409 15838 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:25:03.273414 19042 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:03.338349 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:03.339370 15909 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:03.334708 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.371031 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.371210 19033 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.376354 15984 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:03.377231 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:03.378633 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44013.2us
I20260709 12:25:03.379681 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.377020 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:03.383188 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.298352 18959 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:25:03.385175 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.385919 15830 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
I20260709 12:25:03.352666 18894 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:03.389438 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.352846 18990 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:03.240996 18924 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.361486 18956 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.317006 18889 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:25:03.395262 15909 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.394331 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.405583 15837 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:03.397418 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.397192 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.391016 18894 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.393337 18966 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.401512 15908 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:03.401854 18831 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:03.402527 19042 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.404781 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.363917 19062 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.386751 18967 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.407002 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:03.416328 15981 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:25:03.467039 15981 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.391348 18942 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:03.411810 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 91045.3us
I20260709 12:25:03.454698 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.470646 15838 raft_consensus.cc:2368] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 3. Current term is 5.
I20260709 12:25:03.412274 19045 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:03.460210 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63213.2us
I20260709 12:25:03.459928 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.471662 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.462080 15830 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:03.412057 18894 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.463311 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:03.464900 15908 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.469116 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.479511 15907 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:03.472790 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:03.478351 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:03.482744 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.487360 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.495790 15831 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:03.513321 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:03.514456 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.464001 19049 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:03.520243 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.468636 18638 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.465161 19062 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:03.470132 18942 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:03.512741 18949 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:03.531905 18962 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.525494 19047 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.526448 15831 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:03.504021 19045 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.532765 19058 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.545819 18942 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:03.551887 19067 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:25:03.532991 19062 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.546316 19049 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:03.546294 18638 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:03.546030 18949 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:03.523555 18826 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:03.588383 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:03.558013 19047 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:03.550884 18962 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:03.593185 15909 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:03.598294 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:03.594281 18949 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.579121 19045 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.599843 19058 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.622066 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.622829 15838 raft_consensus.cc:2393] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:03.608681 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 220368us
I20260709 12:25:03.608685 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:03.610814 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:03.596962 19047 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:03.612349 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 133393us
I20260709 12:25:03.598230 18962 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.586520 18959 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:25:03.632573 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.638772 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:03.638984 15908 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.639487 15834 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:03.635855 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 121456us
I20260709 12:25:03.642010 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:03.643385 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:03.650409 15907 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.650875 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.617874 19058 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:03.653519 15909 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:03.645356 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:03.655692 15908 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:03.651954 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.649278 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:03.658032 16486 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.651351 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.660867 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:03.660929 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.663237 15838 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.663932 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:03.669237 19045 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:03.673651 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.674209 15986 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:03.675024 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 112586us
I20260709 12:25:03.678949 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:03.679733 15912 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:03.681392 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:03.682013 15908 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:25:03.636183 18846 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:25:03.684171 15950 leader_election.cc:336] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.960s (SENT)
I20260709 12:25:03.686494 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.671285 18845 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:03.671049 19029 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.649822 18889 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:03.727088 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:03.753075 15838 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:03.727149 15834 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.672063 18990 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:03.764086 15907 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:03.771164 16459 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.772948 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.688959 19033 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:03.779661 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 52673.8us
I20260709 12:25:03.782626 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:03.780192 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 101374us
I20260709 12:25:03.780530 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.781069 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.791096 15953 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:03.687889 18876 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:25:03.880749 15834 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.796284 15837 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:03.723440 18886 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:03.890158 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.786240 19028 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.754545 19038 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
W20260709 12:25:03.889991 19069 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:25:03.787089 19029 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:03.895555 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 206007us
W20260709 12:25:03.904260 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 252359us
I20260709 12:25:03.800798 18983 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.786414 18845 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:03.934154 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.923408 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.802870 18995 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:03.927654 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 136586us
I20260709 12:25:03.882416 19045 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.869879 18826 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:03.936393 15838 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:03.681257 19049 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.788471 18866 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 12:25:03.905467 19028 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.927129 18675 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.959545 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:03.912518 18886 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.938376 18845 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.781456 19058 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:03.965834 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.968276 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.898108 18939 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:25:03.970059 15838 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:03.948261 19045 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:03.956566 19028 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:04.073107 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 351190us
I20260709 12:25:03.989719 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.988013 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:03.987633 15833 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:03.972932 18846 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:04.110383 15837 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:04.106060 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.106125 15834 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:03.987334 18929 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:03.958772 18675 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.968245 19077 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:04.106209 15832 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
W20260709 12:25:04.149959 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 378890us
W20260709 12:25:04.149163 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 219374us
I20260709 12:25:03.968657 18886 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.956198 18638 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:04.159878 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:04.165529 15838 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
W20260709 12:25:04.120299 15830 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
W20260709 12:25:03.995164 19070 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.365s	user 0.001s	sys 0.001s
I20260709 12:25:04.157598 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:03.991109 19073 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:25:03.986824 19081 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:25:04.167508 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:04.121430 19078 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.970467 19083 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.148789 19058 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.099972 18674 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:04.103541 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.177207 15833 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 3.
W20260709 12:25:04.163678 19069 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:25:04.206444 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 425432us
I20260709 12:25:04.114941 19045 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.149487 19109 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.166661 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:04.158088 18675 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.194770 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.216811 15912 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:04.103813 15986 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:04.157399 19077 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:04.132025 19016 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:04.184356 18846 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:04.202867 19083 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.210443 18674 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.290699 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 577) took 1081 ms. Trace:
W20260709 12:25:04.292454 19095 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 12:25:04.292392 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 560) took 1048 ms. Trace:
I20260709 12:25:04.197969 19078 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.293612 19092 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:04.295197 19101 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.296612 18831 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:03.969568 18990 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:04.338649 19047 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.002s
I20260709 12:25:04.346395 19047 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:04.347378 18942 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.000s
I20260709 12:25:04.297302 19099 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.347785 18942 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.348487 19099 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.348899 18833 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.350414 18942 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.350735 19099 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.297001 18675 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.299401 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 576) took 1204 ms. Trace:
I20260709 12:25:04.301460 19086 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:04.351382 15983 rpcz_store.cc:276] 0709 12:25:03.094662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.295404 (+200742us) service_pool.cc:224] Handling call
0709 12:25:03.295715 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.296104 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.296145 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.296562 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.602236 (+305674us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:03.602279 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.602339 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.299145 (+696806us) raft_consensus.cc:1685] finished
0709 12:25:04.299172 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.299320 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66001,"raft.queue_time_us":3984,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5520,"thread_start_us":304842,"threads_started":1,"wal-append.queue_time_us":1000689}
I20260709 12:25:04.352628 18675 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:04.301934 16486 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.014s
I20260709 12:25:04.303715 19109 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.353281 16486 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:03.995402 19029 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.207875 19100 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.110497 19096 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 12:25:04.336199 15984 rpcz_store.cc:276] 0709 12:25:03.208920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.378166 (+169246us) service_pool.cc:224] Handling call
0709 12:25:03.378442 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.391192 (+ 12750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.391222 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.395977 (+  4755us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.572077 (+176100us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.572134 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.572232 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.290409 (+718177us) raft_consensus.cc:1685] finished
0709 12:25:04.290439 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.290634 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7507,"raft.queue_time_us":21365,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":173505,"threads_started":1,"wal-append.queue_time_us":379924}
I20260709 12:25:04.338400 15911 rpcz_store.cc:276] 0709 12:25:03.244171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.244891 (+   720us) service_pool.cc:224] Handling call
0709 12:25:03.245208 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.281164 (+ 35956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.281196 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.281653 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.466761 (+185108us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.466798 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.466867 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.292120 (+825253us) raft_consensus.cc:1685] finished
0709 12:25:04.292151 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.292304 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35540,"raft.queue_time_us":36716,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":184756,"threads_started":1,"wal-append.queue_time_us":312328}
W20260709 12:25:04.322757 18923 consensus_meta.cc:287] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.036s	user 0.011s	sys 0.000s
I20260709 12:25:04.231855 19016 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:04.384518 19016 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.384045 18846 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.353185 18675 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:04.208868 19080 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.373924 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2562) took 1120 ms. Trace:
W20260709 12:25:04.335469 19063 consensus_meta.cc:287] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.040s	user 0.014s	sys 0.003s
W20260709 12:25:04.299216 18962 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
I20260709 12:25:04.378221 15834 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:25:04.299907 18949 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.683s	user 0.004s	sys 0.005s
I20260709 12:25:04.386144 19016 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.343974 18831 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:04.406896 15985 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:04.400527 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.400274 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 242753us
I20260709 12:25:04.416787 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:04.382483 19047 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:04.420934 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:04.353444 19109 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.391559 18942 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:04.354172 19101 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.460664 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:04.402117 19080 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.391505 15913 rpcz_store.cc:276] 0709 12:25:03.224404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.257729 (+ 33325us) service_pool.cc:224] Handling call
0709 12:25:03.283637 (+ 25908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:03.284002 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.284030 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:03.284514 (+   484us) log.cc:844] Serialized 52 byte log entry
0709 12:25:03.413187 (+128673us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:03.463374 (+ 50187us) log.cc:844] Serialized 14 byte log entry
0709 12:25:03.463626 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.463717 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.344626 (+880909us) raft_consensus.cc:1685] finished
0709 12:25:04.344646 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.344781 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19323,"prepare.queue_time_us":53468,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":6256,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":10724,"thread_start_us":128211,"threads_started":1,"wal-append.queue_time_us":243975}
I20260709 12:25:04.425697 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:04.401729 18923 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:04.408601 18855 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.401932 19063 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.468349 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:04.470795 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:04.473845 15985 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:04.476375 16486 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:04.421073 19022 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:04.406525 18687 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:25:04.425254 19106 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:04.465906 19100 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.404543 18962 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.492224 15910 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:04.406975 18949 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.483368 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:04.377388 19092 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.424130 18845 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.500659 15982 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:25:04.502971 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:04.472155 19024 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:25:04.506470 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 298586us
I20260709 12:25:04.480711 19022 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:04.498070 19062 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.902s	user 0.011s	sys 0.000s
I20260709 12:25:04.514178 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:04.514952 19106 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:04.517814 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.521339 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:04.405535 19077 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.480320 18923 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.529590 16488 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:04.529909 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:04.527755 15829 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:04.480564 18855 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.556627 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.558365 15913 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:04.529523 18894 consensus_meta.cc:287] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.000s
I20260709 12:25:04.561390 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.566640 15904 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:25:04.566702 18990 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:04.567710 19093 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.415s	user 0.001s	sys 0.001s
I20260709 12:25:04.568730 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:04.569607 18855 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.604517 15906 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:04.569885 19105 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.570448 18674 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:04.571163 19080 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.572650 18962 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.576426 19063 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:04.578262 19078 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.519302 19062 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.580235 19028 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.581359 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.584884 15904 pending_rounds.cc:85] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 4
I20260709 12:25:04.519555 18942 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:04.598593 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:04.630339 15912 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:04.491291 18831 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:04.614084 15802 connection.cc:256] RPC call timeout handler was delayed by -1.6096276749999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 12:25:04.614279 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.515866 19042 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:25:04.569644 19104 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:25:04.553231 19086 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:04.628830 15904 pending_rounds.cc:107] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:25:04.596485 18990 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.638443 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.495627 19100 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:04.638620 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51885.4us
I20260709 12:25:04.640183 15904 raft_consensus.cc:2889] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:04.640694 15909 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.615688 19077 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.642829 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.596639 18894 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.630340 19101 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:04.637847 19105 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.637125 19083 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:04.642400 18831 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.630075 19080 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:25:04.642755 15912 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:25:04.682220 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 109592us
I20260709 12:25:04.672502 18990 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:04.684162 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 171374us
I20260709 12:25:04.688021 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.672922 19086 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.734481 19042 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:04.689324 18674 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:25:04.726068 19028 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:04.726799 18845 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.725996 19092 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.728003 19016 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:04.688836 15913 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:04.732824 18966 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.738674 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 565) took 1106 ms. Trace:
I20260709 12:25:04.681589 18941 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:04.682520 19029 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.755422 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 669) took 1752 ms. Trace:
I20260709 12:25:04.720690 19062 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.746803 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:04.879112 18941 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:04.746449 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 109572us
I20260709 12:25:04.884619 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.885440 15913 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:04.885962 18894 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:04.886260 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.875818 18966 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.887316 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.887902 15913 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:04.887005 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:04.792212 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.888891 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.889405 19113 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:04.796262 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.842468 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 183272us
I20260709 12:25:04.890455 18923 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:04.681540 19106 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:04.863255 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.892175 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.892334 19100 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:04.867909 15905 rpcz_store.cc:276] 0709 12:25:03.632362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.634256 (+  1894us) service_pool.cc:224] Handling call
0709 12:25:03.634601 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:03.641430 (+  6829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.641456 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:03.645256 (+  3800us) log.cc:844] Serialized 52 byte log entry
0709 12:25:03.869527 (+224271us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:03.869597 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.869697 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.567076 (+697379us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:04.734115 (+167039us) raft_consensus.cc:1685] finished
0709 12:25:04.734139 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.738591 (+  4452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7170,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":18979,"spinlock_wait_cycles":8902912,"thread_start_us":188280,"threads_started":1,"wal-append.queue_time_us":307976}
I20260709 12:25:04.893462 15905 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.893687 15982 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:25:04.878666 15835 rpcz_store.cc:276] 0709 12:25:03.003385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.012588 (+  9203us) service_pool.cc:224] Handling call
0709 12:25:03.012858 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.137228 (+124370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.137255 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.137740 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.333859 (+196119us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:03.333927 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.751614 (+1417687us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540020e254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:04.751668 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.751715 (+    47us) raft_consensus.cc:1685] finished
0709 12:25:04.751727 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.755364 (+  3637us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11246,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":258838912,"thread_start_us":195761,"threads_started":1,"wal-append.queue_time_us":331031,"wal-append.run_cpu_time_us":2193,"wal-append.run_wall_time_us":1057782}
I20260709 12:25:04.797408 19063 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:04.795178 19123 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:25:04.889814 15913 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:25:04.865476 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:04.900985 15907 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:04.737290 18942 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:04.902180 15907 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:04.864163 19016 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:04.888782 18966 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:04.905769 19029 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:04.993063 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.016409 19137 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:05.030258 15987 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:05.031487 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1184) took 1083 ms. Trace:
I20260709 12:25:05.031920 15987 rpcz_store.cc:276] 0709 12:25:03.948084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.949896 (+  1812us) service_pool.cc:224] Handling call
0709 12:25:05.031277 (+1081381us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001b8354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:05.031422 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2460623104}
I20260709 12:25:04.914672 19063 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.040081 15879 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:05.053622 19130 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:25:05.056023 19096 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:05.056582 19096 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:05.056691 19135 log.cc:927] Time spent T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 12:25:05.057611 19096 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:05.058595 18833 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.709s	user 0.005s	sys 0.005s
I20260709 12:25:05.069069 18959 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.069661 18959 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:05.083915 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.076752 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:05.062793 19099 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:05.198609 19114 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.096338 15904 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:05.082193 18826 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:05.233253 19082 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:05.233788 19082 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.235797 19082 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:05.183171 19077 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.026057 19016 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.204752 19099 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:05.358572 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 318715us
I20260709 12:25:05.191838 18833 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:05.357350 19022 consensus_meta.cc:287] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.000s
I20260709 12:25:05.359381 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:05.213007 18966 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:05.451359 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 91597.1us
I20260709 12:25:05.445484 15913 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:05.468225 15988 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:05.473589 19126 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.474278 19126 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:05.388916 19099 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.384269 19029 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:05.390511 18833 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.441866 19096 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.436201 19086 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:05.476898 19126 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:05.448335 19016 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.355472 18826 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:05.490355 18990 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.735s	user 0.030s	sys 0.007s
W20260709 12:25:05.492462 15980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 566) took 2440 ms (client timeout 2041 ms). Trace:
W20260709 12:25:05.505434 18886 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.331s	user 0.010s	sys 0.003s
W20260709 12:25:05.515753 15980 rpcz_store.cc:269] 0709 12:25:03.041541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.070411 (+ 28870us) service_pool.cc:224] Handling call
0709 12:25:05.467711 (+2397300us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540036e2d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:05.481861 (+ 14150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491428608}
I20260709 12:25:05.392478 19077 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.231109 19114 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:05.504338 18833 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.458551 19022 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.479048 18966 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:05.527482 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:05.543483 19114 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:05.520462 18990 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.522778 18886 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:05.557202 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 197932us
I20260709 12:25:05.558462 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:05.573357 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 102837us
I20260709 12:25:05.575102 16495 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.579739 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:05.580488 15980 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:05.579231 19045 consensus_meta.cc:287] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.350s	user 0.011s	sys 0.001s
I20260709 12:25:05.589785 15802 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:05.578650 18846 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.594458 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:05.634552 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:05.595408 19144 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.590554 19063 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:05.622059 18942 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.654160 18942 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:05.656869 18942 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:05.659809 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 63511.6us
W20260709 12:25:05.639734 19140 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:25:05.593276 19149 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:05.665237 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.661674 19141 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:25:05.596087 19045 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.665205 18826 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:05.693351 19143 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:25:05.668669 19113 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.640431 18846 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.701054 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 511) took 1178 ms. Trace:
I20260709 12:25:05.665089 19149 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:05.671867 19150 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.702239 16486 rpcz_store.cc:276] 0709 12:25:04.522855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.523066 (+   211us) service_pool.cc:224] Handling call
0709 12:25:04.523438 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.528238 (+  4800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.528269 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:04.536241 (+  7972us) log.cc:844] Serialized 26 byte log entry
0709 12:25:04.967353 (+431112us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:04.967392 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.967456 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.700794 (+733338us) raft_consensus.cc:1685] finished
0709 12:25:05.700820 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.700971 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4350,"raft.queue_time_us":4771,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":17694,"thread_start_us":337388,"threads_started":1,"wal-append.queue_time_us":911579}
I20260709 12:25:05.686682 19022 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:05.686975 19142 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:05.686833 19077 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:05.701792 19113 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:05.722198 18949 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:05.953106 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:05.924883 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 264297us
I20260709 12:25:06.049619 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:05.975383 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.151641 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:06.026612 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 468058us
I20260709 12:25:05.723793 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:06.127766 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:06.179749 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.176309 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:06.198966 15905 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:06.036645 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1185) took 1639 ms. Trace:
W20260709 12:25:05.736225 19131 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.810s	user 0.000s	sys 0.010s
W20260709 12:25:06.175580 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.199000 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.230427 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:05.719516 18831 consensus_meta.cc:287] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.973s	user 0.008s	sys 0.003s
I20260709 12:25:06.265487 15981 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:06.198120 15831 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:25:05.729423 19146 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:25:06.263886 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:06.264693 15907 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:25:06.073879 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.32704e+06us
I20260709 12:25:06.272521 15952 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:06.272805 15907 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:06.146956 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.275720 15983 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:06.163641 19107 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:06.052875 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:05.721796 18990 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:05.733927 19072 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:06.268096 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 91879.6us
I20260709 12:25:05.732378 19045 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:05.938707 15829 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:06.268427 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.285073 15981 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:06.285574 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:06.016693 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.128072 18983 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.258394 19101 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.258230 19096 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.292114 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:06.229914 18674 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:05.823433 19029 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:06.273144 15984 rpcz_store.cc:276] 0709 12:25:04.397180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.401703 (+  4523us) service_pool.cc:224] Handling call
0709 12:25:04.401989 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.402195 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:04.627348 (+225153us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.035998 (+1408650us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b180038c140. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:06.036183 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.036251 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.036320 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.036407 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.036562 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89744,"prepare.queue_time_us":282753,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2219,"raft.queue_time_us":1297834,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":35923,"spinlock_wait_cycles":5860608,"thread_start_us":313362,"threads_started":2,"wal-append.queue_time_us":252951,"wal-append.run_cpu_time_us":1845,"wal-append.run_wall_time_us":1117602}
I20260709 12:25:05.823678 18949 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.825987 19022 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:06.128935 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1718) took 1092 ms. Trace:
I20260709 12:25:06.282133 19072 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:06.087386 19134 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.932312 19109 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.117918 19155 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:06.087642 18923 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.195855 18687 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.117540 19042 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:05.817143 19149 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.729911 18966 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.286813 15838 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
W20260709 12:25:06.270391 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.265638 15912 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.180881 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1717) took 1144 ms. Trace:
W20260709 12:25:06.272980 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.318s	user 0.010s	sys 0.025s
I20260709 12:25:06.087767 19132 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:05.878501 18826 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:06.230085 19084 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:06.191540 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.294003 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:06.191967 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.355479 16457 connection.cc:256] RPC call timeout handler was delayed by -1.5206760829996711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 12:25:06.355969 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.356521 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.356899 16457 connection.cc:256] RPC call timeout handler was delayed by -1.2834117409997816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 12:25:06.357321 16457 connection.cc:256] RPC call timeout handler was delayed by -1.0008937259999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 12:25:06.295827 15905 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:25:05.922032 18889 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.269484 19105 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.297605 16487 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:05.723037 18886 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:05.878844 19144 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:05.732447 18959 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.338316 19134 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.343014 19155 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.328999 19022 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.360366 19132 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:05.725669 19162 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.561s
I20260709 12:25:06.282913 19136 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.854995 18833 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.328363 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:05.835785 19142 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.324780 15982 rpcz_store.cc:276] 0709 12:25:05.036521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.088984 (+ 52463us) service_pool.cc:224] Handling call
0709 12:25:05.203812 (+114828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.204057 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:05.540383 (+336326us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.128519 (+588136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.128583 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.128642 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.128727 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.128866 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":495957,"prepare.queue_time_us":184459,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":9641,"raft.queue_time_us":506930,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":321200,"threads_started":2,"wal-append.queue_time_us":101703}
I20260709 12:25:06.291767 19028 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.280141 19107 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:06.322459 18949 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:06.341048 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 417640us
I20260709 12:25:05.730036 19150 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.301662 19113 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.343897 15987 rpcz_store.cc:276] 0709 12:25:05.036165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.075134 (+ 38969us) service_pool.cc:224] Handling call
0709 12:25:05.184111 (+108977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.184364 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:05.213687 (+ 29323us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.738385 (+524698us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18001f49e0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe4323a 00007f03cc2ada2a
0709 12:25:06.173409 (+435024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.173478 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:06.173541 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.173628 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.180813 (+  7185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146853,"prepare.queue_time_us":29135,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2575,"raft.queue_time_us":148131,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":26443,"spinlock_wait_cycles":38648704,"thread_start_us":287834,"threads_started":1,"wal-append.queue_time_us":1113715}
I20260709 12:25:06.296447 18983 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.342139 19042 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.345296 18687 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.355046 15833 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:25:06.363008 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.005s	sys 0.016s
W20260709 12:25:06.404865 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.005s	sys 0.016s
I20260709 12:25:06.363459 15912 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:06.301906 19096 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.367000 15953 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:06.347328 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.392s	user 0.011s	sys 0.025s
I20260709 12:25:06.307920 18674 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.364862 16457 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:06.327559 19045 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:06.368803 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 578) took 1448 ms. Trace:
I20260709 12:25:06.415578 15905 rpcz_store.cc:276] 0709 12:25:04.909685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.981190 (+ 71505us) service_pool.cc:224] Handling call
0709 12:25:05.723653 (+742463us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:25:06.357980 (+634327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196257024}
I20260709 12:25:06.323559 19029 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.276840 19117 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.381110 19132 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.453703 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.454192 15982 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:06.390694 15983 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:06.405222 19042 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.388536 15831 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:25:06.393893 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 568) took 2223 ms. Trace:
I20260709 12:25:06.389413 15984 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:25:06.378202 19022 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.351290 18855 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.385707 19162 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:06.407193 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.408964 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.369812 18889 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.367723 19157 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.346172 18923 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.349642 19072 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:06.412474 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 47712.4us
I20260709 12:25:06.412873 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.413470 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:06.420624 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 135266us
I20260709 12:25:06.473243 15838 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:06.476516 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.392877 19028 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.444459 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.480166 15836 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.305635 19101 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.446786 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:06.370395 19160 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:06.447590 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.488834 15830 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:06.376444 19155 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.371729 19171 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:06.374562 19134 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:06.448256 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 162744us
I20260709 12:25:06.449837 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 573) took 1877 ms. Trace:
I20260709 12:25:06.452360 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2682) took 2465 ms. Trace:
I20260709 12:25:06.455768 15908 rpcz_store.cc:276] 0709 12:25:04.170829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.171206 (+   377us) service_pool.cc:224] Handling call
0709 12:25:04.191246 (+ 20040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.507286 (+316040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.507332 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:04.507895 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:25:04.677850 (+169955us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:04.677885 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.677949 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.735691 (+1057742us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:06.367908 (+632217us) raft_consensus.cc:1685] finished
0709 12:25:06.367935 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.393812 (+ 25877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5373,"raft.queue_time_us":195714,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12413,"spinlock_wait_cycles":74043264,"thread_start_us":416135,"threads_started":2,"wal-append.queue_time_us":344194}
I20260709 12:25:06.409513 19113 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:06.445492 19163 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:25:06.361191 18826 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.459618 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:06.446692 19164 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:06.443681 18939 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:06.466372 18966 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.468886 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.466168 19016 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.382208 18886 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.481333 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:06.501617 18939 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.513388 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:06.514006 15908 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.489285 19028 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.495261 18687 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:06.488081 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.466063 19132 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:06.459594 19038 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:06.495644 15984 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:06.496390 15834 rpcz_store.cc:276] 0709 12:25:03.987026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.150609 (+163583us) service_pool.cc:224] Handling call
0709 12:25:04.167229 (+ 16620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.403407 (+236178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.452101 (+2048694us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5400083754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:06.452285 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154143488}
I20260709 12:25:06.497186 15904 rpcz_store.cc:276] 0709 12:25:04.572295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.891935 (+319640us) service_pool.cc:224] Handling call
0709 12:25:06.449710 (+1557775us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54001162d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:06.449791 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468159360}
I20260709 12:25:06.497184 15838 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:06.499452 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:06.415654 18846 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.500509 15905 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:06.470443 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.461196 19162 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:06.490175 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:06.550740 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:06.551573 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.551997 15905 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.523010 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:06.554690 15985 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:06.555682 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.556932 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:06.557138 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.557806 15984 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:06.466216 18855 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.562739 19132 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:06.563659 19132 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.558197 15985 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:06.559186 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.573587 15984 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:06.559580 15982 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:06.559201 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 59809.8us
I20260709 12:25:06.574240 15905 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:06.510035 18831 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:06.567431 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 61199.4us
I20260709 12:25:06.512969 18939 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:06.528817 15836 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:06.575812 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.576996 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:06.589573 15905 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.503481 19134 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:25:06.560848 19163 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:06.598636 15908 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:06.507079 18961 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:25:06.599188 15905 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:06.560825 18687 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:06.512125 18966 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.500339 19113 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.513681 18886 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.609840 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:06.568653 19109 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.585872 18831 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:06.617256 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.606544 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.620522 15906 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:06.560715 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 70591.6us
W20260709 12:25:06.618012 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 61149.5us
I20260709 12:25:06.613718 19179 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:06.368862 19084 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.626222 18687 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.626701 18687 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.627758 19084 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.456857 19117 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.628618 18687 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:06.449146 19107 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.629359 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:06.621637 18831 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.629972 19117 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:06.629508 19107 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.631417 15830 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:06.632583 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.633154 15831 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.633566 18983 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:06.634119 18983 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:06.634575 18983 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:06.634959 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.635551 15833 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:06.636487 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.637015 15833 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.372745 19144 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.634447 15829 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:06.620078 19142 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.393179 19105 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.641367 19105 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.641635 18826 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.472298 19157 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.642241 19096 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:06.642407 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:06.643002 16486 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:06.643852 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.644325 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:06.624023 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.636729 18983 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:06.498448 19171 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.747466 19157 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.694173 18966 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.673470 18949 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.648027 15831 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:06.696759 19144 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.663311 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:06.701678 19175 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:25:06.748793 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 512) took 2224 ms. Trace:
I20260709 12:25:06.663699 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.700484 16492 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:06.630781 18687 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.740356 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.644399 15838 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:06.770562 15833 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:06.771911 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.698962 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:06.775519 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:06.615657 19109 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:06.782709 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.696414 18831 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:06.617997 18833 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.644815 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:06.621454 15879 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.056322 15832 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.033284 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.057896 15836 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:06.645891 18923 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.625749 19179 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:06.694700 19168 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:25:06.970000 15905 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.060487 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:07.070479 16486 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:25:07.059744 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.794436 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 219102us
I20260709 12:25:06.921772 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:06.643020 18674 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.705660 19029 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:07.059748 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.076819 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:07.056192 15904 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:07.069201 15906 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:06.854429 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:07.079025 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:06.673753 19096 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:06.779543 19103 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 2.302s	user 0.003s	sys 0.013s
I20260709 12:25:06.780076 19134 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.057206 15834 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:07.074487 15907 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:06.704557 19162 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.071491 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:07.079602 15986 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.094728 16492 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:07.068133 16495 rpcz_store.cc:276] 0709 12:25:04.524053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.524205 (+   152us) service_pool.cc:224] Handling call
0709 12:25:04.535913 (+ 11708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.575605 (+1039692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.748546 (+1172941us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54007693d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:06.748729 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389510400}
I20260709 12:25:06.973873 19101 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:06.859598 18889 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.058287 19109 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.967669 19113 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.814797 19155 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:06.799540 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.964056 19171 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:07.087093 18886 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:06.779673 19107 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.116315 19155 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.118937 19155 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.067535 18687 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:06.779750 19099 consensus_meta.cc:287] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.274s	user 0.007s	sys 0.005s
I20260709 12:25:07.100981 18674 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.075857 19179 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.084177 19096 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:07.120469 19028 consensus_meta.cc:287] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 12:25:07.108439 18831 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.096125 19024 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:07.110327 18939 consensus_meta.cc:287] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.002s
I20260709 12:25:07.111500 15832 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:07.112354 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:07.087675 16488 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:07.086577 19029 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.119123 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 566) took 3486 ms. Trace:
I20260709 12:25:06.817399 19042 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.117573 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:06.825692 18983 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.106801 19149 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.001s
I20260709 12:25:07.128151 15838 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:25:07.130002 15986 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:07.130842 18687 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:07.153224 19149 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.154301 18941 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:07.154474 19042 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:07.132740 15803 connection.cc:256] RPC call timeout handler was delayed by -1.5130724830000872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 12:25:07.120321 19193 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.161413 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 790) took 1087 ms. Trace:
I20260709 12:25:07.161777 19193 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.161877 16494 rpcz_store.cc:276] 0709 12:25:06.074424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.074581 (+   157us) service_pool.cc:224] Handling call
0709 12:25:06.087357 (+ 12776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.087846 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:06.088170 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.342869 (+254699us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.344903 (+  2034us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.345004 (+   101us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:06.345024 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.345148 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.161203 (+816055us) raft_consensus.cc:1685] finished
0709 12:25:07.161221 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.161355 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6205,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":50,"raft.queue_time_us":5169,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7050,"thread_start_us":253850,"threads_started":1,"wal-append.queue_time_us":281686}
I20260709 12:25:07.164001 19193 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.164139 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2580) took 3489 ms. Trace:
I20260709 12:25:07.164762 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:07.161345 15803 connection.cc:256] RPC call timeout handler was delayed by -1.3336106710003151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 12:25:07.168028 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:07.168788 19193 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:07.164484 15909 rpcz_store.cc:276] 0709 12:25:03.675199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.675331 (+   132us) service_pool.cc:224] Handling call
0709 12:25:03.675604 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.688135 (+1012531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.163923 (+2475788us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400153bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:07.164082 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219133696}
I20260709 12:25:07.170085 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.170614 15909 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:07.171334 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.138474 18674 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:07.171833 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 580) took 3509 ms. Trace:
I20260709 12:25:07.146693 15910 rpcz_store.cc:276] 0709 12:25:03.632659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.640332 (+  7673us) service_pool.cc:224] Handling call
0709 12:25:03.640582 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.492864 (+852282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.118843 (+2625979us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54003bf1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:07.119042 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957991680}
I20260709 12:25:07.173658 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.174189 15910 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:07.174921 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.148917 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:07.140790 15911 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:07.172206 15988 rpcz_store.cc:276] 0709 12:25:03.662077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.662199 (+   122us) service_pool.cc:224] Handling call
0709 12:25:05.467849 (+1805650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.468792 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.171641 (+1702849us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540036e2d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:07.171751 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4143689088}
I20260709 12:25:07.176698 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1242) took 2537 ms. Trace:
I20260709 12:25:07.177024 15911 rpcz_store.cc:276] 0709 12:25:04.640582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.034794 (+394212us) service_pool.cc:224] Handling call
0709 12:25:07.140252 (+2105458us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:25:07.140460 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.176467 (+ 36007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.176646 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14003584}
I20260709 12:25:07.151456 15906 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.142230 18855 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:07.100545 19134 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.114509 19101 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:25:07.200783 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.157259 18983 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.155205 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.186062 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.133383 19096 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.139950 19024 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.165393 15985 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:07.169299 19193 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:07.182999 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.180193 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.156847 19149 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:07.205718 15837 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:07.206583 15907 raft_consensus.cc:2410] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:07.206763 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.214745 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.215433 15831 raft_consensus.cc:2410] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:07.124934 19107 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.179606 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:07.175432 15910 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:07.180119 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:07.218225 15832 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.217749 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.218776 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.219393 15910 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:25:07.223578 15802 leader_election.cc:336] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.512s (SENT)
I20260709 12:25:07.224184 15802 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:07.181007 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.208069 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.206573 15829 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:07.225345 15833 raft_consensus.cc:2393] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:07.160422 18687 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.172561 18674 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.131350 19099 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:07.180979 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 68674.3us
I20260709 12:25:07.229990 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:07.150799 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.210081 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.175628 19160 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.149578 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.147253 19028 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.145426 19144 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:07.226531 15981 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:07.227749 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.228312 15988 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:07.228221 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:07.212486 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.243326 15832 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:07.244256 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.232419 15834 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.206619 18923 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.234251 15913 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:25:07.233862 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:07.234776 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:07.248265 15911 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.245635 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.253666 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.254453 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:07.255681 15952 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.255790 18687 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:07.256366 18687 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:07.256529 19188 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.257113 19188 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:07.257344 18923 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.257906 19188 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.260167 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:07.264603 15911 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:07.155115 19029 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.245007 15985 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:07.243492 15909 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:07.147579 18939 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.235841 19133 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.233825 19165 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:07.268752 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 647357us
I20260709 12:25:07.273926 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:07.235211 19160 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.277645 19172 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:07.277488 19193 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.212397 19155 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:25:07.212613 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:07.244632 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.278249 19134 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:07.795501 18941 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.436373 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 175518us
W20260709 12:25:07.470407 15802 leader_election.cc:336] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.873s (SENT)
I20260709 12:25:07.844345 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:07.845156 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 374773us
W20260709 12:25:07.846154 15802 leader_election.cc:336] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.883s (SENT)
I20260709 12:25:07.846499 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:07.443531 16460 leader_election.cc:336] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 2.041s (SENT)
W20260709 12:25:07.847612 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 404115us
I20260709 12:25:07.795804 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:07.782277 15834 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 12:25:07.849732 15834 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
W20260709 12:25:07.260155 19190 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:25:07.797312 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 561787us
W20260709 12:25:07.862040 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.843870 15952 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.805124 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1191) took 1110 ms. Trace:
I20260709 12:25:07.863512 15985 rpcz_store.cc:276] 0709 12:25:06.694738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.227992 (+533254us) service_pool.cc:224] Handling call
0709 12:25:07.805050 (+577058us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:07.755779 19179 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.000s
I20260709 12:25:07.244616 19196 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.580s
I20260709 12:25:07.808243 15980 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:07.816200 15838 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:07.868352 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.290473 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.869498 15988 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 3.
I20260709 12:25:07.870083 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1199) took 1054 ms. Trace:
W20260709 12:25:07.785792 19109 consensus_meta.cc:287] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 12:25:07.868060 15980 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:07.252916 18983 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:07.825718 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:07.850224 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.875237 15986 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:07.241705 19187 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:07.286271 19181 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:07.259614 19144 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.865073 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.797005 19099 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.881222 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.805713 15981 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.870452 15988 rpcz_store.cc:276] 0709 12:25:06.815908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.260012 (+444104us) service_pool.cc:224] Handling call
0709 12:25:07.870017 (+610005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:07.808360 19172 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.876530 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.889691 15838 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:07.873418 15980 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.797297 19024 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.694861 19028 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:07.879235 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:07.901796 15980 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.901996 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.904947 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1198) took 1089 ms. Trace:
I20260709 12:25:07.905375 15986 rpcz_store.cc:276] 0709 12:25:06.815606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.885305 (+1069699us) service_pool.cc:224] Handling call
0709 12:25:07.904884 (+ 19579us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:07.839565 18674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.006s
I20260709 12:25:07.881846 15985 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:07.890229 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.920419 15831 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:07.286438 19038 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.611s
I20260709 12:25:07.892997 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:07.921736 15838 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
W20260709 12:25:07.920842 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44070.7us
W20260709 12:25:07.895762 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.871366 19045 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:07.906810 19187 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:07.864362 19132 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:25:07.880282 19181 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.866961 19101 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:25:07.314795 18687 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.915726 19029 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:07.917227 18923 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.004s
I20260709 12:25:07.871667 19179 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.877584 19109 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.919968 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1666) took 1287 ms. Trace:
I20260709 12:25:07.891165 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:07.921797 15981 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:07.864003 18941 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:07.861011 19133 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.932789 19187 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:07.951493 15984 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:25:07.964066 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 596) took 1673 ms. Trace:
I20260709 12:25:07.964345 15984 rpcz_store.cc:276] 0709 12:25:06.290719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.950829 (+1660110us) service_pool.cc:224] Handling call
0709 12:25:07.951215 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.963842 (+ 12627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.964017 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:07.954846 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 597) took 1596 ms. Trace:
I20260709 12:25:07.966176 15982 rpcz_store.cc:276] 0709 12:25:06.358426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.953876 (+1595450us) service_pool.cc:224] Handling call
0709 12:25:07.954228 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.954442 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.954482 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.954539 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:07.954583 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.954664 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.954782 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:07.955080 15906 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:07.955204 15830 rpcz_store.cc:276] 0709 12:25:06.632226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.638473 (+  6247us) service_pool.cc:224] Handling call
0709 12:25:06.638774 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.639078 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.639106 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.639547 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.872187 (+232640us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:07.066822 (+194635us) log.cc:844] Serialized 14 byte log entry
0709 12:25:07.081679 (+ 14857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.081752 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.919767 (+838015us) raft_consensus.cc:1685] finished
0709 12:25:07.919788 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.919911 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14594,"prepare.queue_time_us":194556,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":16923,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3297,"thread_start_us":325368,"threads_started":2,"wal-append.queue_time_us":457754}
I20260709 12:25:07.955416 15979 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.932763 15988 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:25:07.970112 15988 pending_rounds.cc:85] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 8
I20260709 12:25:07.970352 15988 pending_rounds.cc:107] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:07.970597 15988 raft_consensus.cc:2889] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:07.970793 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 593) took 1705 ms. Trace:
I20260709 12:25:07.971199 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 595) took 1685 ms. Trace:
I20260709 12:25:07.971161 15985 rpcz_store.cc:276] 0709 12:25:06.285427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.924709 (+1639282us) service_pool.cc:224] Handling call
0709 12:25:07.970357 (+ 45648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.970508 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.970531 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.970569 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:07.970600 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.970654 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.970745 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:07.921954 18674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.006s
I20260709 12:25:07.971628 15988 rpcz_store.cc:276] 0709 12:25:06.286106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.923582 (+1637476us) service_pool.cc:224] Handling call
0709 12:25:07.923889 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.970984 (+ 47095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.971151 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:07.955423 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 679) took 2017 ms. Trace:
I20260709 12:25:07.467669 18675 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.418s
I20260709 12:25:07.929840 15952 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.974987 15982 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:25:07.978046 15982 pending_rounds.cc:85] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 5
I20260709 12:25:07.978327 15982 pending_rounds.cc:107] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:07.978638 15982 raft_consensus.cc:2889] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:07.959635 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 1.46515e+06us
W20260709 12:25:07.957794 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.982879 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:07.983748 15986 raft_consensus.cc:2410] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:07.933689 19045 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.987542 15988 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.988116 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1197) took 1173 ms. Trace:
I20260709 12:25:07.988479 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1193) took 1293 ms. Trace:
I20260709 12:25:07.988412 15988 rpcz_store.cc:276] 0709 12:25:06.815232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.974267 (+1159035us) service_pool.cc:224] Handling call
0709 12:25:07.987385 (+ 13118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.987901 (+   516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.988053 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:07.949546 15983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 590) took 1779 ms (client timeout 2041 ms). Trace:
W20260709 12:25:07.989462 15983 rpcz_store.cc:269] 0709 12:25:06.170679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.276447 (+105768us) service_pool.cc:224] Handling call
0709 12:25:07.949372 (+1672925us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b540036e2d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:07.949494 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80872320}
I20260709 12:25:07.988137 16457 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.992962 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1196) took 1212 ms. Trace:
I20260709 12:25:07.993542 15985 rpcz_store.cc:276] 0709 12:25:06.780218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.972541 (+1192323us) service_pool.cc:224] Handling call
0709 12:25:07.992360 (+ 19819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.992566 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.992598 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.992653 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:07.992706 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.992774 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.992894 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:07.891845 19172 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:07.996775 16459 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.184s (SENT) [suppressed 23 similar messages]
I20260709 12:25:07.999284 18675 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.999794 18675 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:08.000231 18675 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.002314 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.003116 15829 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:08.004551 15829 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:07.974474 15835 rpcz_store.cc:276] 0709 12:25:05.938429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.938552 (+   123us) service_pool.cc:224] Handling call
0709 12:25:05.938812 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.412229 (+473417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.412259 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.412297 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:06.412331 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.955184 (+1542853us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54004074d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:07.955239 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.955362 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088313088}
I20260709 12:25:08.006428 19028 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.006865 19028 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:08.006963 19207 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.007860 19028 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.008369 19207 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.010161 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:08.010437 19207 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:07.985108 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:08.011425 15908 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:08.017632 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 141172us
I20260709 12:25:08.018745 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 513) took 1344 ms. Trace:
I20260709 12:25:08.019127 16488 rpcz_store.cc:276] 0709 12:25:06.674108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.674254 (+   146us) service_pool.cc:224] Handling call
0709 12:25:06.765367 (+ 91113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.146570 (+381203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.018496 (+871926us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540066b054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:08.018683 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740717440}
I20260709 12:25:07.981643 19029 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:07.950105 18923 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.988876 15982 rpcz_store.cc:276] 0709 12:25:06.695310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.966998 (+1271688us) service_pool.cc:224] Handling call
0709 12:25:07.967232 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.988276 (+ 21044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.988428 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:08.021534 19206 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.022056 19206 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.022886 19072 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.024148 19206 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.024641 19206 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.025048 19206 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:07.936902 19165 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.948122 18939 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:07.995615 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 65879.9us
I20260709 12:25:07.991586 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:07.958274 19181 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.954638 19109 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:07.953136 19179 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.937309 19155 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.924268 19173 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:25:08.028053 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.028615 19183 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.960960 19133 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:07.957720 19132 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:08.033470 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:08.059521 15911 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:25:07.957466 18941 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:08.010898 19207 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:07.958833 19187 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.064860 19160 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.050268 19221 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:08.052228 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.091269 15982 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:08.047210 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:07.995965 19045 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.029356 15986 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:08.060959 19132 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:08.045354 19028 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.986582 18924 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:25:08.070205 19206 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.026909 19033 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:25:08.049232 15876 connection.cc:256] RPC call timeout handler was delayed by -1.4067973420001181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 12:25:08.115335 15876 connection.cc:256] RPC call timeout handler was delayed by -1.2105973420002556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 12:25:08.115082 19132 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:08.115684 15876 connection.cc:256] RPC call timeout handler was delayed by -1.2006973420002396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 12:25:08.115983 15876 connection.cc:256] RPC call timeout handler was delayed by -1.1272045999999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:25:08.116278 15876 connection.cc:256] RPC call timeout handler was delayed by -1.1128045999998903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 12:25:08.116313 19132 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:08.116676 15876 connection.cc:256] RPC call timeout handler was delayed by -1.0386973419999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 12:25:08.081333 15979 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:08.056916 18939 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:08.117616 15981 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:08.060348 19183 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.118105 19183 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.055544 19109 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:08.118834 19109 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.119237 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:08.089862 19173 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:08.097271 19184 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.308s	user 0.008s	sys 0.010s
I20260709 12:25:08.121236 19173 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:08.122030 19173 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.123278 19173 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.055311 19215 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:08.125320 19215 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.127288 19215 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:08.098821 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51771.2us
I20260709 12:25:08.102257 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.106774 15980 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:08.128614 16487 raft_consensus.cc:2410] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:25:08.128978 18995 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:25:08.129757 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1724) took 3091 ms. Trace:
I20260709 12:25:08.130218 15980 rpcz_store.cc:276] 0709 12:25:05.038326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.664882 (+626556us) service_pool.cc:224] Handling call
0709 12:25:05.680239 (+ 15357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.808133 (+2127894us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54000e3ba0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc21adc0 00007f03cc2a51c0 00007f03cc2a6231 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c
0709 12:25:08.128776 (+320643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.129700 (+   924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769784192}
I20260709 12:25:08.131460 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:08.132535 15980 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.102820 19221 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.133843 18924 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:08.134248 18924 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:08.113026 19188 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.135243 19188 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:08.108932 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 229801us
W20260709 12:25:08.110760 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 264615us
W20260709 12:25:08.088752 19096 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.871s	user 0.010s	sys 0.000s
I20260709 12:25:08.113412 15908 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:08.103076 18986 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:08.117542 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.056069 15830 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:08.135057 18924 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.135300 19150 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.135890 19188 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:08.136449 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.128628 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.182463 15982 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:08.183591 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:08.185580 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 68101.2us
I20260709 12:25:08.120779 19109 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:08.128553 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:08.106979 15879 leader_election.cc:336] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Timed out: RequestConsensusVote RPC to 127.14.78.68:43743 timed out after 1.513s (SENT)
W20260709 12:25:08.138430 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 146947us
I20260709 12:25:08.190028 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.139835 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:08.192248 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52586.2us
W20260709 12:25:08.193063 15802 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.523s (SENT)
I20260709 12:25:08.193292 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:08.160154 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2599) took 1008 ms. Trace:
I20260709 12:25:08.166811 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:08.194447 15979 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.194199 15906 rpcz_store.cc:276] 0709 12:25:07.155974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.212390 (+ 56416us) service_pool.cc:224] Handling call
0709 12:25:08.159902 (+947512us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540010b654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:08.160076 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320012544}
I20260709 12:25:08.152932 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 585) took 1810 ms. Trace:
I20260709 12:25:08.187973 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:08.188647 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 69480.1us
I20260709 12:25:08.187970 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.184362 15982 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:08.195649 15912 rpcz_store.cc:276] 0709 12:25:06.342211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.411391 (+ 69180us) service_pool.cc:224] Handling call
0709 12:25:06.413755 (+  2364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.516010 (+102255us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:06.568201 (+ 52191us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.781733 (+213532us) log.cc:844] Serialized 14 byte log entry
0709 12:25:07.169937 (+388204us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b18004841e0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:07.268235 (+ 98298us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18004841e0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:07.268371 (+   136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.268416 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:07.268466 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.152620 (+884154us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400431054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:08.152684 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.152855 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129720,"prepare.queue_time_us":52046,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":508529,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"spinlock_wait_cycles":334853120,"thread_start_us":212747,"threads_started":1,"wal-append.queue_time_us":501765,"wal-append.run_cpu_time_us":1483,"wal-append.run_wall_time_us":1058033}
I20260709 12:25:08.200824 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.201786 15982 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:25:08.202752 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.202966 15983 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:08.203516 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1209) took 1028 ms. Trace:
I20260709 12:25:08.203830 15983 rpcz_store.cc:276] 0709 12:25:07.174981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.150265 (+975284us) service_pool.cc:224] Handling call
0709 12:25:08.202664 (+ 52399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.203293 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.203467 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:08.204592 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 76109.4us
I20260709 12:25:08.087544 19207 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.230943 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.222024 15985 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:25:08.232961 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 236194us
I20260709 12:25:08.233284 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1211) took 1005 ms. Trace:
I20260709 12:25:08.233811 15985 rpcz_store.cc:276] 0709 12:25:07.227450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.181338 (+953888us) service_pool.cc:224] Handling call
0709 12:25:08.221713 (+ 40375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.232979 (+ 11266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.233221 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:08.223043 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.205318 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:08.224015 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 117051us
W20260709 12:25:08.235464 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 47596.9us
I20260709 12:25:08.225968 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 794) took 1603 ms. Trace:
I20260709 12:25:08.225852 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:08.227151 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1190) took 1557 ms. Trace:
I20260709 12:25:08.230607 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.236156 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.236496 15981 rpcz_store.cc:276] 0709 12:25:06.669478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.955792 (+1286314us) service_pool.cc:224] Handling call
0709 12:25:08.117447 (+161655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.118017 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.226924 (+108907us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400013bd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:08.227084 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371195776}
I20260709 12:25:08.236212 16487 rpcz_store.cc:276] 0709 12:25:06.622969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.623157 (+   188us) service_pool.cc:224] Handling call
0709 12:25:08.225790 (+1602633us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400522954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:08.225913 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3445941120}
I20260709 12:25:08.237306 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.237929 16495 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 4.
I20260709 12:25:08.181149 19033 consensus_queue.cc:1243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:08.238205 19179 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:08.239091 19160 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.239363 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:08.239626 19206 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.239848 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.240163 19206 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:08.240451 16486 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:08.241017 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.241317 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:08.241169 19206 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.241693 16492 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:08.242520 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2589) took 1763 ms. Trace:
I20260709 12:25:08.242695 16489 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:08.204938 19026 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.237950 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:08.235188 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:08.245421 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 127065us
I20260709 12:25:08.239123 16490 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:08.241386 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.242919 15904 rpcz_store.cc:276] 0709 12:25:06.478896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.078543 (+599647us) service_pool.cc:224] Handling call
0709 12:25:07.113791 (+ 35248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.278509 (+164718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.278541 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.861460 (+582919us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.112781 (+251321us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:08.112818 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.113229 (+   411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.242332 (+129103us) raft_consensus.cc:1685] finished
0709 12:25:08.242350 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.242466 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168504,"raft.queue_time_us":164594,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":44,"thread_start_us":223038,"threads_started":1,"wal-append.queue_time_us":364168}
I20260709 12:25:08.248486 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:08.249120 15983 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.251910 15980 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:08.153137 18986 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:08.266649 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.277673 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.205211 19150 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:08.201864 19224 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.279356 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:08.230542 18983 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.290691 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.291492 15985 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:08.244769 18924 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.182898 19096 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.280742 15909 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:08.296168 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:08.280887 19223 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:08.281291 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:08.300384 15904 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:08.232514 19212 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.282920 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.244875 18941 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.304762 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:08.232758 19038 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.288033 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:08.288436 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 94564.4us
I20260709 12:25:08.284585 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.307819 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:08.308487 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 70603.1us
I20260709 12:25:08.280330 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.309280 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.310118 19208 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:08.310179 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.289179 15979 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:08.296919 15912 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.310698 19208 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.311141 19208 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.311435 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.253799 19134 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:08.244340 19109 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:25:08.284982 19166 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:08.304509 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.308614 19033 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.310560 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:08.304234 16490 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:08.273530 19144 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.286010 19150 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:08.312891 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:08.313374 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.288488 19211 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:08.293740 19042 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.258780 19026 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:08.319559 15802 leader_election.cc:336] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.158s (SENT)
I20260709 12:25:08.322737 19072 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:08.323082 16496 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:08.323974 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.326856 16489 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:08.327804 15912 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:08.305284 18939 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:08.305446 19224 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.295712 19215 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:25:08.327759 15876 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.316949 19193 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:08.387012 19193 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:08.387262 19203 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:25:08.388067 19193 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.306087 19179 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:08.388970 19216 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:08.318279 19134 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.390152 19134 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.389798 19179 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.321004 19171 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:08.407387 16488 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:08.375053 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.375118 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:08.324299 19166 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.434828 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.335623 19144 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:08.377302 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.323709 18941 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.383750 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:08.457950 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.458603 15836 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
W20260709 12:25:08.398676 19214 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:08.384333 19224 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:08.384567 19033 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:25:08.405603 19210 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:25:08.405707 18939 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:08.345708 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.332728 19221 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:08.410106 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 82414.3us
I20260709 12:25:08.470463 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.471597 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.334028 19150 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.333524 19106 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:08.425489 19212 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:08.449479 19166 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.331835 18986 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.440698 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.442701 15831 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.459506 19144 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:08.453338 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 209593us
I20260709 12:25:08.487778 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:08.454375 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 175091us
I20260709 12:25:08.379170 19211 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:08.377157 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 57615.5us
I20260709 12:25:08.489611 19211 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:08.490844 15802 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.783s (SENT)
I20260709 12:25:08.491268 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:08.462055 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 84832.3us
I20260709 12:25:08.388059 19203 consensus_queue.cc:1243] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:08.462967 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.492766 15833 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:08.463639 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.406831 19096 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:08.407464 19171 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.330473 19227 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 12:25:08.473145 19165 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:08.470366 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 190120us
I20260709 12:25:08.479521 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.433858 16487 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:08.449218 19223 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:08.440220 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:08.482594 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 174853us
I20260709 12:25:08.449479 19230 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:08.379865 19072 consensus_queue.cc:1243] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:08.486603 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.473891 19224 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.406632 18675 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.397372 19042 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.499487 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.499770 15838 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
W20260709 12:25:08.502133 15802 leader_election.cc:336] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.642s (SENT)
I20260709 12:25:08.462610 18941 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.393392 19183 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.478780 19109 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.514241 18941 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:08.514415 19109 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.514804 19109 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.514953 16495 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:08.498195 19155 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.516346 15982 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:08.494632 19171 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.504920 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.500846 15952 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.510859 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.517808 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2588) took 2039 ms. Trace:
I20260709 12:25:08.521546 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.522181 15838 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.521631 15905 rpcz_store.cc:276] 0709 12:25:06.478685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.070423 (+591738us) service_pool.cc:224] Handling call
0709 12:25:07.070710 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:07.269371 (+198661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.269414 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:07.861591 (+592177us) log.cc:844] Serialized 52 byte log entry
0709 12:25:08.110276 (+248685us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:08.110315 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.110377 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.517610 (+407233us) raft_consensus.cc:1685] finished
0709 12:25:08.517627 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.517753 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198274,"raft.queue_time_us":207543,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":46,"thread_start_us":219596,"threads_started":1,"wal-append.queue_time_us":373513}
I20260709 12:25:08.486203 19106 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:08.518711 15837 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:08.495955 19144 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.529422 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.509938 19107 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.485977 19233 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.501876 19165 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.486619 18983 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 12:25:08.551788 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50993.4us
I20260709 12:25:08.560002 15838 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 4.
I20260709 12:25:08.510165 19207 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:08.613418 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50011.5us
I20260709 12:25:08.504050 19203 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:25:08.617110 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:08.617882 15908 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:08.617113 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:08.618860 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.619351 15905 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.527688 19237 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.518030 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:08.565171 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 63071.8us
I20260709 12:25:08.569751 19230 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:08.572337 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 71530.2us
W20260709 12:25:08.639921 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 121959us
I20260709 12:25:08.640336 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.640733 15983 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:08.572914 19206 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.602679 18675 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:08.602679 19106 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.563990 19165 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.514243 19183 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.606009 19026 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:08.606587 19134 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.610288 19042 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:08.561101 15834 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.563200 19155 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.562549 19132 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:08.642278 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.643079 15983 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.643489 15879 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:08.686194 15983 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.645227 15832 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:08.688297 15832 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:08.623569 19172 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.002s
I20260709 12:25:08.622736 19096 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:08.636399 19187 consensus_meta.cc:287] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 12:25:08.650432 19183 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:08.650703 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.653358 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.653944 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.654487 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.649887 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:08.657788 19173 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.005s
W20260709 12:25:08.658064 19028 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.001s
W20260709 12:25:08.664040 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 167441us
W20260709 12:25:08.665902 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.667290 19181 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.000s
W20260709 12:25:08.669359 19045 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.001s
I20260709 12:25:08.673554 15905 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:08.686126 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.644399 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.712370 15829 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:08.697970 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.639499 19237 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.715538 19237 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.716698 19230 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.682690 15835 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:08.700150 19206 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:08.689306 15832 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:08.725013 15832 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:08.705964 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56125.9us
I20260709 12:25:08.705422 15830 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:08.707660 16459 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.725948 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:08.708072 15802 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.910s (SENT)
I20260709 12:25:08.713853 18941 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:08.713994 19244 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:08.715035 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.721369 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.646306 19233 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.700366 19096 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.726635 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:08.729593 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.729013 15834 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:08.733879 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:08.742362 15832 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:25:08.749652 15832 pending_rounds.cc:85] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 10
I20260709 12:25:08.743325 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.750389 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:08.702534 19245 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:08.704885 19132 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:08.738245 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.712387 19221 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:08.722246 19183 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:08.752729 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.753088 15837 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:08.754464 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.751863 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:08.755375 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.756314 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.757463 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:08.758013 15832 pending_rounds.cc:107] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:25:08.730595 19206 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:08.813714 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.818055 15832 raft_consensus.cc:2889] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:08.818531 15835 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:08.819074 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 61489.4us
I20260709 12:25:08.819762 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:08.819968 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:08.700017 19172 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.746357 19106 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.822235 15834 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:08.823160 15829 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.639112 19212 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.744230 19233 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.825256 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:25:08.824213 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72394.4us
I20260709 12:25:08.824096 18923 raft_consensus.cc:2764] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:08.707507 19187 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.753111 19096 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.737879 18941 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:08.827785 15835 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:08.821455 15832 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:08.744143 19207 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.729763 19179 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:25:08.723378 19045 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.754477 19203 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.752707 19173 raft_consensus.cc:2764] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:08.722700 19181 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.758718 19155 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.755409 19221 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:08.843204 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:08.849869 19248 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:08.850339 19187 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:08.850827 15986 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:08.850689 19211 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:08.852645 19208 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.000s
I20260709 12:25:08.829377 19134 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:08.856227 19238 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.964567 15984 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:08.831847 19172 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:08.859045 19099 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:08.859342 19188 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.001s
I20260709 12:25:08.820986 19206 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.882192 15803 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:08.986004 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 103943us
W20260709 12:25:08.863045 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.883468 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 323117us
I20260709 12:25:08.833366 19132 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.894608 19150 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:08.889734 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 174758us
I20260709 12:25:08.997560 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:08.892737 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.893396 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68196.4us
I20260709 12:25:08.895196 15835 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:08.827124 19106 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.830585 19223 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.826725 19249 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:08.881970 18939 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:08.904531 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61452.2us
I20260709 12:25:08.842777 19233 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.016422 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:08.906394 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 165197us
I20260709 12:25:08.890316 18941 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.022174 15909 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:08.849004 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.943763 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:09.023080 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 79472.2us
I20260709 12:25:08.946168 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 514) took 2248 ms. Trace:
I20260709 12:25:09.024020 16496 rpcz_store.cc:276] 0709 12:25:06.697895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.698020 (+   125us) service_pool.cc:224] Handling call
0709 12:25:06.768761 (+ 70741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.377877 (+1609116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.945815 (+567938us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400619ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:08.946081 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3574165888}
I20260709 12:25:08.950356 16492 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:08.955251 15830 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:08.962025 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:08.903584 18924 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.603s	user 0.004s	sys 0.005s
I20260709 12:25:08.905736 19221 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.985123 16495 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:08.981395 19245 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:09.007022 19106 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.894444 19033 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:25:08.990854 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:08.992056 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.900324 18845 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:25:08.890836 19026 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:25:09.000342 15904 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:09.000912 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.103220 15908 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.002527 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:08.981627 19196 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:09.005172 15952 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:09.108631 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 103586us
I20260709 12:25:08.974915 19248 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:09.008747 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:09.009346 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:08.963907 19238 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:09.019629 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.021011 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:09.026005 16489 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:09.026597 15802 leader_election.cc:336] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 3.249s (SENT)
I20260709 12:25:09.017514 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:09.118948 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:09.030683 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.119892 15911 raft_consensus.cc:2376] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5. Re-sending same reply.
I20260709 12:25:08.908322 19155 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.987886 19114 raft_consensus.cc:2764] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:25:09.033990 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:08.912266 19165 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:08.880568 15829 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:09.122603 15829 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:25:09.123577 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 89690.8us
I20260709 12:25:09.124112 15908 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
W20260709 12:25:09.125257 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 104473us
I20260709 12:25:09.037410 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:09.011691 19249 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.006184 19223 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:09.065878 15907 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:09.035374 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:09.010149 18939 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:09.035137 19109 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260709 12:25:09.107267 19172 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.967022 19208 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:09.099578 15979 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:08.973271 19183 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:09.009171 19149 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:25:08.988372 19188 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:09.127962 15980 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:09.032382 19179 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:09.131728 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 114288us
I20260709 12:25:09.126400 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:09.161862 15979 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:09.172582 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:09.108309 19196 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:09.174268 15833 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:09.167815 16489 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:09.169317 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:09.118484 19211 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.175582 15986 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.177736 15830 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:09.186257 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.145960 18939 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:09.188791 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:09.134110 19249 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:09.189428 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 63104.9us
W20260709 12:25:09.134017 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:09.134310 19215 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:09.193102 15831 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:09.198295 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:09.203183 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.205680 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.129523 18866 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:25:09.198812 15879 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:09.198880 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:09.255913 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.190124 19114 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.183856 19174 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.256690 15905 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:09.258301 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 231728us
I20260709 12:25:09.261721 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.262260 15911 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:09.262734 15802 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 3.264s (SENT)
I20260709 12:25:09.263136 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:09.258728 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:09.259361 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.264397 15912 raft_consensus.cc:2410] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:25:09.258394 16496 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:25:09.257633 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 58900.4us
I20260709 12:25:09.291654 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.146104 19176 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.307s
I20260709 12:25:09.259007 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.171240 19172 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:09.246153 19262 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:09.319545 15907 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:09.294411 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:09.293320 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 258001us
I20260709 12:25:09.322599 15988 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:09.197947 19179 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:09.197160 19099 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:09.323318 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:09.175971 19109 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:09.257293 19045 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:09.201251 19245 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:09.256635 19248 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:09.335819 19114 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.761219 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2695) took 1119 ms. Trace:
I20260709 12:25:09.326479 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.343011 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:09.368558 15908 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:09.331799 15911 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:09.520476 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 201285us
I20260709 12:25:09.834102 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.835155 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:09.543556 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.841883 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.842800 15912 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:09.836556 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.845623 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:09.832543 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 569773us
W20260709 12:25:09.860492 15802 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.955s (SENT)
I20260709 12:25:09.831583 15831 rpcz_store.cc:276] 0709 12:25:08.641375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.641502 (+   127us) service_pool.cc:224] Handling call
0709 12:25:09.760980 (+1119478us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400039b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:09.761134 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120350080}
W20260709 12:25:09.885447 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.244745 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 113716us
W20260709 12:25:09.334671 19144 consensus_meta.cc:287] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.002s
W20260709 12:25:09.427888 19237 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:25:09.316684 19238 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:09.344022 19261 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.840586 18687 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.550006 19265 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 12:25:09.292975 19181 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:09.466308 19256 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
W20260709 12:25:09.504694 19210 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:25:09.755653 19220 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.426s	user 0.010s	sys 0.004s
I20260709 12:25:09.467058 19263 raft_consensus.cc:2764] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:09.193655 19211 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:09.467216 19266 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:09.932611 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.917943 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.466955 19226 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:09.371465 19260 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:25:09.466795 19259 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:09.724018 18941 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.003s
I20260709 12:25:09.463883 18845 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:09.812726 19171 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.245s	user 0.011s	sys 0.000s
W20260709 12:25:09.689126 19267 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
W20260709 12:25:09.932608 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 72149.9us
I20260709 12:25:10.067152 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.067744 15908 raft_consensus.cc:2376] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8. Re-sending same reply.
W20260709 12:25:10.068112 15802 leader_election.cc:336] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.161s (SENT)
I20260709 12:25:10.068511 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:10.023378 19042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.005s	sys 0.023s
I20260709 12:25:09.521030 19254 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.957615 15913 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:09.955662 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:09.957772 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:09.959446 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:09.197409 19230 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.722s
I20260709 12:25:09.645974 19165 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:09.345316 19275 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:09.322889 19215 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:09.961865 19024 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.702589 19150 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:09.835750 19179 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:09.650211 19155 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:09.840524 19099 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:09.966549 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:09.829917 19114 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:09.467350 19239 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.997462 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2715) took 1247 ms. Trace:
I20260709 12:25:09.944643 18986 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:09.998412 15910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.010s	sys 0.017s
W20260709 12:25:10.003561 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.003s	sys 0.024s
W20260709 12:25:10.003909 15979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.014s	sys 0.014s
I20260709 12:25:09.904377 19149 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 12:25:09.999082 19166 consensus_meta.cc:287] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.504s	user 0.006s	sys 0.005s
I20260709 12:25:09.967137 19162 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:09.655005 19224 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.139s	user 0.009s	sys 0.000s
I20260709 12:25:09.962428 19144 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:09.962828 19237 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.083483 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.024106 18886 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:09.687084 19196 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:09.967928 18687 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.438176 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.096254 19254 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.451335 18886 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.452167 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.452950 15907 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:10.453068 19254 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:10.282178 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 939187us
I20260709 12:25:10.453943 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.066010 18941 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.411253 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:10.454896 19166 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:10.411899 19280 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:25:10.420120 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:10.488525 15907 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:10.488814 15986 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:10.441637 19207 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.543s	user 0.012s	sys 0.000s
W20260709 12:25:10.385617 19212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.011s	sys 0.025s
W20260709 12:25:10.429570 19232 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 2.106s	user 0.005s	sys 0.009s
I20260709 12:25:10.385401 19211 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:10.414806 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 1.40366e+06us
W20260709 12:25:10.204097 19249 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.948s	user 0.008s	sys 0.002s
W20260709 12:25:10.172525 19223 consensus_meta.cc:287] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.002s	user 0.006s	sys 0.000s
I20260709 12:25:10.499433 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:10.385733 19229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.001s	sys 0.036s
W20260709 12:25:10.448796 16494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 604) took 2257 ms (client timeout 2608 ms). Trace:
W20260709 12:25:10.501880 15879 connection.cc:256] RPC call timeout handler was delayed by -1.4676701710000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2928s for a response
I20260709 12:25:10.431541 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1192) took 3736 ms. Trace:
W20260709 12:25:10.072933 19256 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:10.040915 18675 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:10.459921 15910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.016s	sys 0.025s
I20260709 12:25:10.253562 15980 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:10.460582 15979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.014s	sys 0.028s
I20260709 12:25:10.510928 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1750) took 1491 ms. Trace:
I20260709 12:25:10.255466 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.512566 15912 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:10.461627 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.349s	user 0.006s	sys 0.035s
W20260709 12:25:10.513185 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 1.45203e+06us
I20260709 12:25:10.513831 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:10.432780 19266 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:10.498754 19207 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.030483 19238 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:10.242861 15988 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1749) took 1254 ms (client timeout 1531 ms). Trace:
I20260709 12:25:10.384588 19187 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:25:10.453969 18886 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:10.252358 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 597) took 1233 ms. Trace:
W20260709 12:25:10.137750 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 178342us
I20260709 12:25:10.557152 15913 rpcz_store.cc:276] 0709 12:25:09.018697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.019416 (+   719us) service_pool.cc:224] Handling call
0709 12:25:10.252139 (+1232723us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54001162d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:10.252289 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931091328}
I20260709 12:25:10.558431 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.558794 19165 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:10.559242 15913 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:10.559489 19165 consensus_queue.cc:1243] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:10.560910 19133 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.519826 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.561322 19133 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:10.561816 15912 raft_consensus.cc:2410] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:25:10.562068 15731 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 175) took 39214 ms (client timeout 15000 ms). Trace:
I20260709 12:25:10.562168 19133 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.562654 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:10.563369 19283 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:10.563447 19133 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.564114 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:10.564675 15836 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:10.447315 15987 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.011s
W20260709 12:25:10.565207 15987 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.008s	sys 0.011s
I20260709 12:25:10.487296 19239 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.560050 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.566836 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:10.176607 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.569240 16492 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.569530 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1251) took 1365 ms. Trace:
I20260709 12:25:10.569947 15908 rpcz_store.cc:276] 0709 12:25:09.204119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.068289 (+864170us) service_pool.cc:224] Handling call
0709 12:25:10.569477 (+501188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:10.041210 19226 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:10.291783 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 223674us
I20260709 12:25:10.580617 15836 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:10.468390 15830 rpcz_store.cc:276] 0709 12:25:08.749716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.034778 (+285062us) service_pool.cc:224] Handling call
0709 12:25:09.035080 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.178138 (+143058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.997177 (+819039us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400406ad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:09.997382 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310917504}
W20260709 12:25:10.074257 19042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.005s	sys 0.024s
I20260709 12:25:10.249922 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:10.500160 19174 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:10.250892 19202 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:25:10.227934 19106 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.126s	user 0.006s	sys 0.001s
W20260709 12:25:10.036823 19134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.021s	sys 0.013s
I20260709 12:25:10.224978 19290 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:10.075874 19259 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.459162 19269 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.443s	user 0.000s	sys 0.001s
W20260709 12:25:10.427659 19221 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.318s	user 0.004s	sys 0.004s
W20260709 12:25:10.208634 18939 consensus_meta.cc:287] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.001s	user 0.009s	sys 0.001s
I20260709 12:25:10.094867 19176 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:10.498718 15982 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:10.496416 15833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2694) took 1855 ms (client timeout 1818 ms). Trace:
I20260709 12:25:10.500715 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:10.626014 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 125365us
I20260709 12:25:10.251261 19033 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.170749 19044 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:10.244810 18924 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:10.173166 19153 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.501092 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:10.639648 16496 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:10.502257 16494 rpcz_store.cc:269] 0709 12:25:08.191599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.222826 (+ 31227us) service_pool.cc:224] Handling call
0709 12:25:10.448518 (+2225692us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b540039ce54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:10.448695 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397752192}
I20260709 12:25:10.449438 19208 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:10.281746 19262 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:10.291927 19132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.021s
I20260709 12:25:10.502429 19024 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.466094 19179 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:10.516451 15986 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:10.511277 15979 rpcz_store.cc:276] 0709 12:25:09.019965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.173095 (+153130us) service_pool.cc:224] Handling call
0709 12:25:09.173478 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.178720 (+  5242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.178764 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.198368 (+ 19604us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.510612 (+1312244us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:10.510649 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.510713 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.510753 (+    40us) raft_consensus.cc:1685] finished
0709 12:25:10.510770 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.510879 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4817,"raft.queue_time_us":5390,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":7605,"thread_start_us":1192770,"threads_started":1,"wal-append.queue_time_us":967145}
I20260709 12:25:10.413125 19188 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:10.517571 15985 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:10.108923 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.456996 19114 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:10.502203 19229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.001s	sys 0.039s
W20260709 12:25:10.519795 15988 rpcz_store.cc:269] 0709 12:25:08.988622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.004119 (+ 15497us) service_pool.cc:224] Handling call
0709 12:25:10.242650 (+1238531us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400186fd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:10.242793 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702764288}
I20260709 12:25:10.555712 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 606) took 1430 ms. Trace:
I20260709 12:25:10.692077 15980 rpcz_store.cc:276] 0709 12:25:09.125769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.177977 (+ 52208us) service_pool.cc:224] Handling call
0709 12:25:10.253156 (+1075179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.510220 (+257064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.555450 (+ 45230us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400186fd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:10.555635 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420226816}
I20260709 12:25:10.204803 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2704) took 1561 ms. Trace:
I20260709 12:25:10.563970 19240 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.179s
I20260709 12:25:10.451041 15905 raft_consensus.cc:2410] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:25:10.168437 19096 consensus_meta.cc:287] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.281s	user 0.009s	sys 0.002s
W20260709 12:25:10.571080 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.572559 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:10.556119 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:10.573510 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:10.574430 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:10.066205 19171 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.631597 19221 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:10.715691 19233 consensus_meta.cc:287] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.679s	user 0.006s	sys 0.003s
I20260709 12:25:10.716091 19233 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.583067 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:10.595873 19174 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.717501 15912 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:10.494493 19289 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.568774 19239 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:10.498910 19212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.012s	sys 0.027s
I20260709 12:25:10.487109 19099 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.593429 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:10.594308 19286 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:10.706224 19295 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:10.596791 15835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.000s	sys 0.038s
W20260709 12:25:10.733649 15835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.311s	user 0.000s	sys 0.038s
I20260709 12:25:10.602603 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:10.734390 15908 raft_consensus.cc:2376] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8. Re-sending same reply.
I20260709 12:25:10.604740 19187 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:10.605429 19202 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.518982 19181 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:10.466082 19224 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.619464 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:10.623533 19299 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.581127 19254 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:10.631157 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:10.624676 15833 rpcz_store.cc:269] 0709 12:25:08.641096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.641213 (+   117us) service_pool.cc:224] Handling call
0709 12:25:10.467196 (+1825983us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54004079d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:10.496324 (+ 29128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077990144}
I20260709 12:25:10.590674 18866 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.601434 19134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.029s	sys 0.022s
I20260709 12:25:10.590807 19275 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:10.502444 15984 rpcz_store.cc:276] 0709 12:25:06.695046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.965141 (+1270095us) service_pool.cc:224] Handling call
0709 12:25:07.965386 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.964950 (+999564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.431238 (+1466288us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54002788d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:10.431454 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297502976}
W20260709 12:25:10.648593 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 192528us
I20260709 12:25:10.513969 19223 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.656737 19153 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:10.654929 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 137541us
I20260709 12:25:10.655694 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 600) took 1636 ms. Trace:
I20260709 12:25:10.616321 19207 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:10.656952 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:10.656224 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 406325us
I20260709 12:25:10.601882 19109 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:10.514276 19249 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.601598 19142 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:25:10.630306 19033 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:10.693321 15834 rpcz_store.cc:276] 0709 12:25:08.643541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.844120 (+200579us) service_pool.cc:224] Handling call
0709 12:25:08.844597 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.847797 (+  3200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.847825 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.860556 (+ 12731us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.010682 (+150126us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:09.010715 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.010773 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.204591 (+1193818us) raft_consensus.cc:1685] finished
0709 12:25:10.204610 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.204743 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2761,"raft.queue_time_us":2862,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"thread_start_us":103927,"threads_started":1,"wal-append.queue_time_us":263468}
I20260709 12:25:10.707232 19226 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.705628 19297 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.190s
I20260709 12:25:10.700480 19266 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:10.695655 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.639362 19107 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:10.602083 18886 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:25:10.633874 19044 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.639529 18924 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:10.658155 19132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.015s	sys 0.027s
I20260709 12:25:10.640945 19290 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:10.562503 15731 rpcz_store.cc:269] 0709 12:24:31.347377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.347648 (+   271us) service_pool.cc:224] Handling call
0709 12:25:10.561857 (+39214209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:01.022048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:01.022825 (+   777us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:01.022884 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:25:01.022917 (+    33us) tablet.cc:662] Decoding operations
0709 12:25:01.023719 (+   802us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:01.023799 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:01.023827 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:25:01.024299 (+   472us) tablet.cc:701] Row locks acquired
0709 12:25:01.024356 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:25:01.024588 (+   232us) write_op.cc:270] Start()
0709 12:25:01.024767 (+   179us) write_op.cc:276] Timestamp: P: 1783599901024508 usec, L: 0
0709 12:25:01.024783 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:25:01.298869 (+274086us) log.cc:844] Serialized 1355 byte log entry
0709 12:25:01.894072 (+595203us) op_driver.cc:464] REPLICATION: finished
0709 12:25:02.307611 (+413539us) write_op.cc:301] APPLY: starting
0709 12:25:02.307753 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:02.307959 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:02.308129 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:02.349601 (+ 41472us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:02.349896 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:25:02.349938 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:02.350220 (+   282us) log.cc:844] Serialized 35 byte log entry
0709 12:25:02.350398 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:02.350482 (+    84us) write_op.cc:454] Released schema lock
0709 12:25:02.350554 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:02.350937 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:02.350962 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25678,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":413183,"apply.run_cpu_time_us":2833,"apply.run_wall_time_us":43360,"num_ops":3,"prepare.queue_time_us":305367,"prepare.run_cpu_time_us":36394,"prepare.run_wall_time_us":542790,"raft.queue_time_us":170283,"raft.run_cpu_time_us":140409,"raft.run_wall_time_us":413449,"replication_time_us":869095,"thread_start_us":976438,"threads_started":4,"wal-append.queue_time_us":411086,"wal-append.run_cpu_time_us":28403,"wal-append.run_wall_time_us":1642978}]]}
W20260709 12:25:10.708832 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 152786us
I20260709 12:25:10.709091 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:10.709406 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:10.712155 19306 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:10.713176 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1257) took 1489 ms. Trace:
I20260709 12:25:10.713671 19166 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:10.709823 15829 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:10.722992 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:10.723907 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2709) took 2079 ms. Trace:
I20260709 12:25:10.617798 19106 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.594334 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:10.630100 18939 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:10.730206 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 136859us
I20260709 12:25:10.728207 19289 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.732101 19174 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:10.731981 19212 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:10.733633 15906 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:25:10.520586 18675 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:10.170138 19172 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:10.640657 19259 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.747910 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:11.093747 15837 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.765518 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:10.967566 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 609) took 1013 ms. Trace:
I20260709 12:25:11.095575 15830 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:25:10.994376 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1742) took 2870 ms. Trace:
I20260709 12:25:10.969399 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 528) took 1652 ms. Trace:
I20260709 12:25:11.094738 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:10.763986 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2711) took 2119 ms. Trace:
I20260709 12:25:11.096174 15838 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:10.774379 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:11.100137 15831 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:11.101078 15979 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:11.096393 15907 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:11.101644 16457 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:11.102459 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:11.096131 15985 rpcz_store.cc:276] 0709 12:25:08.124406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.328674 (+204268us) service_pool.cc:224] Handling call
0709 12:25:08.335987 (+  7313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.693097 (+2357110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.994080 (+300983us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b540011a3d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:10.994299 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5016788352}
I20260709 12:25:10.722946 19227 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.663504 19252 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:11.132602 15835 rpcz_store.cc:276] 0709 12:25:08.644891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.030162 (+385271us) service_pool.cc:224] Handling call
0709 12:25:09.104065 (+ 73903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.104677 (+   612us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:09.422541 (+317864us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.763659 (+1341118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.763707 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:10.763752 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.763812 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.763915 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29330,"prepare.queue_time_us":921271,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":54281,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":31619,"thread_start_us":1549347,"threads_started":2,"wal-append.queue_time_us":1226698}
I20260709 12:25:10.706178 19144 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.093905 15988 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:10.716761 19171 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:10.717881 19114 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:11.103408 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.158975 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:11.163339 16487 raft_consensus.cc:2368] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:11.112640 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:11.163900 15838 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:11.099010 16494 raft_consensus.cc:2376] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9. Re-sending same reply.
I20260709 12:25:11.110966 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:11.165180 15835 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:25:11.164340 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.165689 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.093109 15987 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:11.096616 15910 rpcz_store.cc:276] 0709 12:25:09.019796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.029797 (+ 10001us) service_pool.cc:224] Handling call
0709 12:25:09.030033 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.030217 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:09.293597 (+263380us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.655372 (+1361775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.655426 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:10.655470 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.655531 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.655639 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77789,"prepare.queue_time_us":517119,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":81069,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":20166,"thread_start_us":1504759,"threads_started":3,"wal-append.queue_time_us":880321}
I20260709 12:25:11.102574 15982 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:10.930248 19101 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:11.099426 16492 rpcz_store.cc:276] 0709 12:25:09.317559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.321824 (+  4265us) service_pool.cc:224] Handling call
0709 12:25:09.427294 (+105470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.569627 (+1142333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.969068 (+399441us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:10.969324 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625778560}
I20260709 12:25:11.163988 19229 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:11.093591 15905 rpcz_store.cc:276] 0709 12:25:09.223854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.083191 (+859337us) service_pool.cc:224] Handling call
0709 12:25:10.713113 (+629922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.174338 19229 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.174714 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:11.175408 15905 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:11.175062 18924 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.175694 19306 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:11.120096 15831 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:11.176072 19306 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:11.176124 18924 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.103835 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:11.143503 19299 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:11.177191 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 81042.2us
W20260709 12:25:11.177273 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73507.7us
I20260709 12:25:11.177809 15912 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.178045 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:11.176148 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.179908 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.180497 15905 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:11.176929 19306 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.181190 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.181414 19306 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.182199 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.182847 15905 raft_consensus.cc:2368] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:11.182789 19166 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.183349 19166 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.185760 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.183323 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1254) took 1978 ms. Trace:
I20260709 12:25:11.186796 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.187295 15837 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:10.918285 19188 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.239s
I20260709 12:25:11.143708 16489 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:11.142977 15980 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:11.144356 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.095592 15986 rpcz_store.cc:276] 0709 12:25:09.954165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.966690 (+1012525us) service_pool.cc:224] Handling call
0709 12:25:10.967023 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.967224 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.967255 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.967298 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:10.967338 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.967396 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.967508 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.111402 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:11.191386 15908 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:11.096447 15832 rpcz_store.cc:276] 0709 12:25:08.644391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.893614 (+249223us) service_pool.cc:224] Handling call
0709 12:25:08.896199 (+  2585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.901956 (+  5757us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:25:08.901991 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.907752 (+  5761us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.160207 (+252455us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:09.160333 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.160399 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.723714 (+1563315us) raft_consensus.cc:1685] finished
0709 12:25:10.723734 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.723844 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":412,"raft.queue_time_us":609,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2332,"thread_start_us":156805,"threads_started":1,"wal-append.queue_time_us":817665}
I20260709 12:25:11.145953 15983 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.146672 15911 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:11.146996 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:11.148370 15913 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.190670 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:10.757230 19206 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.754s	user 0.010s	sys 0.001s
I20260709 12:25:10.759884 19233 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:10.647984 19215 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:11.121306 19238 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.002s
I20260709 12:25:10.724651 19096 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.730235 19286 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:10.916216 19133 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.082258 19292 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.156081 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 60112.6us
I20260709 12:25:10.778327 19196 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.753489 19237 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:10.917239 19240 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:10.915931 19155 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.105785 19044 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:11.187903 19045 consensus_queue.cc:1175] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2fa3925738bd485e912c7ac0e28b0265" responder_term: 10 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:11.043540 19193 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.739148 18941 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:10.746208 18687 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:10.761301 19161 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.995203 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 530) took 1040 ms. Trace:
I20260709 12:25:11.169870 15984 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.739216 19024 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.274971 19033 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.454015 19024 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:11.116081 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:11.455181 19153 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.290033 19155 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.173234 19114 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.459219 19155 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.459539 19114 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.278612 19142 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.275214 19162 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:11.460642 19166 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.267877 19171 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.461977 19162 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:11.195930 19179 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.164311 19172 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:11.466212 19106 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.465848 19172 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.354373 19223 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.357815 19224 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.158198 19230 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.470520 19230 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.157621 19227 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.367898 19229 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.292049 19240 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.119854 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:11.474673 15829 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.476408 19240 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.189205 15912 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:11.407138 15836 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:25:11.295569 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 148640us
I20260709 12:25:11.155628 19239 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:11.480603 19239 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:11.294414 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.482393 19239 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.110607 18866 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.443713 15913 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:11.119294 19275 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:11.156661 18986 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.005s
I20260709 12:25:11.280601 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:11.488415 19275 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.488593 19173 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.119298 19202 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.269989 19206 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.463944 19162 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.110364 19207 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.119499 19181 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.162062 19187 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:11.473570 16493 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:10.737323 19262 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.410710 15835 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:11.292922 15981 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:11.168699 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:11.257534 15983 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:11.356442 19249 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:11.153218 19252 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.628041 19024 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.141834 19258 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:25:11.630369 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 610) took 1675 ms. Trace:
I20260709 12:25:11.280310 19282 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.359386 19284 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.629s	user 0.006s	sys 0.000s
I20260709 12:25:11.277583 19286 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.196918 19290 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:10.735235 19208 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.287814 19133 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.295924 19193 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.289727 19292 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.268703 19294 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:11.364136 19299 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:11.291196 19303 net_util.cc:396] Time spent resolve address for 127.14.78.68: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:25:11.355387 19307 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:25:11.354621 19309 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.247054 19311 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.368767 19313 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:25:11.406816 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.229830 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 70936.3us
I20260709 12:25:11.451347 18675 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.440173 16488 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:11.222859 15907 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:11.186969 15905 rpcz_store.cc:276] 0709 12:25:09.204829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.182012 (+1977183us) service_pool.cc:224] Handling call
0709 12:25:11.183278 (+  1266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.273686 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:11.259085 15951 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.015s	sys 0.016s
I20260709 12:25:11.295893 16496 rpcz_store.cc:276] 0709 12:25:09.955234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.955361 (+   127us) service_pool.cc:224] Handling call
0709 12:25:09.961782 (+  6421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.640158 (+678376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.994933 (+354775us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54005a4454. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:10.995135 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558442880}
W20260709 12:25:11.408126 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 229949us
I20260709 12:25:11.190233 19101 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.495255 15836 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:11.456768 19096 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:11.628605 19252 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.632262 15830 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:11.488150 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 525) took 2288 ms. Trace:
I20260709 12:25:11.498862 15909 raft_consensus.cc:2368] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
W20260709 12:25:11.496436 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 215741us
I20260709 12:25:11.497267 15834 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.488142 19176 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.558766 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2618) took 1301 ms. Trace:
W20260709 12:25:11.553323 15950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.011s	sys 0.015s
I20260709 12:25:11.614645 15829 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:11.554376 15803 leader_election.cc:400] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:11.465871 19179 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.676968 15803 leader_election.cc:403] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.499672 19202 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.551489 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.497611 19172 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.630542 19258 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:11.495623 19033 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.627025 15910 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:11.610183 16493 pending_rounds.cc:85] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 5
I20260709 12:25:11.551671 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.620210 19266 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.685986 15950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.016s	sys 0.024s
I20260709 12:25:11.497069 19306 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:11.495555 19173 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.630708 19024 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.637135 19109 raft_consensus.cc:3055] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:11.644644 19206 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.638209 19181 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:11.654070 19099 consensus_meta.cc:287] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.921s	user 0.005s	sys 0.015s
I20260709 12:25:11.645938 19207 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.695242 16493 pending_rounds.cc:107] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:11.635962 19144 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:11.714243 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:11.715680 19144 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:11.715834 19294 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:11.716003 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.716446 19294 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.716897 15905 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:25:11.708282 15908 raft_consensus.cc:2368] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:11.684684 19258 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:11.641429 19230 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.708191 19312 consensus_queue.cc:1059] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:25:11.676342 15912 rpcz_store.cc:276] 0709 12:25:10.257385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.774089 (+516704us) service_pool.cc:224] Handling call
0709 12:25:11.558320 (+784231us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54001c3754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:11.558522 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176519040}
I20260709 12:25:11.673290 15984 rpcz_store.cc:276] 0709 12:25:09.954501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.094797 (+1140296us) service_pool.cc:224] Handling call
0709 12:25:11.169643 (+ 74846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.423177 (+253534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.630028 (+206851us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54001b8850. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:11.630175 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171471616}
I20260709 12:25:11.675922 16489 rpcz_store.cc:276] 0709 12:25:09.199342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.199455 (+   113us) service_pool.cc:224] Handling call
0709 12:25:09.199940 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.190179 (+1990239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.487504 (+297325us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54005cfdd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:11.487920 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4469751040}
W20260709 12:25:11.713687 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.717535 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1299) took 1131 ms. Trace:
I20260709 12:25:11.718106 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2617) took 1463 ms. Trace:
I20260709 12:25:11.720490 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:11.720178 19187 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.725804 15905 rpcz_store.cc:276] 0709 12:25:10.586400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.714078 (+1127678us) service_pool.cc:224] Handling call
0709 12:25:11.717451 (+  3373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.706497 19109 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:11.721172 15951 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.015s	sys 0.019s
I20260709 12:25:11.668453 19044 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.725859 15910 rpcz_store.cc:276] 0709 12:25:10.250351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.168442 (+918091us) service_pool.cc:224] Handling call
0709 12:25:11.708565 (+540123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.714697 16493 raft_consensus.cc:2889] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.721722 19309 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.731309 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:11.731336 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.732100 19258 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.717133 19144 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:11.729797 19024 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.738165 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1279) took 1501 ms. Trace:
I20260709 12:25:11.742933 19208 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.743286 19254 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:11.744120 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.730051 19306 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:11.734297 15908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1255) took 2529 ms (client timeout 3264 ms). Trace:
I20260709 12:25:11.744650 15907 rpcz_store.cc:276] 0709 12:25:10.224469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.185757 (+961288us) service_pool.cc:224] Handling call
0709 12:25:11.723403 (+537646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.746666 19096 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.748430 19312 raft_consensus.cc:3055] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:11.748167 19254 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:11.747673 15908 rpcz_store.cc:269] 0709 12:25:09.223152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.192249 (+1969097us) service_pool.cc:224] Handling call
0709 12:25:11.729652 (+537403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.748602 15979 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.738430 19258 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.751981 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:11.753818 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.750046 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:11.754792 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.755836 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.722353 19266 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.724454 19099 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.756917 19292 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:11.889521 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1293) took 1304 ms. Trace:
I20260709 12:25:11.910795 15908 rpcz_store.cc:276] 0709 12:25:10.584649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.749666 (+1165017us) service_pool.cc:224] Handling call
0709 12:25:11.889437 (+139771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.885259 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.858814 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:11.917011 15905 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:11.925683 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1300) took 1339 ms. Trace:
I20260709 12:25:11.926399 15905 rpcz_store.cc:276] 0709 12:25:10.586642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.746327 (+1159685us) service_pool.cc:224] Handling call
0709 12:25:11.925611 (+179284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:11.798967 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 245034us
I20260709 12:25:11.809643 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.828317 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.890833 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:11.748867 19312 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:11.890900 19327 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:25:11.945173 15834 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:11.854130 19275 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:11.853940 19249 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.863415 19289 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:11.811055 18924 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.014s
I20260709 12:25:11.887311 19193 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.861764 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:11.892551 19133 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:11.827633 19162 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.992982 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 272570us
W20260709 12:25:11.809763 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1248) took 2539 ms (client timeout 1883 ms). Trace:
I20260709 12:25:11.753470 19282 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.001821 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.011060 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:11.997172 15904 rpcz_store.cc:269] 0709 12:25:09.203344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.256474 (+ 53130us) service_pool.cc:224] Handling call
0709 12:25:11.736495 (+2480021us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400421654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:11.742437 (+  5942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3810763136}
I20260709 12:25:11.748458 19096 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:11.998677 19275 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:12.026849 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.028040 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.040678 16486 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:12.043251 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.048221 19211 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.048476 19307 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:12.048967 19211 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.049351 19307 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.051587 19307 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.052098 19307 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.052166 18675 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.053303 18687 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:12.053012 18675 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:12.053414 19312 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.053963 18687 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.054780 19312 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.055275 18675 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.055346 19318 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:12.056277 18687 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.056109 19318 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.056033 19211 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.057107 19172 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.049752 18866 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.057644 19172 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:12.058175 19172 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:12.058370 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 305624us
I20260709 12:25:12.058612 19318 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.059430 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:11.757339 19176 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.052871 19307 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.070904 19266 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.014367 19254 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.072937 19309 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.053058 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1699) took 1474 ms. Trace:
I20260709 12:25:12.074194 15834 rpcz_store.cc:276] 0709 12:25:10.578261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.115860 (+537599us) service_pool.cc:224] Handling call
0709 12:25:12.052834 (+936974us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b540003a2d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.052981 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96014592}
I20260709 12:25:12.075907 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.077591 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.079039 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.080389 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.081861 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.082803 15907 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:25:12.083940 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.088930 19044 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.090193 19099 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.091379 15905 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:12.091956 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1281) took 1867 ms. Trace:
I20260709 12:25:12.092368 15905 rpcz_store.cc:276] 0709 12:25:10.225030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.980102 (+1755072us) service_pool.cc:224] Handling call
0709 12:25:12.091888 (+111786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.093562 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.094504 15905 raft_consensus.cc:2376] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8. Re-sending same reply.
I20260709 12:25:12.095645 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.096372 15905 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.097993 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.099671 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.101352 16490 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:12.102929 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1233) took 1520 ms. Trace:
I20260709 12:25:12.107226 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.107993 16490 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:12.107566 15988 rpcz_store.cc:276] 0709 12:25:10.582292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.153410 (+571118us) service_pool.cc:224] Handling call
0709 12:25:11.171622 (+ 18212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.554958 (+383336us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:11.615910 (+ 60952us) log.cc:844] Serialized 14 byte log entry
0709 12:25:11.728945 (+113035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.728993 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.729057 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.102478 (+373421us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400205b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.102522 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.102739 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11118,"prepare.queue_time_us":79111,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":15065,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8364,"spinlock_wait_cycles":759703808,"thread_start_us":91461,"threads_started":2,"wal-append.queue_time_us":128543}
I20260709 12:25:12.109560 19306 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.111862 19106 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.114456 19176 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.100426 19221 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.100984 19307 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:12.105643 19332 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:25:12.106231 18939 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.120159 19227 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.120679 19024 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:12.104041 19172 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:12.122632 19096 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.123374 19172 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.052281 19109 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:12.124130 19024 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:12.124897 19109 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.125085 19024 consensus_queue.cc:1243] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:12.125391 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.125752 19024 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.126158 15907 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.126216 19024 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:12.125901 15732 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 9, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 9 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:25:12.127550 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.889703 19311 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.127430 19024 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.128791 19101 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.129856 19311 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.130287 16493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 516) took 5431 ms. Trace:
I20260709 12:25:12.130738 16493 rpcz_store.cc:276] 0709 12:25:06.698584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.698701 (+   117us) service_pool.cc:224] Handling call
0709 12:25:06.777104 (+ 78403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.908821 (+5131717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.129966 (+221145us) spinlock_profiling.cc:243] Waited 4.69 s on lock 0x7b540039dad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.130204 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10798377216}
I20260709 12:25:12.012758 19249 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.132190 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.133395 19249 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.133778 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1230) took 1558 ms. Trace:
I20260709 12:25:12.134172 15979 rpcz_store.cc:276] 0709 12:25:10.575097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.101808 (+526711us) service_pool.cc:224] Handling call
0709 12:25:11.102058 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.786270 (+684212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.133530 (+347260us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54001879d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.133721 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350732032}
I20260709 12:25:12.139816 19144 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.025836 19162 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.143157 19162 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.143086 19294 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.144466 15908 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:12.145020 16489 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:12.146308 19294 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:12.146624 15911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1262) took 2822 ms (client timeout 1783 ms). Trace:
I20260709 12:25:12.108850 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.148705 16490 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:25:12.147020 15911 rpcz_store.cc:269] 0709 12:25:09.324439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.834932 (+510493us) service_pool.cc:224] Handling call
0709 12:25:12.146257 (+2311325us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400073354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.146434 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014678784}
I20260709 12:25:12.151118 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.152026 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.152336 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.153184 15911 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:12.154068 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.154788 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1267) took 2550 ms. Trace:
I20260709 12:25:12.155153 15911 rpcz_store.cc:276] 0709 12:25:09.604432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.153763 (+2549331us) service_pool.cc:224] Handling call
0709 12:25:12.154744 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.156073 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.151144 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.157384 15979 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.157559 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.132916 16493 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:12.157843 19275 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.159071 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.132619 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.044667 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:12.149761 19314 log.cc:927] Time spent T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.814s	user 0.004s	sys 0.043s
I20260709 12:25:12.116277 19286 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.159250 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.160377 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:12.173341 16495 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:12.162221 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.173761 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:12.174247 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.128703 19024 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.175052 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.175176 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 807) took 1644 ms. Trace:
I20260709 12:25:12.175753 16493 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:12.176067 15829 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:12.176179 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:12.156781 19259 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:12.166962 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.176872 15834 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:12.175560 16495 rpcz_store.cc:276] 0709 12:25:10.530686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.531032 (+   346us) service_pool.cc:224] Handling call
0709 12:25:10.561487 (+ 30455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.173891 (+1612404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.174935 (+  1044us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54005eb5d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.175115 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3706104704}
I20260709 12:25:12.178160 15829 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:25:12.166282 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.178684 15829 pending_rounds.cc:85] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:12.178980 15829 pending_rounds.cc:107] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:25:12.179224 15829 raft_consensus.cc:2889] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.161448 19202 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:25:12.180172 15732 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:12.181809 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:12.181607 15834 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:12.182672 19176 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:12.191359 19176 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:12.192088 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:12.192119 15983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1225) took 2340 ms (client timeout 1871 ms). Trace:
I20260709 12:25:12.192411 19176 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.193207 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:12.193094 15983 rpcz_store.cc:269] 0709 12:25:09.851837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.410977 (+559140us) service_pool.cc:224] Handling call
0709 12:25:12.191822 (+1780845us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002c5e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.191932 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513656192}
I20260709 12:25:12.183871 19286 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.195240 15834 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:12.195647 15834 pending_rounds.cc:85] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:12.195953 15834 pending_rounds.cc:107] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:12.196228 15834 raft_consensus.cc:2889] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.195091 15732 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 2 to 4, term changed from 3 to 8, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to <none>, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:12.197556 15732 catalog_manager.cc:5697] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 7, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:12.200070 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 532) took 1087 ms. Trace:
I20260709 12:25:12.200562 15834 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:12.184545 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:12.213829 15829 raft_consensus.cc:2410] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:25:12.185978 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.184058 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:12.188088 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 164159us
I20260709 12:25:12.167430 19252 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.190531 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:12.160321 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1704) took 1039 ms. Trace:
I20260709 12:25:12.193506 19176 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.200460 16488 rpcz_store.cc:276] 0709 12:25:11.112323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.112462 (+   139us) service_pool.cc:224] Handling call
0709 12:25:11.146352 (+ 33890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.705775 (+559423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.199776 (+494001us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540066b054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.199990 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673646336}
W20260709 12:25:12.203539 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 144265us
I20260709 12:25:12.203691 15912 raft_consensus.cc:2410] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:25:12.204973 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.205905 19292 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:12.207050 19221 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.207402 19179 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:12.235383 15988 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:12.231112 19292 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:12.207942 19099 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:12.208839 19173 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.209573 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.172533 16486 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:12.213683 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.240764 15984 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.184577 19202 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:12.187868 19044 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.176820 16493 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:12.214571 15834 pending_rounds.cc:85] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:12.230948 15837 rpcz_store.cc:276] 0709 12:25:11.120133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.561641 (+441508us) service_pool.cc:224] Handling call
0709 12:25:11.604151 (+ 42510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.735718 (+131567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.735753 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.735815 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:11.735862 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.159179 (+423317us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400030a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.159225 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.159347 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237423872}
W20260709 12:25:12.238967 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.254823 15834 pending_rounds.cc:107] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:12.255265 15834 raft_consensus.cc:2889] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.242720 15905 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:12.243887 16487 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:12.242985 15732 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 7, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:12.247491 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.251873 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:12.247941 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 63953.6us
I20260709 12:25:12.257174 15829 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.252664 15835 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:12.253350 19144 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.248358 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.277380 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1272) took 2227 ms. Trace:
I20260709 12:25:12.277872 15908 rpcz_store.cc:276] 0709 12:25:10.027018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.931009 (+1903991us) service_pool.cc:224] Handling call
0709 12:25:12.253789 (+322780us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400196ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.253908 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325680000}
I20260709 12:25:12.239337 19292 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.280444 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:12.286540 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2629) took 1104 ms. Trace:
I20260709 12:25:12.286999 15904 rpcz_store.cc:276] 0709 12:25:11.182377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.214182 (+1031805us) service_pool.cc:224] Handling call
0709 12:25:12.286479 (+ 72297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.284416 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.297292 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.295032 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.300217 15829 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:12.276597 19144 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.279458 19096 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.303390 16457 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:12.303733 19096 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:12.304878 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56062.3us
I20260709 12:25:12.301656 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.307327 15905 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
W20260709 12:25:12.301926 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.308211 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.302201 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.303429 15984 raft_consensus.cc:2410] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:12.308157 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.310402 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.312368 15907 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:25:12.313345 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.313479 19227 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.314385 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.313758 15732 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 4, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 4 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.307277 19173 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:12.315097 15905 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:12.315843 19173 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:12.316303 19173 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:12.316574 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.317124 18924 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.302340 19144 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.317870 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.318619 19162 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.319131 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.308732 19179 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:12.321313 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.322113 15908 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.322263 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.322518 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1294) took 1737 ms. Trace:
I20260709 12:25:12.322911 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 595) took 3305 ms. Trace:
I20260709 12:25:12.322976 15984 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:12.323380 15906 rpcz_store.cc:276] 0709 12:25:09.017858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.019966 (+  2108us) service_pool.cc:224] Handling call
0709 12:25:09.020361 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.096699 (+2076338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.322428 (+1225729us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001536d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.322694 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3939411200}
I20260709 12:25:12.324079 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.325342 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.320117 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.326109 15986 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:12.326228 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.326439 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.326800 15982 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.327117 16488 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:12.327039 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.327926 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.328637 15986 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:12.316220 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.325199 19249 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.328989 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:12.333192 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.319969 19162 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:12.335033 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.307994 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.248445 19044 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.315148 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.311827 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.337877 15831 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:25:12.322918 15908 rpcz_store.cc:276] 0709 12:25:10.584906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.289498 (+1704592us) service_pool.cc:224] Handling call
0709 12:25:12.322446 (+ 32948us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.313503 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.330482 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:12.307734 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.316190 15732 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:12.324844 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.349418 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.258599 19258 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 12:25:12.351711 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 92922.1us
I20260709 12:25:12.352558 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.329563 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.354100 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1218) took 3321 ms. Trace:
I20260709 12:25:12.317709 19174 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.354419 15980 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:12.359865 16488 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:25:12.311264 19096 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.354535 15981 rpcz_store.cc:276] 0709 12:25:08.989231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.995465 (+  6234us) service_pool.cc:224] Handling call
0709 12:25:08.995837 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.608710 (+2612873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.279854 (+671144us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b540036f1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.310696 (+ 30842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5282084224}
I20260709 12:25:12.356846 16486 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:12.364977 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.362337 16457 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:12.330649 18866 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:25:12.366429 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.368891 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.369261 15979 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.369496 15988 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:12.367515 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.351722 19044 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.373106 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:12.365212 19252 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.373385 15983 raft_consensus.cc:2393] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.373414 15904 raft_consensus.cc:2393] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:12.373803 15911 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:12.317734 18924 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:12.374671 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:12.376914 15984 raft_consensus.cc:2393] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.377146 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.376120 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:12.378801 15905 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:12.381606 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.383450 15986 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:12.384701 15986 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:12.385268 15987 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:12.387117 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:12.388350 19099 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.389156 19174 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:12.390581 15980 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:12.391521 19174 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:12.397476 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.382004 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.388650 15879 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:12.379925 15732 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 5, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:12.410527 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.475920 15983 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:12.474016 16496 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:12.411275 15906 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:12.431304 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.483196 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:12.484210 15904 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:12.377350 18939 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:12.492835 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 116124us
I20260709 12:25:12.495384 19174 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:12.497628 15980 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:12.497462 19174 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.498690 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.500001 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.381213 19258 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:25:12.399152 19173 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.496495 18866 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.502650 15830 raft_consensus.cc:2410] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:25:12.510192 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 226474us
I20260709 12:25:12.518383 15984 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:12.521092 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.522835 15982 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
W20260709 12:25:12.523797 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 149211us
I20260709 12:25:12.524403 15907 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:12.525826 15986 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:12.509804 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.529642 18939 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:12.530843 18939 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.532418 15905 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:12.533406 15988 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:25:12.533325 15732 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 6, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:12.535545 15732 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:12.537111 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1698) took 1959 ms. Trace:
I20260709 12:25:12.537487 15832 rpcz_store.cc:276] 0709 12:25:10.577979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.230792 (+652813us) service_pool.cc:224] Handling call
0709 12:25:11.421763 (+190971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.641781 (+220018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.641829 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.642547 (+   718us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.709122 (+ 66575us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:11.709164 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.536599 (+827435us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b540024efd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.536643 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.536681 (+    38us) raft_consensus.cc:1685] finished
0709 12:25:12.536693 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.536901 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25435,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":223,"spinlock_wait_cycles":156388608,"thread_start_us":50779,"threads_started":1,"wal-append.queue_time_us":114631}
I20260709 12:25:12.540410 15836 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:12.506852 18924 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:12.542868 15906 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:12.543740 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1258) took 3319 ms. Trace:
I20260709 12:25:12.544242 15906 rpcz_store.cc:276] 0709 12:25:09.224126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.519974 (+3295848us) service_pool.cc:224] Handling call
0709 12:25:12.542584 (+ 22610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.543407 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.543649 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:12.543751 15909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1249) took 3340 ms (client timeout 2158 ms). Trace:
W20260709 12:25:12.545595 19328 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.812s	user 0.000s	sys 0.016s
W20260709 12:25:12.545776 15909 rpcz_store.cc:269] 0709 12:25:09.203612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.203728 (+   116us) service_pool.cc:224] Handling call
0709 12:25:12.543516 (+3339788us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400305554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.543673 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5006404992}
W20260709 12:25:12.547246 15912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1277) took 2323 ms (client timeout 2582 ms). Trace:
I20260709 12:25:12.547863 15909 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:12.548691 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1278) took 2324 ms. Trace:
I20260709 12:25:12.549171 19179 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:12.557265 19179 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.557757 19179 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.557946 19249 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:12.559139 19249 raft_consensus.cc:3055] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:12.559466 19249 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:12.560328 19249 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.549216 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1250) took 3345 ms. Trace:
I20260709 12:25:12.562280 15905 rpcz_store.cc:276] 0709 12:25:09.203888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.398374 (+3194486us) service_pool.cc:224] Handling call
0709 12:25:12.532164 (+133790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.532877 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.549125 (+ 16248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.563987 19160 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:12.564057 15905 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:12.564477 19160 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:12.547677 15912 rpcz_store.cc:269] 0709 12:25:10.223924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.151667 (+1927743us) service_pool.cc:224] Handling call
0709 12:25:12.547053 (+395386us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b540029a754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.547190 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116724096}
I20260709 12:25:12.567252 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1696) took 1989 ms. Trace:
I20260709 12:25:12.567478 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2619) took 2309 ms. Trace:
I20260709 12:25:12.567653 15838 rpcz_store.cc:276] 0709 12:25:10.577413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.164546 (+587133us) service_pool.cc:224] Handling call
0709 12:25:11.164827 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.501002 (+336175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.501071 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.501892 (+   821us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.683756 (+181864us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:11.683787 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.566689 (+882902us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400081e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:12.566745 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.566796 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:12.566812 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.567073 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747643776,"thread_start_us":63985,"threads_started":1,"wal-append.queue_time_us":178603}
I20260709 12:25:12.568879 19160 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.571779 19160 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.561239 15909 rpcz_store.cc:276] 0709 12:25:10.224200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.546838 (+2322638us) service_pool.cc:224] Handling call
0709 12:25:12.547272 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.548340 (+  1068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.548601 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:12.574291 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 185700us
I20260709 12:25:12.574582 15909 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:25:12.561704 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:12.564966 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1280) took 2340 ms. Trace:
I20260709 12:25:12.576702 15834 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:12.550305 15908 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:12.575310 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2621) took 2280 ms. Trace:
I20260709 12:25:12.570025 15906 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:12.577785 15909 rpcz_store.cc:276] 0709 12:25:10.295333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.573578 (+2278245us) service_pool.cc:224] Handling call
0709 12:25:12.574219 (+   641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.575062 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.575247 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.475687 19162 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:12.567879 15912 rpcz_store.cc:276] 0709 12:25:10.257718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.566531 (+2308813us) service_pool.cc:224] Handling call
0709 12:25:12.566863 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.567186 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.567209 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.567246 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:12.567276 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.567321 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.567412 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:12.581944 15913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2624) took 2224 ms (client timeout 1840 ms). Trace:
I20260709 12:25:12.575266 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:12.586469 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:12.591626 16496 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:12.576391 15905 rpcz_store.cc:276] 0709 12:25:10.224754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.563243 (+2338489us) service_pool.cc:224] Handling call
0709 12:25:12.563749 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.564672 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.564899 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.593117 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2620) took 2330 ms. Trace:
I20260709 12:25:12.593478 15906 rpcz_store.cc:276] 0709 12:25:10.257988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.569436 (+2311448us) service_pool.cc:224] Handling call
0709 12:25:12.569812 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.587980 (+ 18168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.588144 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.594126 19208 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:12.594494 19208 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:12.594761 15906 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:12.595357 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 604) took 2148 ms. Trace:
I20260709 12:25:12.595669 15906 rpcz_store.cc:276] 0709 12:25:10.447272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.594175 (+2146903us) service_pool.cc:224] Handling call
0709 12:25:12.594480 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.595107 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.595303 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.597352 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.588009 15732 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 6, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.595563 19208 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:12.597945 15988 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:12.482251 19033 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.595487 19144 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:12.589761 15913 rpcz_store.cc:269] 0709 12:25:10.296182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.566619 (+270437us) service_pool.cc:224] Handling call
0709 12:25:12.481017 (+1914398us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54001522d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:12.520066 (+ 39049us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331539200}
I20260709 12:25:12.525342 19174 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.601707 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1252) took 3384 ms. Trace:
I20260709 12:25:12.598649 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:12.617667 15908 rpcz_store.cc:276] 0709 12:25:09.204358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.487856 (+3283498us) service_pool.cc:224] Handling call
0709 12:25:12.550092 (+ 62236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.588223 (+ 38131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.588378 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.603828 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.608494 15987 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:12.619182 15983 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.610009 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.599025 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:12.613164 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.615588 16488 raft_consensus.cc:2410] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:12.615873 15904 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:12.620780 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 601) took 3302 ms. Trace:
I20260709 12:25:12.621217 15904 rpcz_store.cc:276] 0709 12:25:09.318650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.484858 (+3166208us) service_pool.cc:224] Handling call
0709 12:25:12.615705 (+130847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.620497 (+  4792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.620713 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.628403 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.631182 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.631820 15984 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
W20260709 12:25:12.632575 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.634266 15906 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:12.634940 15913 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:12.634938 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1297) took 2049 ms. Trace:
I20260709 12:25:12.635689 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1298) took 2049 ms. Trace:
I20260709 12:25:12.635522 15906 rpcz_store.cc:276] 0709 12:25:10.585841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.600857 (+2015016us) service_pool.cc:224] Handling call
0709 12:25:12.626645 (+ 25788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.634712 (+  8067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.634884 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.636051 15913 rpcz_store.cc:276] 0709 12:25:10.586124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.612633 (+2026509us) service_pool.cc:224] Handling call
0709 12:25:12.634751 (+ 22118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.635462 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.635639 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.637470 15906 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:12.637315 15732 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:12.638032 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 607) took 1473 ms. Trace:
I20260709 12:25:12.638345 15906 rpcz_store.cc:276] 0709 12:25:11.164981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.636935 (+1471954us) service_pool.cc:224] Handling call
0709 12:25:12.637291 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.637816 (+   525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.637973 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.638972 15732 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.583139 19109 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:12.634279 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.644325 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:12.640866 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.645529 15988 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:12.640329 16489 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:12.613073 19033 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.661518 15987 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.650063 15905 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:12.662227 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 603) took 2215 ms. Trace:
I20260709 12:25:12.650842 15732 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 6, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.662600 15905 rpcz_store.cc:276] 0709 12:25:10.446976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.601693 (+2154717us) service_pool.cc:224] Handling call
0709 12:25:12.643117 (+ 41424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.662000 (+ 18883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.662180 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.652498 15909 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:12.660667 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 61709.7us
I20260709 12:25:12.663895 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2622) took 2368 ms. Trace:
I20260709 12:25:12.664346 15909 rpcz_store.cc:276] 0709 12:25:10.295673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.598360 (+2302687us) service_pool.cc:224] Handling call
0709 12:25:12.644266 (+ 45906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.663614 (+ 19348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.663834 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:12.653294 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.666149 15983 raft_consensus.cc:2393] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:12.636405 19239 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:25:12.655023 15985 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:12.668711 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:12.655403 15802 connection.cc:256] RPC call timeout handler was delayed by -1.8883876689997123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 12:25:12.655566 19044 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:12.656706 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.657191 15908 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:12.568869 19292 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.651067 19312 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:12.653203 19249 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.678644 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.668100 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.636053 19160 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:12.673952 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.669080 15985 pending_rounds.cc:85] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 8
I20260709 12:25:12.677753 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 605) took 1982 ms. Trace:
I20260709 12:25:12.601505 18866 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:12.680891 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1271) took 2681 ms. Trace:
W20260709 12:25:12.738300 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 77698.8us
W20260709 12:25:12.814144 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63091.7us
I20260709 12:25:13.128922 15982 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:25:13.129237 15912 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.035s
I20260709 12:25:12.678167 15732 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:25:13.117779 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 519155us
I20260709 12:25:12.856832 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.790587 15911 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.131129 15985 pending_rounds.cc:107] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 12:25:13.108003 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 494372us
W20260709 12:25:13.130808 15912 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.006s	sys 0.035s
W20260709 12:25:13.132380 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.131255 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:25:12.687707 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.769075 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:13.133518 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.127924 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 480367us
W20260709 12:25:12.836331 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.852967 15953 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:12.836164 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.822764 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:12.799113 15905 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:13.131870 15985 raft_consensus.cc:2889] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.664291 19033 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:12.672025 19306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.015s
I20260709 12:25:12.667737 19208 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:12.823521 15802 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.139s (SENT)
I20260709 12:25:13.127698 15907 rpcz_store.cc:276] 0709 12:25:10.000057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.525266 (+2525209us) service_pool.cc:224] Handling call
0709 12:25:12.670184 (+144918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.680486 (+ 10302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.680527 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.680583 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:12.680631 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.680706 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.680826 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:13.134109 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.152909 15802 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:12.677601 19173 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.667598 19252 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.089088 19294 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:13.142822 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:12.897383 15979 consensus_meta.cc:287] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.002s
W20260709 12:25:13.126876 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.856997 19275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.020s	sys 0.017s
W20260709 12:25:13.160351 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.021801 19044 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.056595 19179 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.172729 15833 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:13.150970 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 609) took 1956 ms. Trace:
I20260709 12:25:13.159230 19294 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:13.181015 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.183248 19264 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:13.184144 19179 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.184840 15906 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:25:13.153517 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.181664 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.146979 19106 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:12.826202 19172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.009s	sys 0.008s
W20260709 12:25:13.188795 16494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.003s	sys 0.031s
W20260709 12:25:13.189144 19172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.022s	sys 0.012s
I20260709 12:25:13.189883 18866 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:12.950989 19292 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:13.109697 19162 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.159809 15979 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:13.160146 15907 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:25:13.152396 19306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.010s	sys 0.031s
I20260709 12:25:13.121155 19282 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.162011 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2646) took 1014 ms. Trace:
I20260709 12:25:13.200160 15910 rpcz_store.cc:276] 0709 12:25:12.161329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.826311 (+664982us) service_pool.cc:224] Handling call
0709 12:25:13.147898 (+321587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.158217 (+ 10319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.158241 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:13.161763 (+  3522us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:13.161805 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.161861 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.161963 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158976}
I20260709 12:25:13.150398 15732 catalog_manager.cc:5697] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 1 to 3, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:25:12.837673 19290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.002s	sys 0.012s
W20260709 12:25:13.205019 19290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.003s	sys 0.026s
I20260709 12:25:13.148995 19221 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:13.205879 19221 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:13.205626 19162 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.206255 15910 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.206929 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 615) took 1001 ms. Trace:
I20260709 12:25:13.206728 19221 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.207283 15910 rpcz_store.cc:276] 0709 12:25:12.205604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.205768 (+1000164us) service_pool.cc:224] Handling call
0709 12:25:13.206077 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.206694 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.206875 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:13.207973 19221 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:13.161700 19275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.024s	sys 0.017s
I20260709 12:25:13.171118 15834 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:13.203305 15803 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 1.580s (SENT) [suppressed 35 similar messages]
I20260709 12:25:12.768395 19096 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.417s
I20260709 12:25:13.211792 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.152707 19258 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:13.175398 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.165397 19318 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:13.176882 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 602) took 2742 ms. Trace:
I20260709 12:25:13.215670 15911 rpcz_store.cc:276] 0709 12:25:10.446518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.601667 (+2155149us) service_pool.cc:224] Handling call
0709 12:25:12.648739 (+ 47072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.146281 (+497542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.176542 (+ 30261us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54004213d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:13.176769 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276067072}
I20260709 12:25:13.178249 15909 rpcz_store.cc:276] 0709 12:25:11.189643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.674077 (+1484434us) service_pool.cc:224] Handling call
0709 12:25:13.128863 (+454786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.145925 (+ 17062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.145954 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:13.145989 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:13.146021 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.146075 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.146173 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
I20260709 12:25:13.151889 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 608) took 1959 ms. Trace:
I20260709 12:25:13.217316 15905 rpcz_store.cc:276] 0709 12:25:11.185407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.663325 (+1477918us) service_pool.cc:224] Handling call
0709 12:25:12.776254 (+112929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.144960 (+368706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.145159 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:13.150167 19160 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.130131 15908 rpcz_store.cc:276] 0709 12:25:10.695499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.618577 (+1923078us) service_pool.cc:224] Handling call
0709 12:25:12.656994 (+ 38417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.672970 (+ 15976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.677694 (+  4724us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:13.188071 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:25:13.189186 16494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.003s	sys 0.031s
I20260709 12:25:13.154739 16459 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:12.851644 19144 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:13.180198 19227 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:13.192487 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49763.7us
I20260709 12:25:13.190382 19106 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:13.205395 19306 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.226594 15907 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:13.182015 19187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.022s	sys 0.069s
I20260709 12:25:13.160339 19252 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:13.212270 15981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.028s	sys 0.031s
W20260709 12:25:13.237673 15981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.028s	sys 0.031s
I20260709 12:25:13.212513 15732 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 7, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 7 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:13.222592 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.223213 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 69387.3us
I20260709 12:25:13.238749 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:13.210397 19044 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.211103 19282 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:13.228083 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.229405 15911 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:13.233467 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 616) took 1021 ms. Trace:
I20260709 12:25:13.234700 15908 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:13.248854 15907 rpcz_store.cc:276] 0709 12:25:12.205883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.215809 (+1009926us) service_pool.cc:224] Handling call
0709 12:25:13.226439 (+ 10630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.226986 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.227164 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:13.235760 15909 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:13.213471 18866 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:13.240854 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2630) took 2058 ms. Trace:
I20260709 12:25:13.250386 15906 rpcz_store.cc:276] 0709 12:25:11.182617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.639621 (+1457004us) service_pool.cc:224] Handling call
0709 12:25:12.652815 (+ 13194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.185235 (+532420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.240642 (+ 55407us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b5400072e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:13.240802 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223062912}
I20260709 12:25:13.218827 19290 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.241495 15833 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.215435 19318 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.213822 19294 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.253621 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 617) took 1047 ms. Trace:
I20260709 12:25:13.256173 15911 rpcz_store.cc:276] 0709 12:25:12.206186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.216663 (+1010477us) service_pool.cc:224] Handling call
0709 12:25:13.225593 (+  8930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.248562 (+ 22969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.253568 (+  5006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:13.257468 19294 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.229954 19306 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:13.258702 15732 catalog_manager.cc:5697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:13.259450 19306 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.261261 19264 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:13.266026 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 606) took 2570 ms. Trace:
I20260709 12:25:13.266918 19227 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:13.267702 19227 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:13.266404 15904 rpcz_store.cc:276] 0709 12:25:10.695821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.622092 (+1926271us) service_pool.cc:224] Handling call
0709 12:25:12.651046 (+ 28954us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.651386 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.651414 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.651923 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.102246 (+450323us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:13.102305 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.102400 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.265824 (+163424us) raft_consensus.cc:1685] finished
0709 12:25:13.265844 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.265966 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":795,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":449845,"threads_started":1,"wal-append.queue_time_us":609169}
I20260709 12:25:13.270172 19258 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:13.270680 19258 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.271052 15905 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:13.271766 19258 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.268641 19227 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:13.254917 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 54176.6us
I20260709 12:25:13.228616 19292 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:13.241219 19252 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:13.237133 19187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.023s	sys 0.069s
I20260709 12:25:13.278136 15910 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:25:13.282336 15910 pending_rounds.cc:85] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:25:13.282573 15910 pending_rounds.cc:107] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:25:13.282816 15910 raft_consensus.cc:2889] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:13.228344 19106 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:13.279089 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 124420us
I20260709 12:25:13.238452 19350 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.260530 15732 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:13.285478 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:13.279666 19312 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.275547 19276 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:13.307487 15732 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 6, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:13.296113 19264 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.295329 19292 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:13.303880 19275 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.300824 19258 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.318058 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:13.316179 15732 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:13.313366 19264 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.283895 18866 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.314114 19187 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.327749 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 89048.5us
W20260709 12:25:13.328648 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 62069.8us
I20260709 12:25:13.333386 19044 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.334573 15803 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:13.337141 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.321920 19275 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.339412 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 620) took 1484 ms. Trace:
I20260709 12:25:13.340046 19275 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.340616 19275 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.324725 19144 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:25:13.341768 19144 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.342478 19144 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:13.342545 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.342918 19144 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:13.343809 19144 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.345444 19292 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.345772 19106 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.347821 19106 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.324877 19264 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.304013 19350 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:13.295181 19160 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:13.392117 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.392474 19366 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:13.392781 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.400712 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 244724us
I20260709 12:25:13.402061 19359 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.402608 19359 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.404265 19359 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:13.405097 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 552186us
W20260709 12:25:13.405244 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 593118us
W20260709 12:25:13.409228 15802 connection.cc:256] RPC call timeout handler was delayed by -1.72185262199946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.41650000000000004s for a response
W20260709 12:25:13.410013 15802 connection.cc:256] RPC call timeout handler was delayed by -1.6827793379993636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2964s for a response
I20260709 12:25:13.413173 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2626) took 2231 ms. Trace:
W20260709 12:25:13.414076 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 92393.7us
I20260709 12:25:13.414125 15913 rpcz_store.cc:276] 0709 12:25:11.181631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.648319 (+1466688us) service_pool.cc:224] Handling call
0709 12:25:12.667726 (+ 19407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.143705 (+475979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.143872 (+   167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.155666 (+ 11794us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.405918 (+250252us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:13.405972 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.406057 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.412889 (+  6832us) raft_consensus.cc:1685] finished
0709 12:25:13.412914 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.413102 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73060,"raft.queue_time_us":392678,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4722,"thread_start_us":206983,"threads_started":1,"wal-append.queue_time_us":219310}
I20260709 12:25:13.340924 19275 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:13.417454 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68170.2us
I20260709 12:25:13.325392 15732 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 3 to 5, term changed from 5 to 7, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65), VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66), VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67), VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:13.428069 19221 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.428718 19221 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.430915 19221 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.437680 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:13.410566 19187 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.440747 19187 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:13.441907 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 105567us
I20260709 12:25:13.441640 19356 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:13.442297 18939 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:13.440725 19360 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.443121 19356 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:13.443646 19356 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.444414 19239 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:13.445097 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:13.443662 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.447060 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.448935 19239 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.449613 19239 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.450709 19360 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:13.451402 19360 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:13.451969 19360 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:13.453799 19345 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:25:13.454789 19340 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:25:13.456918 18866 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.326009 19318 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.458539 19318 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.458720 15952 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:13.459826 19187 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:13.460464 19187 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:13.461118 19282 consensus_queue.cc:1175] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fd62f0fa06a4561a0a7101b85942f86" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:13.461715 19187 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.344996 19144 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.334586 19044 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.469511 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:13.470752 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:13.471575 19249 consensus_meta.cc:287] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.002s
W20260709 12:25:13.472576 19339 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:13.473178 19044 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.477546 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 813) took 1526 ms. Trace:
I20260709 12:25:13.339768 16494 rpcz_store.cc:276] 0709 12:25:11.854891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.855118 (+   227us) service_pool.cc:224] Handling call
0709 12:25:12.572405 (+717287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.572786 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.572814 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.573295 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.219592 (+646297us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:13.229174 (+  9582us) log.cc:844] Serialized 14 byte log entry
0709 12:25:13.235410 (+  6236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.235509 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.337746 (+102237us) raft_consensus.cc:1685] finished
0709 12:25:13.337771 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.339234 (+  1463us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b5400669750. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:13.339356 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9461,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3030,"raft.queue_time_us":2726,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":17369,"spinlock_wait_cycles":1325346560,"thread_start_us":645921,"threads_started":1,"wal-append.queue_time_us":668641}
I20260709 12:25:13.477442 15732 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:13.488224 15802 leader_election.cc:336] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 3.072s (SENT)
I20260709 12:25:13.488682 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:13.489903 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2623) took 3194 ms. Trace:
I20260709 12:25:13.489646 15732 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 8, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 8 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:13.463865 19275 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.478029 16495 rpcz_store.cc:276] 0709 12:25:11.960267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.178635 (+218368us) service_pool.cc:224] Handling call
0709 12:25:12.178947 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:12.179413 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.179442 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:12.180114 (+   672us) log.cc:844] Serialized 52 byte log entry
0709 12:25:12.699081 (+518967us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:12.814516 (+115435us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.814773 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.814864 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.477346 (+662482us) raft_consensus.cc:1685] finished
0709 12:25:13.477365 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.477488 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63501,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":7427,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":3586,"thread_start_us":493264,"threads_started":1,"wal-append.queue_time_us":1133773}
I20260709 12:25:13.494751 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:13.495630 15732 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 6, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:25:13.483388 19311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.018s	sys 0.029s
I20260709 12:25:13.499361 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:13.499130 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:13.482888 19096 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.482424 19221 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.502274 15732 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 9, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 9 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.503618 15952 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:13.491395 15912 rpcz_store.cc:276] 0709 12:25:10.295930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.588934 (+2293004us) service_pool.cc:224] Handling call
0709 12:25:12.596927 (+  7993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.597158 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:13.134968 (+537810us) log.cc:844] Serialized 14 byte log entry
0709 12:25:13.489565 (+354597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:13.489614 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:13.489656 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.489751 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.489853 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":665658,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":71,"thread_start_us":846342,"threads_started":2}
I20260709 12:25:13.444628 19356 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.500936 18866 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:13.492615 19099 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:13.499393 19311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.019s	sys 0.029s
I20260709 12:25:13.477195 19239 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:13.511999 19161 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:13.516151 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.518641 19264 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.527570 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.504493 19172 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:13.531561 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 127883us
I20260709 12:25:13.534343 16495 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:13.538607 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 70835.9us
W20260709 12:25:13.539151 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.539376 19337 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.276s	user 0.001s	sys 0.002s
W20260709 12:25:13.539687 15802 connection.cc:256] RPC call timeout handler was delayed by -1.5747074849996352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:25:13.541100 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.541428 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.541720 19099 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:13.541890 15829 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:13.542270 15838 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:13.491074 19252 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.546121 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 624) took 1047 ms. Trace:
I20260709 12:25:13.499310 19350 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:25:13.531065 19173 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.559044 15732 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:13.552053 19294 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.562180 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.542182 19099 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.564870 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:13.568445 19187 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.568711 15732 catalog_manager.cc:5697] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 6, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:13.499110 19033 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.569881 15837 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:13.531149 18939 consensus_queue.cc:1243] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:13.528633 19161 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.571642 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.557377 15983 rpcz_store.cc:276] 0709 12:25:12.498229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.674020 (+175791us) service_pool.cc:224] Handling call
0709 12:25:13.128304 (+454284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.150675 (+ 22371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.150719 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.179818 (+ 29099us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.487723 (+307905us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:13.487762 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.487826 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.545934 (+ 58108us) raft_consensus.cc:1685] finished
0709 12:25:13.545953 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.546069 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59305,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":285583,"threads_started":1,"wal-append.queue_time_us":308388}
I20260709 12:25:13.570185 15732 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:13.577719 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.511231 19221 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.642333 15980 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:13.579586 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:13.649484 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 77881us
W20260709 12:25:13.650012 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68510.3us
I20260709 12:25:13.546089 19370 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:13.651104 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.654821 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 83861us
W20260709 12:25:13.654806 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 75287us
I20260709 12:25:13.655148 15732 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 3, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.656116 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:13.553174 19160 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:25:13.654383 19187 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:13.659886 15838 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:13.660354 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.660835 15830 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:13.656826 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 208398us
I20260709 12:25:13.660368 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:13.660048 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 132553us
I20260709 12:25:13.563728 19173 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.579383 18866 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.668526 15834 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:13.630432 19249 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:13.675441 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:13.663188 19356 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.662981 19359 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.663084 19144 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.684409 15829 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:13.662925 19187 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.685490 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.687738 19360 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:13.688858 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.689303 15838 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.563201 19096 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:25:13.690992 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.716822 15837 raft_consensus.cc:2410] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:13.579852 19172 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 12:25:13.718091 15833 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:13.679807 19173 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.719077 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.575666 19306 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.729203 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.690482 19249 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.720680 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.705988 19286 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:13.664335 19370 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:13.738186 19370 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.739539 19033 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:13.668480 19292 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:25:13.731045 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.724413 19208 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:13.742288 19208 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.744388 19208 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.710309 19376 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.716217 19187 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:13.733690 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 58327.1us
I20260709 12:25:13.734154 15981 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:13.734943 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.735360 19312 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:13.736171 19179 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:13.769176 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.736658 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:13.656350 19239 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:25:13.731539 15836 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:13.746295 15831 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:13.690560 19375 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:13.732766 15835 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:25:13.749325 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.749207 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 81200.3us
I20260709 12:25:13.732293 19286 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:13.754294 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.754613 19385 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:13.755366 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.761587 15834 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:13.762085 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.762349 19360 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:13.724885 19311 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.769713 15982 raft_consensus.cc:2376] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7. Re-sending same reply.
I20260709 12:25:13.731361 15832 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:13.775213 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.774300 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.716395 19144 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.777011 15986 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 4: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:13.785354 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.785979 15987 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:13.786769 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.791996 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:13.792779 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 132515us
I20260709 12:25:13.776361 19221 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.800590 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.800985 15988 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.775214 19179 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:13.802424 19252 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:13.803476 19144 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:13.812716 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:13.815829 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.804096 19380 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:13.804348 16488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:13.773514 19276 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 12:25:13.806754 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.779922 19311 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:13.814355 15831 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:13.816450 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:13.823503 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:13.821302 16488 raft_consensus.cc:606] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:13.824052 16488 raft_consensus.cc:614] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:13.775902 19099 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.825659 15834 raft_consensus.cc:2410] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:13.825129 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:13.827083 19179 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.824936 19311 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.828004 19264 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:13.796461 19292 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:13.829433 19374 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:25:13.830699 19161 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.831944 19161 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:13.823700 15912 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:13.818017 19376 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:25:13.833739 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.834138 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:13.834790 16490 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:13.794571 19249 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:13.836259 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 99678.8us
I20260709 12:25:13.837641 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:13.839393 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.828646 19264 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:13.874023 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.820922 19380 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:13.878793 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.879417 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.880216 15988 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.880831 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:13.881738 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:13.798928 19385 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:13.819317 19356 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:25:13.886061 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.886866 19370 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:13.887430 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.887754 19370 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:13.888443 19096 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:13.888006 15986 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.889349 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.890159 15831 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:13.890864 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:13.897629 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:13.898581 16494 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:13.900624 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:13.901441 15982 raft_consensus.cc:2376] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7. Re-sending same reply.
I20260709 12:25:13.905185 15987 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:13.877858 19312 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.907181 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:13.912251 16490 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:13.913616 15980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 628) took 1414 ms (client timeout 1645 ms). Trace:
I20260709 12:25:13.907934 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:13.913877 15980 rpcz_store.cc:269] 0709 12:25:12.499586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.499715 (+   129us) service_pool.cc:224] Handling call
0709 12:25:13.913498 (+1413783us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000c7954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:13.913576 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344131840}
I20260709 12:25:13.915215 19172 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:25:13.921689 19383 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:25:13.930039 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.918973 19290 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:25:13.933787 16489 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:13.934894 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:13.938230 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:13.896809 19096 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:13.926689 15911 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:13.941844 15911 pending_rounds.cc:85] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:25:13.942189 15911 pending_rounds.cc:107] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:13.942478 15911 raft_consensus.cc:2889] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:13.927263 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:13.943665 16488 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:13.948243 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.911607 19221 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.843293 19286 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:13.888729 19360 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:25:13.909243 19312 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.907830 19292 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:13.919363 19366 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:13.998231 15831 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:13.921944 19249 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:13.945950 19387 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:25:13.951653 19208 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:13.976331 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:14.047423 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 71168.7us
I20260709 12:25:13.926568 19172 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:14.028048 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.919210 19252 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:25:13.958307 19290 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.032394 19388 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:25:13.980242 19292 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:13.955713 19221 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:13.980679 19312 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.907167 19384 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 12:25:14.048259 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:14.074956 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:14.046627 19208 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.058143 18866 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.058626 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.029011 19306 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:14.044296 19366 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:14.058658 15984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:14.064757 19264 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.061196 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:14.047863 19275 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 12:25:14.067077 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:13.973017 19144 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:25:14.059649 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.098013 15835 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:13.979470 19044 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.072696 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:14.078996 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 273949us
I20260709 12:25:14.100981 15838 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:14.059418 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.102185 15836 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:14.102315 15832 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:14.083134 15834 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 6: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:14.083717 15984 raft_consensus.cc:606] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:14.061376 15950 leader_election.cc:336] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.548s (SENT)
I20260709 12:25:14.103302 15984 raft_consensus.cc:614] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:14.084195 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.070784 19292 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.071771 19221 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.941905 19380 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.156350 15836 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:14.092494 19187 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.079290 19208 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.103402 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:14.079829 18866 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.120435 19306 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:14.100732 19275 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:14.121307 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:14.089802 19099 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:14.165611 15831 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:14.123261 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.066217 19311 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.124660 15906 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:14.079957 19359 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:14.129207 16488 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:14.182963 15988 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:14.157648 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.084650 19172 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:14.160095 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 252215us
I20260709 12:25:14.090888 19356 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:14.163254 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 274728us
W20260709 12:25:14.124150 19389 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:14.071100 19290 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.178514 16490 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:14.099772 19264 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:14.156942 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 68261.8us
I20260709 12:25:14.207676 15833 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:14.183588 15832 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:14.179219 19385 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:14.198848 19360 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:14.199234 19381 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:25:14.201545 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:14.202967 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 141629us
I20260709 12:25:14.209442 15831 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 4: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:14.204913 19290 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:14.165249 18866 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.210922 15988 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:14.216454 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.079381 19096 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:14.242269 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:14.242501 15984 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:25:14.251006 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.242887 15981 raft_consensus.cc:2376] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7. Re-sending same reply.
I20260709 12:25:14.262094 15953 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:14.283819 15906 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:14.285454 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:14.286193 15910 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:14.294407 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:14.226918 19359 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.107s
W20260709 12:25:14.366954 15950 leader_election.cc:336] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.818s (SENT)
I20260709 12:25:14.344460 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:14.333568 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:14.365926 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.372186 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.371192 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.373713 15831 raft_consensus.cc:2368] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8.
I20260709 12:25:14.374652 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.375366 15831 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
W20260709 12:25:14.375852 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 299555us
W20260709 12:25:14.322026 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.376493 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.376513 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:14.379001 19144 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:14.379490 19144 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:14.380167 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.381028 19425 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:14.386785 15905 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:14.306234 19385 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:14.396140 15831 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:14.398432 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 191348us
I20260709 12:25:14.359802 19294 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.381616 19425 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.417551 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:14.423161 15831 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:14.418303 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:14.425207 15904 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:14.443831 16490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:14.444581 16490 raft_consensus.cc:606] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:14.399178 19380 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.450718 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:14.463440 15986 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 12:25:14.427351 19381 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.426120 19425 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:14.466486 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 88464.1us
I20260709 12:25:14.424043 19385 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:14.306330 19172 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.468663 15831 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:14.409134 19106 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:25:14.490760 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.496382 15831 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:14.466689 15986 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:14.448096 19044 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:14.493252 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.499446 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:14.427202 18939 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:25:14.427977 19294 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:14.308701 19366 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.473519 19187 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:14.526619 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.494314 19173 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.004s
I20260709 12:25:14.509352 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:14.531843 16495 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.517395 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:14.525254 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:14.526486 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 316419us
I20260709 12:25:14.529428 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:14.490486 19275 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:14.477999 19359 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.535728 19416 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:14.542905 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:14.543727 16486 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:14.542763 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:14.506939 19311 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:14.464212 19406 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.310s
I20260709 12:25:14.459632 19144 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:14.552201 15904 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:14.562536 15910 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:14.491706 19381 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:14.621089 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 56765.2us
I20260709 12:25:14.548517 19264 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:14.577433 19414 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:25:14.581749 19418 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:25:14.642787 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:14.645241 19385 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:14.645279 15830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 722) took 1484 ms (client timeout 1636 ms). Trace:
I20260709 12:25:14.577200 19413 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.540977 19173 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:14.581470 19416 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:14.691433 19427 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:25:14.693343 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:14.564163 19359 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:14.634065 19312 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 12:25:14.712921 15838 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:14.710155 15830 rpcz_store.cc:269] 0709 12:25:13.161350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.175049 (+ 13699us) service_pool.cc:224] Handling call
0709 12:25:14.644995 (+1469946us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540024f9d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:14.645177 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028012800}
I20260709 12:25:14.725145 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:14.901002 19394 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.843s	user 0.004s	sys 0.000s
W20260709 12:25:14.808152 19099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.025s
W20260709 12:25:15.014222 19099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.005s	sys 0.040s
I20260709 12:25:15.015532 19359 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:14.720315 19221 consensus_meta.cc:287] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.004s
I20260709 12:25:14.720063 19239 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.296s
I20260709 12:25:15.016419 19221 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:14.712086 19318 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.253s	user 0.017s	sys 0.012s
I20260709 12:25:14.872908 19294 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:14.712106 19249 consensus_meta.cc:287] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.005s
I20260709 12:25:14.712935 19391 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.757318 19413 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:14.871052 19376 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:14.928004 19292 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.000s
W20260709 12:25:14.777639 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.021289 19391 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:15.025405 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.025794 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.808490 19421 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:25:15.027288 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2731) took 1294 ms. Trace:
W20260709 12:25:15.023891 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 298837us
I20260709 12:25:15.029016 19174 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:15.027802 15837 rpcz_store.cc:276] 0709 12:25:13.733353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.733526 (+   173us) service_pool.cc:224] Handling call
0709 12:25:13.765333 (+ 31807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.797372 (+ 32039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.797415 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.843621 (+ 46206us) log.cc:844] Serialized 26 byte log entry
0709 12:25:14.226396 (+382775us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:14.461590 (+235194us) log.cc:844] Serialized 14 byte log entry
0709 12:25:14.461898 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.462022 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.027092 (+565070us) raft_consensus.cc:1685] finished
0709 12:25:15.027115 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.027237 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160138,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":37621,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":29448,"thread_start_us":487120,"threads_started":2,"wal-append.queue_time_us":638987}
I20260709 12:25:15.030369 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.030953 15837 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.031926 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:15.032615 19174 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:15.033254 19174 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:15.032135 19391 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:15.034145 19174 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:15.019366 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:15.038193 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b5f0a13b879f47dd804f8fc4b7b19a0a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:14.715209 19382 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.299s
I20260709 12:25:15.038866 15838 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
W20260709 12:25:14.870767 19431 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:15.023802 19360 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.778136 19312 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.021363 19376 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:15.040611 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.041502 15838 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.041785 19376 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:15.043597 19376 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.045866 19312 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:14.715463 19144 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.018486 19221 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:15.055207 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:14.873301 19362 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.239s
I20260709 12:25:15.054345 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:14.688345 19411 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.073521 15907 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:15.078147 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:15.070669 15833 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
W20260709 12:25:15.079988 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.085944 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:15.099390 16495 consensus_meta.cc:287] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
I20260709 12:25:15.100117 16495 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:15.024544 19292 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.102025 16487 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:15.102329 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:15.021945 19413 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:15.066876 15837 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:15.103212 15912 raft_consensus.cc:2393] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:15.145871 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.149799 15830 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:15.151845 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.163885 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.164912 15837 raft_consensus.cc:2410] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:15.073804 19382 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.168154 15907 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:14.766088 19106 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.392s
I20260709 12:25:15.199334 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.200203 15833 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
W20260709 12:25:15.174192 15802 connection.cc:256] RPC call timeout handler was delayed by -2.4651239650002026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 12:25:15.202713 15802 connection.cc:256] RPC call timeout handler was delayed by -2.4516239650001808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 12:25:15.203361 15802 connection.cc:256] RPC call timeout handler was delayed by -2.4309239650001473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:25:15.210187 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.143812 19360 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.144070 19406 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.213624 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.220499 15907 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:15.214406 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.221329 15837 raft_consensus.cc:2368] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8.
I20260709 12:25:15.225253 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:15.230737 15878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.028s
W20260709 12:25:15.231081 15878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.028s
W20260709 12:25:15.236608 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.040s	sys 0.042s
W20260709 12:25:15.237759 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.041s	sys 0.042s
I20260709 12:25:15.189261 19359 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:15.238233 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 532793us
I20260709 12:25:15.247409 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:15.189054 19275 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:15.216379 19033 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.264599 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:15.266531 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.267463 15907 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:15.262333 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.259161 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.269079 15837 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
W20260709 12:25:15.253055 19208 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.072s	user 0.012s	sys 0.000s
W20260709 12:25:15.257215 18866 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.996s	user 0.010s	sys 0.000s
I20260709 12:25:15.078465 19416 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.256294 19391 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.250936 19239 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.299911 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:15.286849 19380 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.819s	user 0.008s	sys 0.002s
I20260709 12:25:15.256598 19318 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:15.231998 19187 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:15.343394 19187 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:15.343743 19187 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:15.344553 19187 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.345845 19187 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.279772 19033 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:15.244814 19360 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.350627 19360 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:15.329329 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.352851 15833 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:15.329422 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.331400 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.337296 19276 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:15.335079 19239 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:15.338040 19436 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:25:15.293895 19413 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:15.338649 19444 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:25:15.338793 19362 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:15.331771 19391 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:15.340943 19441 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:15.342280 19318 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.273607 19275 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.193598 19382 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.372848 15833 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:15.257810 19359 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.239012 19406 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.377754 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.084770 19411 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:15.413436 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.419485 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.416221 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.420337 15833 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.417500 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.310096 19208 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:15.423501 15912 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:15.368006 19276 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:15.440881 16487 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:15.323410 18866 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.414947 19381 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:15.449437 19276 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.451184 19276 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.453161 19440 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:15.453791 19440 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:15.457306 19442 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.650s	user 0.002s	sys 0.000s
I20260709 12:25:15.457803 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.458877 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:15.459501 15907 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:15.460212 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.483043 15829 raft_consensus.cc:2368] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12.
I20260709 12:25:15.475665 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.483608 15838 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:15.485018 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.490931 15832 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:15.491197 15833 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:15.481526 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 630) took 1446 ms. Trace:
W20260709 12:25:15.443209 19425 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.000s
I20260709 12:25:15.497893 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.376754 19413 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:15.499822 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.494143 15911 rpcz_store.cc:276] 0709 12:25:14.035457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.035646 (+   189us) service_pool.cc:224] Handling call
0709 12:25:14.049361 (+ 13715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.392366 (+343005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.392410 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.392979 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:25:14.562259 (+169280us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:14.562294 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.473301 (+911007us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540029a754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:15.473361 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.473439 (+    78us) raft_consensus.cc:1685] finished
0709 12:25:15.473459 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.481442 (+  7983us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6228,"raft.queue_time_us":128188,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4209,"spinlock_wait_cycles":354733312,"thread_start_us":274379,"threads_started":2,"wal-append.queue_time_us":486851}
I20260709 12:25:15.504485 19239 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:15.505368 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.506156 15830 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:15.507073 19391 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:15.507227 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.508250 15830 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:15.509938 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.510569 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 551) took 1017 ms. Trace:
I20260709 12:25:15.510039 19275 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:15.473764 19033 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:15.510910 16494 rpcz_store.cc:276] 0709 12:25:14.493226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.493431 (+   205us) service_pool.cc:224] Handling call
0709 12:25:14.510110 (+ 16679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.510553 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:14.510592 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.539121 (+ 28529us) log.cc:844] Serialized 26 byte log entry
0709 12:25:14.712873 (+173752us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:14.712942 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.713083 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.510379 (+797296us) raft_consensus.cc:1685] finished
0709 12:25:15.510395 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.510507 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8316,"raft.queue_time_us":99,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":16060,"thread_start_us":146445,"threads_started":1,"wal-append.queue_time_us":654916}
W20260709 12:25:15.617471 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.512187 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.511113 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.628296 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1301) took 1049 ms. Trace:
I20260709 12:25:15.528228 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:15.628340 15830 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:25:15.606051 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:15.630211 15838 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:15.617885 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:15.579806 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 332444us
I20260709 12:25:15.631536 15833 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:15.560067 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.627118 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.625387 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:15.636085 15907 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.493269 19294 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.628638 16457 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:15.566147 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.639760 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.641877 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.642964 15833 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:15.665910 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.654626 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:15.665469 16489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:15.667661 16489 raft_consensus.cc:606] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:15.663718 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1708) took 1162 ms. Trace:
I20260709 12:25:15.668898 15833 rpcz_store.cc:276] 0709 12:25:14.501381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.641566 (+1140185us) service_pool.cc:224] Handling call
0709 12:25:15.663632 (+ 22066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:15.668323 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:15.670218 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:15.670537 15988 raft_consensus.cc:2393] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:15.670459 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:15.671048 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:15.671224 15984 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 4.
I20260709 12:25:15.511695 19275 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:15.567756 19452 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:25:15.677925 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 449390us
I20260709 12:25:15.679401 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:15.681406 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.673074 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 440187us
W20260709 12:25:15.669054 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.673295 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:15.682216 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.682287 15912 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
W20260709 12:25:15.682746 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.678557 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.683379 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1709) took 1181 ms. Trace:
I20260709 12:25:15.683938 15830 rpcz_store.cc:276] 0709 12:25:14.502091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.638023 (+1135932us) service_pool.cc:224] Handling call
0709 12:25:15.683324 (+ 45301us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:15.525465 15908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.044s
W20260709 12:25:15.685443 15908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.009s	sys 0.050s
I20260709 12:25:15.628762 15904 rpcz_store.cc:276] 0709 12:25:14.579277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.493588 (+914311us) service_pool.cc:224] Handling call
0709 12:25:15.628220 (+134632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:15.681239 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1714) took 1177 ms. Trace:
I20260709 12:25:15.715422 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:15.716318 15988 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:15.695819 15836 rpcz_store.cc:276] 0709 12:25:14.503496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.665678 (+1162182us) service_pool.cc:224] Handling call
0709 12:25:15.681182 (+ 15504us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:15.667063 19144 consensus_meta.cc:287] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:25:15.636996 19376 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.621657 19382 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:15.735448 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:15.735370 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:15.666329 19381 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:15.735991 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:15.672370 19370 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:15.736495 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:15.621490 19385 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:15.755048 19290 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:15.754926 19385 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.738747 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:15.555284 19173 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:15.668716 19033 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:15.768029 19033 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.676451 19160 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:15.769991 19160 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.770051 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.770476 19160 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:15.770751 15911 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:15.776734 15982 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:15.751139 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:15.751893 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.878759 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.755270 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:15.879942 15904 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:15.568426 19411 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:15.756898 15912 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:15.757531 15802 leader_election.cc:336] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.169s (SENT)
I20260709 12:25:15.645869 19391 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:25:15.755609 19290 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.766580 19426 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:15.501742 19425 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.752431 19376 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:15.750962 15836 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.731254 19275 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:15.781787 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:15.756635 19370 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:15.847285 15831 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:15.668330 19294 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:15.798646 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:15.906710 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:16.121295 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.103628 15907 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:25:16.161434 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.171236 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.092131 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 355916us
I20260709 12:25:16.181341 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2755) took 1837 ms. Trace:
W20260709 12:25:15.925500 19366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.019s	sys 0.017s
I20260709 12:25:16.182724 15836 rpcz_store.cc:276] 0709 12:25:14.344333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.738503 (+1394170us) service_pool.cc:224] Handling call
0709 12:25:15.750764 (+ 12261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.181070 (+430306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.181266 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.184522 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:16.184962 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.188326 15836 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:16.187877 15983 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:16.190011 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.190366 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.158288 19286 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:15.805701 19381 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:16.193578 15982 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:16.186733 15988 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:16.159096 19413 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:16.202447 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 451380us
I20260709 12:25:16.189278 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:16.198601 19370 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:16.199276 15913 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:16.199990 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:16.184211 19276 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.725s	user 0.014s	sys 0.005s
I20260709 12:25:16.200253 19385 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.033126 19406 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:16.189543 19366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.547s	user 0.025s	sys 0.023s
I20260709 12:25:16.203862 15837 raft_consensus.cc:2368] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8.
I20260709 12:25:16.209069 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:15.889667 19356 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.210759 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.266119 15986 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:15.942835 19411 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:16.212564 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1306) took 1448 ms. Trace:
I20260709 12:25:16.213371 16457 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:16.195328 19400 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:16.214581 15984 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:16.215734 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 485005us
I20260709 12:25:16.179903 19359 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.193212 19179 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:16.271924 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 735) took 2148 ms. Trace:
I20260709 12:25:16.272169 19179 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:16.272316 15834 rpcz_store.cc:276] 0709 12:25:14.123422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.124124 (+   702us) service_pool.cc:224] Handling call
0709 12:25:14.163991 (+ 39867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.164240 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:14.188532 (+ 24292us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.271493 (+2082961us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b18002656c0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287
0709 12:25:16.271589 (+    96us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.271634 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:16.271685 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.271747 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.271849 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61840,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":19732,"raft.queue_time_us":191879,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"spinlock_wait_cycles":7068928,"thread_start_us":136840,"threads_started":1}
I20260709 12:25:16.274260 19179 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:16.275089 19411 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:16.275352 19423 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:16.275699 15984 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:16.275892 19423 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.276265 19411 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.277076 15984 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:16.274260 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:16.215355 19434 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:16.268230 19033 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:15.890797 19380 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.320s
I20260709 12:25:16.262584 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:16.266613 15913 rpcz_store.cc:276] 0709 12:25:14.764460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.782423 (+ 17963us) service_pool.cc:224] Handling call
0709 12:25:16.198870 (+1416447us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b580009ff98. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:25:16.199065 (+   195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.212300 (+ 13235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.212506 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524928}
W20260709 12:25:16.213893 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.211159 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:16.306252 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95203.1us
I20260709 12:25:16.307140 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:16.033164 19426 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:16.270385 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 57097us
I20260709 12:25:16.308595 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:16.269765 19356 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.187325 19208 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:16.279929 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.318252 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.281419 15988 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:16.285002 19370 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.268010 19275 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.287248 15834 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:16.218173 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:16.302284 19416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.024s	sys 0.032s
I20260709 12:25:16.313484 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:16.314278 19239 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.314713 19179 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:16.316670 19356 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:16.318452 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:16.332531 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:16.320868 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:16.277257 19439 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 1.346s	user 0.010s	sys 0.010s
I20260709 12:25:16.322263 15836 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:16.322364 15913 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
W20260709 12:25:16.329533 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 67622.3us
I20260709 12:25:16.333855 15988 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
W20260709 12:25:16.324597 19416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.024s	sys 0.032s
I20260709 12:25:16.360981 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:16.266414 19385 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 12:25:16.334646 15802 leader_election.cc:336] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.213s (SENT)
I20260709 12:25:16.289506 19276 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:16.365288 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 102917us
W20260709 12:25:16.366289 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 57774.4us
I20260709 12:25:16.369416 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:16.325675 19406 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:16.280131 19400 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:16.363431 19437 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:16.336117 19179 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:16.365458 19356 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:16.380602 15834 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:16.388700 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2757) took 2001 ms. Trace:
I20260709 12:25:16.389019 15834 rpcz_store.cc:276] 0709 12:25:14.387377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.366334 (+1978957us) service_pool.cc:224] Handling call
0709 12:25:16.380290 (+ 13956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.388445 (+  8155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.388646 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.386641 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2658) took 2015 ms. Trace:
I20260709 12:25:16.390331 15913 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:25:16.387486 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 52892.4us
I20260709 12:25:16.391010 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2666) took 1293 ms. Trace:
I20260709 12:25:16.391326 15913 rpcz_store.cc:276] 0709 12:25:15.097231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.378535 (+1281304us) service_pool.cc:224] Handling call
0709 12:25:16.390115 (+ 11580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.390793 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.390964 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.359963 19413 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.374833 19470 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:16.364393 19462 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:16.397578 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:16.336304 19239 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.390393 15906 rpcz_store.cc:276] 0709 12:25:14.371693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.381787 (+ 10094us) service_pool.cc:224] Handling call
0709 12:25:14.382129 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:14.404683 (+ 22554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.404713 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:14.426962 (+ 22249us) log.cc:844] Serialized 52 byte log entry
0709 12:25:14.579669 (+152707us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:14.579710 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.579771 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.118035 (+1538264us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:16.386290 (+268255us) raft_consensus.cc:1685] finished
0709 12:25:16.386318 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.386572 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15776,"raft.queue_time_us":100700,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":15427,"spinlock_wait_cycles":14238080,"thread_start_us":101087,"threads_started":1,"wal-append.queue_time_us":292071}
I20260709 12:25:16.388012 19179 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.403038 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:16.403650 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.406100 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:16.317713 19434 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:16.417235 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.407883 16495 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:16.408332 19290 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.409363 19239 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:16.411976 19160 consensus_meta.cc:287] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.002s
I20260709 12:25:16.402334 19276 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:16.390136 19356 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.441232 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:16.441612 19474 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:25:16.441643 19356 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.444204 19179 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:16.446224 19376 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.417256 19462 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.441879 15986 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:16.450695 19462 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.399585 19173 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:16.428521 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:16.435043 19406 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:16.453261 19406 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:16.454248 19406 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:16.457818 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2752) took 2120 ms. Trace:
I20260709 12:25:16.458158 15832 rpcz_store.cc:276] 0709 12:25:14.337306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.388751 (+ 51445us) service_pool.cc:224] Handling call
0709 12:25:14.410998 (+ 22247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.491347 (+1080349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.457606 (+966259us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400291b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:16.457766 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483177728}
I20260709 12:25:16.416232 19411 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:16.421283 19264 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.461308 19294 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:16.464862 15832 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:16.465932 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2744) took 2407 ms. Trace:
I20260709 12:25:16.434188 19276 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.457759 19380 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.371425 19381 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.401396 19470 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:16.434437 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2657) took 2141 ms. Trace:
I20260709 12:25:16.485754 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1712) took 1982 ms. Trace:
I20260709 12:25:16.486172 15837 rpcz_store.cc:276] 0709 12:25:14.502949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.638143 (+1135194us) service_pool.cc:224] Handling call
0709 12:25:16.485542 (+847399us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54001252d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:16.485694 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204374784}
I20260709 12:25:16.414042 19472 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:25:16.487603 15837 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:16.407087 19361 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.436733 19460 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:16.437598 19473 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:16.488204 19361 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.437543 19400 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:16.436389 19468 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:25:16.437872 19469 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:25:16.440564 19160 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.439181 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.490199 15982 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:16.490316 19361 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.457636 19425 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:16.468950 15802 connection.cc:256] RPC call timeout handler was delayed by -1.4382239650003612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33290000000000003s for a response
I20260709 12:25:16.491285 19160 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:16.491621 19044 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:16.491827 19425 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:16.492270 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1716) took 1952 ms. Trace:
I20260709 12:25:16.492159 19044 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:16.492350 19425 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.492727 15837 rpcz_store.cc:276] 0709 12:25:14.539811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.487006 (+1947195us) service_pool.cc:224] Handling call
0709 12:25:16.487309 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.487944 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.492200 (+  4256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.493315 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:16.493778 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:16.494417 19425 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.466429 15835 rpcz_store.cc:276] 0709 12:25:14.058885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.098651 (+ 39766us) service_pool.cc:224] Handling call
0709 12:25:14.104253 (+  5602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.468758 (+364505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.469960 (+  1202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:14.470020 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:14.470084 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.470170 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.465756 (+1995586us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b54004079d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:16.465871 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":221520,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":12165504,"thread_start_us":295534,"threads_started":1}
I20260709 12:25:16.495735 15835 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:16.496227 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1721) took 1665 ms. Trace:
I20260709 12:25:16.496503 15835 rpcz_store.cc:276] 0709 12:25:14.830559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.495310 (+1664751us) service_pool.cc:224] Handling call
0709 12:25:16.495577 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.496035 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.496181 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.482563 19476 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:16.497344 19476 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:16.497781 15835 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:25:16.498137 15835 pending_rounds.cc:85] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 4
I20260709 12:25:16.498378 15835 pending_rounds.cc:107] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:25:16.498755 15835 raft_consensus.cc:2889] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.498317 19476 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.462575 19385 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:16.491642 15802 connection.cc:256] RPC call timeout handler was delayed by -1.1205647720003071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 12:25:16.500273 19385 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:16.500413 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0962647720002678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 12:25:16.500728 19385 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.494457 19044 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:16.493897 15982 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:16.500769 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0512647720001951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:25:16.468819 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1706) took 1965 ms. Trace:
I20260709 12:25:16.466001 19411 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:16.501652 19096 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.510016 15953 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:16.511333 19396 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.511873 19396 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.512449 19292 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:16.485205 15909 rpcz_store.cc:276] 0709 12:25:14.292627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.292780 (+   153us) service_pool.cc:224] Handling call
0709 12:25:14.293200 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:14.293719 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.293758 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:14.393985 (+100227us) log.cc:844] Serialized 52 byte log entry
0709 12:25:14.549726 (+155741us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:14.719705 (+169979us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.075689 (+355984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.075841 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.200095 (+1124254us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b180027bc80. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:16.431881 (+231786us) raft_consensus.cc:1685] finished
0709 12:25:16.434239 (+  2358us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.434382 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82111,"prepare.queue_time_us":164133,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":8393,"raft.queue_time_us":212509,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"spinlock_wait_cycles":12501376,"thread_start_us":443381,"threads_started":2,"wal-append.queue_time_us":280596}
I20260709 12:25:16.487258 19356 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.424464 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:16.502738 15950 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.840s (SENT)
I20260709 12:25:16.516794 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:16.517426 15950 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:16.502555 15832 rpcz_store.cc:276] 0709 12:25:14.500519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.459045 (+1958526us) service_pool.cc:224] Handling call
0709 12:25:16.462312 (+  3267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.465613 (+  3301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.465831 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.494320 15837 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.502063 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2776) took 1484 ms. Trace:
I20260709 12:25:16.520637 15835 rpcz_store.cc:276] 0709 12:25:15.014721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.497210 (+1482489us) service_pool.cc:224] Handling call
0709 12:25:16.497472 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.499168 (+  1696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.499327 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:16.505769 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:16.471694 19276 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:16.524380 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 99999.3us
I20260709 12:25:16.526371 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:16.527069 16487 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.527987 19423 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:16.529568 19467 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:25:16.484517 19470 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:16.531090 19470 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.515194 19380 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.533452 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 635) took 2543 ms. Trace:
W20260709 12:25:16.534202 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.534844 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:16.535533 16494 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:16.533888 15980 rpcz_store.cc:276] 0709 12:25:13.989657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.989778 (+   121us) service_pool.cc:224] Handling call
0709 12:25:13.990090 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.028707 (+ 38617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.028738 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.033150 (+  4412us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.448442 (+1415292us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b1800433ea0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:25:15.939750 (+491308us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:15.939804 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.949161 (+  9357us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.533107 (+583946us) raft_consensus.cc:1685] finished
0709 12:25:16.533133 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.533380 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20437,"raft.queue_time_us":26650,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":22634,"spinlock_wait_cycles":7758208,"thread_start_us":491051,"threads_started":1,"wal-append.queue_time_us":2271301}
I20260709 12:25:16.534307 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:16.538481 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.540408 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:16.541599 15982 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:16.542763 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.525288 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:16.539373 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.471167 19264 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:16.545537 15950 connection.cc:256] RPC call timeout handler was delayed by -1.1896679550000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:25:16.787644 15950 connection.cc:256] RPC call timeout handler was delayed by -1.0570078870000543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 12:25:16.756541 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:16.555656 16487 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:25:16.788125 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.789438 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.589057 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.790696 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.550900 16496 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:16.551234 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:16.745901 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.618315 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:16.567847 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 62219.3us
I20260709 12:25:16.564247 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:16.550192 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:16.543090 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:16.795131 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.796089 15986 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:16.834033 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 308815us
I20260709 12:25:16.834396 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2760) took 2404 ms. Trace:
I20260709 12:25:16.837983 15833 rpcz_store.cc:276] 0709 12:25:14.429602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.456802 (+2027200us) service_pool.cc:224] Handling call
0709 12:25:16.459432 (+  2630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.459665 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:16.467608 (+  7943us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.833991 (+366383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.834044 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:16.834103 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.834178 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.834330 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38821,"prepare.queue_time_us":8942,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":326619,"threads_started":1}
W20260709 12:25:16.818120 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.550138 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.841425 15987 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:16.785952 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:16.628196 15837 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:16.843394 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:16.859135 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.861990 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.885628 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.890298 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.645905 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.901417 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:16.543201 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.558772 19423 raft_consensus.cc:2764] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:16.616966 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.906474 15980 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:16.813529 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2754) took 2469 ms. Trace:
W20260709 12:25:16.924716 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.925839 16486 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:16.929450 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:16.930236 15833 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:25:16.925733 15950 leader_election.cc:336] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.500s (SENT)
I20260709 12:25:16.940861 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:16.619000 19292 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.943794 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:16.948603 15982 raft_consensus.cc:2410] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:25:16.945348 15979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.019s
W20260709 12:25:16.945813 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.755455 19160 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:16.552254 19396 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:16.947522 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.557420 19360 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.926249 19429 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:16.950510 15979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.003s	sys 0.019s
I20260709 12:25:16.935978 19376 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.844806 19380 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.983530 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 738) took 2583 ms. Trace:
I20260709 12:25:16.949919 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:16.944360 19450 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.944391 19174 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.955513 19033 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.983244 19472 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:16.832126 19258 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.949889 19413 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:16.980829 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:16.960103 19429 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.951937 19160 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.550766 19411 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.984362 15836 rpcz_store.cc:276] 0709 12:25:14.400549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.367058 (+1966509us) service_pool.cc:224] Handling call
0709 12:25:16.367329 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.367520 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:16.669762 (+302242us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.983013 (+313251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.983090 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:16.983167 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.983272 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.983440 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89725,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":601759,"threads_started":2}
I20260709 12:25:16.992837 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:17.509969 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.431754 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.566730 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.567312 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.100600 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 199258us
I20260709 12:25:17.569064 15953 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:17.257370 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.570622 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.571076 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.908802 15830 rpcz_store.cc:276] 0709 12:25:14.343988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.736880 (+1392892us) service_pool.cc:224] Handling call
0709 12:25:16.162441 (+425561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.176860 (+ 14419us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:16.324462 (+147602us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.788399 (+463937us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.812895 (+ 24496us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.813122 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:16.813177 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:16.813240 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.813326 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.813462 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":280210,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":86,"raft.queue_time_us":4990,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":39823,"spinlock_wait_cycles":208313728,"thread_start_us":546990,"threads_started":2,"wal-append.queue_time_us":440159}
W20260709 12:25:17.397439 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.581396 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.582165 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.546733 15910 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:17.181283 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 255579us
W20260709 12:25:17.583205 15910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1302) took 2951 ms (client timeout 2800 ms). Trace:
W20260709 12:25:17.583838 15950 leader_election.cc:336] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.617s (SENT)
I20260709 12:25:17.584231 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:17.583839 15910 rpcz_store.cc:269] 0709 12:25:14.632087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.992459 (+2360372us) service_pool.cc:224] Handling call
0709 12:25:17.583111 (+590652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.572772 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 744) took 1853 ms. Trace:
I20260709 12:25:17.585312 15830 rpcz_store.cc:276] 0709 12:25:15.719732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.571802 (+1852070us) service_pool.cc:224] Handling call
0709 12:25:17.572164 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.572365 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.572401 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.572455 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.572499 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.572575 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.572706 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.078907 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2668) took 1981 ms. Trace:
I20260709 12:25:17.589308 15904 raft_consensus.cc:2410] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 4 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:25:17.140201 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 739) took 2723 ms. Trace:
I20260709 12:25:17.590006 15834 rpcz_store.cc:276] 0709 12:25:14.417105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.389693 (+1972588us) service_pool.cc:224] Handling call
0709 12:25:16.404560 (+ 14867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.404891 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.404918 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.405929 (+  1011us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.815864 (+409935us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:16.815918 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.816006 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.139989 (+323983us) raft_consensus.cc:1685] finished
0709 12:25:17.140008 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.140141 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2412,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":401359,"threads_started":1,"wal-append.queue_time_us":563742}
W20260709 12:25:17.543721 19490 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.447s	user 0.000s	sys 0.000s
I20260709 12:25:17.589030 15913 rpcz_store.cc:276] 0709 12:25:15.097753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.531041 (+1433288us) service_pool.cc:224] Handling call
0709 12:25:16.531365 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.531747 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.531776 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.532237 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.002024 (+469787us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:17.002075 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.002165 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.078634 (+ 76469us) raft_consensus.cc:1685] finished
0709 12:25:17.078663 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.078832 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9250,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":7728,"thread_start_us":455682,"threads_started":1,"wal-append.queue_time_us":542418}
W20260709 12:25:17.101900 19370 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.000s
W20260709 12:25:17.524688 19494 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.727s	user 0.000s	sys 0.001s
W20260709 12:25:17.600916 19491 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.462s	user 0.000s	sys 0.000s
I20260709 12:25:17.601087 15910 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:17.613940 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 636) took 2363 ms. Trace:
I20260709 12:25:17.614269 15910 rpcz_store.cc:276] 0709 12:25:15.250141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.600368 (+2350227us) service_pool.cc:224] Handling call
0709 12:25:17.600839 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.613717 (+ 12878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.613891 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.611650 15835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.012s	sys 0.025s
I20260709 12:25:17.004488 19360 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:17.612632 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1322) took 2047 ms (client timeout 2582 ms). Trace:
W20260709 12:25:17.615403 15835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.013s	sys 0.025s
W20260709 12:25:17.615672 15803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.012s	sys 0.025s
W20260709 12:25:17.623827 15803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.026s
I20260709 12:25:17.005106 19318 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:17.445369 19356 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:17.587917 19429 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:17.544881 19472 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:17.089756 19292 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.624603 15876 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.020s	sys 0.039s
W20260709 12:25:17.624377 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 674348us
W20260709 12:25:17.625240 15832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.007s	sys 0.034s
W20260709 12:25:17.638892 15832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.007s	sys 0.034s
W20260709 12:25:17.622723 15904 rpcz_store.cc:269] 0709 12:25:15.565069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.954760 (+1389691us) service_pool.cc:224] Handling call
0709 12:25:17.612469 (+657709us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.639950 15876 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.039s
W20260709 12:25:17.628969 15837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.004s	sys 0.031s
I20260709 12:25:17.629276 15830 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:17.640491 15837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.004s	sys 0.031s
I20260709 12:25:17.640897 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 745) took 1910 ms. Trace:
I20260709 12:25:16.987582 19376 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.585783 19258 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:16.991664 19450 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.005682 19174 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:17.581156 19033 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.641422 15830 rpcz_store.cc:276] 0709 12:25:15.730297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.611779 (+1881482us) service_pool.cc:224] Handling call
0709 12:25:17.629054 (+ 17275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.640636 (+ 11582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.640841 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.592597 19413 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:17.640365 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 565332us
I20260709 12:25:17.641450 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 741) took 2000 ms. Trace:
I20260709 12:25:17.625021 19275 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.660357 15837 rpcz_store.cc:276] 0709 12:25:15.640587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.947550 (+1306963us) service_pool.cc:224] Handling call
0709 12:25:16.966013 (+ 18463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.966192 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:16.966409 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.640986 (+674577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.641103 (+   117us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:17.641160 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.641248 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.641381 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11292,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":674281,"threads_started":1}
I20260709 12:25:17.632169 19370 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.637147 19472 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.990374 19380 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.650712 19503 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.635687 19360 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.654628 19450 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:17.645211 15802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.023s	sys 0.040s
I20260709 12:25:17.663259 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:17.675849 15802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.024s	sys 0.040s
I20260709 12:25:17.670460 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.676666 15830 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
W20260709 12:25:17.678162 15829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2750) took 3341 ms (client timeout 1840 ms). Trace:
W20260709 12:25:17.675218 15988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.005s	sys 0.008s
W20260709 12:25:17.679849 15988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.006s	sys 0.008s
W20260709 12:25:17.678649 15829 rpcz_store.cc:269] 0709 12:25:14.333088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.333247 (+   159us) service_pool.cc:224] Handling call
0709 12:25:17.673800 (+3340553us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540033ccd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:17.673954 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559379840}
I20260709 12:25:17.681638 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.682245 15829 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:17.683215 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.683866 15829 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:17.687103 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:17.693277 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 749552us
I20260709 12:25:17.695271 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:17.699544 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1724) took 2596 ms. Trace:
I20260709 12:25:17.700739 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.700034 15832 rpcz_store.cc:276] 0709 12:25:15.102769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.520613 (+1417844us) service_pool.cc:224] Handling call
0709 12:25:16.565786 (+ 45173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.628823 (+ 63037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.628869 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.732694 (+103825us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.640059 (+907365us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:17.640163 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.640249 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.699257 (+ 59008us) raft_consensus.cc:1685] finished
0709 12:25:17.699283 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.699464 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62561,"raft.queue_time_us":90653,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":60612,"thread_start_us":795592,"threads_started":1,"wal-append.queue_time_us":892540}
I20260709 12:25:17.693286 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:17.702421 15830 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:17.702492 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.703320 15832 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:17.704313 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.705336 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1725) took 2523 ms. Trace:
I20260709 12:25:17.705789 15835 rpcz_store.cc:276] 0709 12:25:15.182399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.522346 (+1339947us) service_pool.cc:224] Handling call
0709 12:25:16.552890 (+ 30544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.617266 (+ 64376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.617310 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.669852 (+ 52542us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.624063 (+954211us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:17.624113 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.624185 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.705103 (+ 80918us) raft_consensus.cc:1685] finished
0709 12:25:17.705127 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.705271 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365,"raft.queue_time_us":64393,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":779640,"threads_started":1,"wal-append.queue_time_us":886044}
I20260709 12:25:17.707895 19174 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:17.708168 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.709487 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.701654 15837 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:17.710203 15829 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:17.711066 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:17.687403 19385 consensus_meta.cc:287] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.185s	user 0.006s	sys 0.003s
I20260709 12:25:17.662317 19292 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:17.706182 19276 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.976s	user 0.010s	sys 0.000s
W20260709 12:25:17.711961 19470 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.178s	user 0.011s	sys 0.000s
I20260709 12:25:17.715230 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 752) took 1343 ms. Trace:
I20260709 12:25:17.668721 19370 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:17.717607 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.719810 15832 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:17.718227 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.717614 15829 rpcz_store.cc:276] 0709 12:25:16.371401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.713945 (+1342544us) service_pool.cc:224] Handling call
0709 12:25:17.714612 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.714788 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.714816 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.714865 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.714901 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.714956 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.715057 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.720795 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 648) took 1555 ms. Trace:
I20260709 12:25:17.721271 15988 rpcz_store.cc:276] 0709 12:25:16.180802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.365861 (+185059us) service_pool.cc:224] Handling call
0709 12:25:16.366169 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.366385 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:16.399190 (+ 32805us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.715897 (+1316707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.715949 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.715991 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.716055 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.716284 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21444,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1573,"thread_start_us":1299245,"threads_started":2}
I20260709 12:25:17.712206 19160 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:17.730538 15837 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:17.734656 15837 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:17.735991 15837 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:17.717491 19382 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:17.741349 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 754) took 1207 ms. Trace:
W20260709 12:25:17.741580 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1303) took 3109 ms (client timeout 1580 ms). Trace:
W20260709 12:25:17.742102 15905 rpcz_store.cc:269] 0709 12:25:14.632488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.741356 (+3108868us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.741494 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:17.741940 15832 rpcz_store.cc:276] 0709 12:25:16.534158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.720578 (+1186420us) service_pool.cc:224] Handling call
0709 12:25:17.740786 (+ 20208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.740957 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.740991 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.741085 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:17.741127 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.741184 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.741290 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.741413 19096 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.225s	user 0.011s	sys 0.000s
I20260709 12:25:17.751626 19459 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.752465 19370 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:17.752331 19459 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:17.753165 19507 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.755200 19173 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:17.755681 19173 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.757723 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 653) took 1217 ms. Trace:
I20260709 12:25:17.758091 16486 rpcz_store.cc:276] 0709 12:25:16.540640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.540760 (+   120us) service_pool.cc:224] Handling call
0709 12:25:16.550179 (+  9419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.926500 (+376321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.757486 (+830986us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400522954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:17.757663 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863396736}
I20260709 12:25:17.767212 15905 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:17.767185 19472 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.768033 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1316) took 2407 ms. Trace:
I20260709 12:25:17.768354 15905 rpcz_store.cc:276] 0709 12:25:15.360262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.743117 (+2382855us) service_pool.cc:224] Handling call
0709 12:25:17.766897 (+ 23780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.767802 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.767981 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.770125 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2673) took 2207 ms. Trace:
I20260709 12:25:17.770503 15905 rpcz_store.cc:276] 0709 12:25:15.562906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.769300 (+2206394us) service_pool.cc:224] Handling call
0709 12:25:17.769607 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.769776 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.769800 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.769839 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.769873 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.769919 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.770076 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.771337 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.774250 15838 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
W20260709 12:25:17.774686 15838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 747) took 2035 ms (client timeout 1913 ms). Trace:
W20260709 12:25:17.774994 15838 rpcz_store.cc:269] 0709 12:25:15.738817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.742428 (+  3611us) service_pool.cc:224] Handling call
0709 12:25:17.771130 (+2028702us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b5800010298. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:25:17.774628 (+  3498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2977536}
I20260709 12:25:17.772925 19258 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:17.746351 19456 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.940s	user 0.015s	sys 0.006s
I20260709 12:25:17.746549 19376 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:17.777568 15830 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:17.714650 19385 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:17.740785 19382 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:17.720134 19276 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.794356 15905 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:17.798327 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2674) took 2235 ms. Trace:
I20260709 12:25:17.800870 15905 rpcz_store.cc:276] 0709 12:25:15.563300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.775969 (+2212669us) service_pool.cc:224] Handling call
0709 12:25:17.793872 (+ 17903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.798005 (+  4133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.798264 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.803216 15986 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:17.790189 19370 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.791317 18866 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:17.792490 19413 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:17.820636 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 236822us
I20260709 12:25:17.800215 19472 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:17.820160 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2675) took 2256 ms. Trace:
I20260709 12:25:17.831007 15905 rpcz_store.cc:276] 0709 12:25:15.563626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.802099 (+2238473us) service_pool.cc:224] Handling call
0709 12:25:17.819500 (+ 17401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.819703 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.819744 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.819811 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:17.819862 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.819937 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.820107 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.789839 19429 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:17.821327 15950 leader_election.cc:336] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.627s (SENT)
W20260709 12:25:17.837594 15950 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.742s (SENT)
I20260709 12:25:17.844183 15905 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:17.844441 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:17.843518 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 184763us
I20260709 12:25:17.818035 19370 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:17.844517 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 275582us
W20260709 12:25:17.836310 19476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.001s	sys 0.009s
I20260709 12:25:17.849511 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2676) took 2086 ms. Trace:
W20260709 12:25:17.850039 15950 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.824s (SENT)
I20260709 12:25:17.851933 15905 rpcz_store.cc:276] 0709 12:25:15.763398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.832908 (+2069510us) service_pool.cc:224] Handling call
0709 12:25:17.843877 (+ 10969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.848309 (+  4432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.849456 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.852798 15950 leader_election.cc:336] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.896s (SENT)
I20260709 12:25:17.853299 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:17.853982 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:17.857012 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 161880us
W20260709 12:25:17.858027 15950 leader_election.cc:336] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.951s (SENT)
I20260709 12:25:17.858453 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:17.848986 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:17.856770 15876 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:17.865427 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:17.887221 15988 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.868268 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:17.872963 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:17.888291 16492 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:17.873878 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.846731 19443 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:17.844866 19033 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:17.874897 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 638) took 2100 ms. Trace:
I20260709 12:25:17.862182 19472 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.876117 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:17.877842 19276 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:17.872903 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:17.885222 19510 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:17.885757 19187 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:17.851871 19476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.002s	sys 0.009s
I20260709 12:25:17.846966 19312 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:17.888242 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:17.873524 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:17.893487 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 742) took 2240 ms. Trace:
I20260709 12:25:17.929314 16486 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:17.853811 19513 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.894073 15905 rpcz_store.cc:276] 0709 12:25:15.774735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.852886 (+2078151us) service_pool.cc:224] Handling call
0709 12:25:17.874400 (+ 21514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.874584 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.874610 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.874660 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.874689 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.874740 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.874845 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.875532 15980 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:25:17.895504 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.898633 15950 leader_election.cc:336] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.090s (SENT)
I20260709 12:25:17.941139 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:17.931360 15830 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:17.941947 15983 raft_consensus.cc:2410] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:25:17.835242 19382 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.931722 19507 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:17.946026 15982 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:17.900084 18866 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.944720 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48664.7us
I20260709 12:25:17.934540 15836 rpcz_store.cc:276] 0709 12:25:15.653448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.544917 (+1891469us) service_pool.cc:224] Handling call
0709 12:25:17.545285 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.545489 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:17.729739 (+184250us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.893084 (+163345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.893158 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:17.893226 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.893310 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.893429 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13652,"prepare.queue_time_us":270755,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":16082,"thread_start_us":286801,"threads_started":2}
I20260709 12:25:17.944969 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:17.895381 19292 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:17.948863 15983 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:17.949321 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:17.949875 15983 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:17.950266 15983 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:17.938511 19411 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:17.952723 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:17.953009 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:17.957250 15837 raft_consensus.cc:2368] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8.
I20260709 12:25:17.957173 15838 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:17.953485 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:17.958326 15832 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:17.927608 19521 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.959879 19429 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:17.926900 19443 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:17.961836 15802 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:17.963131 19443 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:17.933590 19450 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:25:17.950105 19187 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:17.965691 19187 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.966305 19523 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:17.967171 19523 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.944075 19312 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:17.968493 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 635) took 2718 ms. Trace:
I20260709 12:25:17.951342 19472 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.956315 19520 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.968852 15913 rpcz_store.cc:276] 0709 12:25:15.249916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.598100 (+2348184us) service_pool.cc:224] Handling call
0709 12:25:17.623115 (+ 25015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.623743 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.623773 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.624493 (+   720us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.807738 (+183245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:17.807788 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.807871 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.968299 (+160428us) raft_consensus.cc:1685] finished
0709 12:25:17.968320 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.968440 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1269,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5337,"thread_start_us":166079,"threads_started":1,"wal-append.queue_time_us":222042}
I20260709 12:25:17.972592 15913 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:17.969099 19519 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:25:17.969321 19507 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:17.952124 18866 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:17.974650 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 1.1879e+06us
I20260709 12:25:17.975364 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:17.975816 19525 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:17.976212 19525 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:17.945555 19382 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.951042 15983 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:17.956530 15987 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:17.986012 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2680) took 1147 ms. Trace:
I20260709 12:25:17.986949 15913 rpcz_store.cc:276] 0709 12:25:16.838712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.972161 (+1133449us) service_pool.cc:224] Handling call
0709 12:25:17.972443 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.972892 (+   449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.973050 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.984833 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2670) took 2655 ms. Trace:
I20260709 12:25:17.988773 15904 rpcz_store.cc:276] 0709 12:25:15.329089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.639856 (+2310767us) service_pool.cc:224] Handling call
0709 12:25:17.650486 (+ 10630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.650861 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.650890 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.651328 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.807046 (+155718us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:17.807100 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.807197 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.984648 (+177451us) raft_consensus.cc:1685] finished
0709 12:25:17.984667 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.984783 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":427,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":155298,"threads_started":1,"wal-append.queue_time_us":314783}
I20260709 12:25:17.991637 15988 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:17.992395 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:17.957839 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:17.994199 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95613.5us
I20260709 12:25:17.994722 16492 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:17.995018 19507 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.996111 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:17.997375 15950 connection.cc:256] RPC call timeout handler was delayed by -1.0697637220000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:25:17.997785 15950 connection.cc:256] RPC call timeout handler was delayed by -1.05155884099986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 12:25:17.998066 15988 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:25:18.001154 15950 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.102s (SENT)
I20260709 12:25:18.001502 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:17.950371 19376 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.001669 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:18.002540 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:17.996934 19513 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:17.981638 19426 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:18.003973 15950 leader_election.cc:336] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.123s (SENT)
I20260709 12:25:17.981788 19370 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:17.969578 19312 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:17.970093 19385 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:18.007182 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:18.007778 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:18.012673 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.014686 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.012976 19033 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.016604 19429 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:18.017047 19476 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:17.969460 19472 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.017122 19429 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:18.004297 19360 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.015040 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:18.013084 19450 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:17.987910 19292 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:25:18.020591 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:18.018718 19443 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:18.010337 19521 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.009981 19516 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.970007 19520 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.017827 19476 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:18.018733 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.014990 19513 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:18.021438 19370 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.071645 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 637) took 2821 ms. Trace:
I20260709 12:25:18.038559 19443 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:18.072996 19443 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.038092 19450 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:18.061203 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.044443 19429 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.062170 19472 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.062651 19513 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:18.095346 16459 connection.cc:256] RPC call timeout handler was delayed by -1.3299969989998317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:25:18.096236 19258 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:18.096572 19264 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.065317 19523 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:17.977015 19525 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.070132 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.096719 19258 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.097729 19525 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.098914 19258 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.103839 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:18.070631 19033 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.070904 19520 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.071123 19534 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.105230 19472 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.072012 15910 rpcz_store.cc:276] 0709 12:25:15.250367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.614962 (+2364595us) service_pool.cc:224] Handling call
0709 12:25:17.630405 (+ 15443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.659305 (+ 28900us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:17.835795 (+176490us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.943532 (+107737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.946026 (+  2494us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.946220 (+   194us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:17.946269 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.071245 (+124976us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b54003bf1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:18.071292 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.071336 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:18.071421 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.071587 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3680,"prepare.queue_time_us":214027,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":2482,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8529,"spinlock_wait_cycles":65600896,"thread_start_us":242397,"threads_started":2,"wal-append.queue_time_us":172182}
I20260709 12:25:18.106820 19380 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.107321 19380 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:18.107860 19096 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:18.109083 19096 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:18.042642 19464 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 1.983s	user 0.006s	sys 0.021s
I20260709 12:25:18.112737 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.112694 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.045142 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 746) took 2309 ms. Trace:
W20260709 12:25:18.076984 15907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1323) took 2511 ms (client timeout 2713 ms). Trace:
I20260709 12:25:18.046736 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.081439 19161 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.036556 19173 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.087455 19370 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.087663 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2665) took 2990 ms. Trace:
I20260709 12:25:18.078152 19450 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:18.088327 19382 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:18.093276 19443 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.074371 19516 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:18.115093 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68426.9us
I20260709 12:25:18.114579 15835 rpcz_store.cc:276] 0709 12:25:15.736146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.713509 (+1977363us) service_pool.cc:224] Handling call
0709 12:25:17.719614 (+  6105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.843187 (+123573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.843233 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.852420 (+  9187us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.993465 (+141045us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:17.993491 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.993594 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.044862 (+ 51268us) raft_consensus.cc:1685] finished
0709 12:25:18.044890 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.045065 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4156,"raft.queue_time_us":26646,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":202458,"threads_started":2,"wal-append.queue_time_us":136874}
W20260709 12:25:18.115625 15907 rpcz_store.cc:269] 0709 12:25:15.565325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.060782 (+2495457us) service_pool.cc:224] Handling call
0709 12:25:18.076910 (+ 16128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:18.116457 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 107426us
W20260709 12:25:18.118468 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.109898 19361 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:18.125584 15911 rpcz_store.cc:276] 0709 12:25:15.096943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.086853 (+2989910us) service_pool.cc:224] Handling call
0709 12:25:18.087175 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.087364 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.087386 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.087424 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:18.087457 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.087507 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.087612 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.128114 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.045583 19476 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.134428 15910 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:18.207906 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.208902 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.201858 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:18.191725 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.169824 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.211814 19361 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:18.212056 15913 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:18.213322 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.213900 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.213128 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.215078 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.212750 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.138093 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.215786 15907 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:18.215634 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:18.216476 16486 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.216490 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.133749 19520 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:18.217849 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.217701 19520 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:18.193096 15950 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.972s (SENT)
I20260709 12:25:18.219636 19520 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.219678 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:18.216558 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.125221 19161 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.222627 16496 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:18.223701 19161 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:18.225065 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 206526us
I20260709 12:25:18.223279 19382 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.227327 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.118381 19525 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:18.233989 15950 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.127s (SENT)
I20260709 12:25:18.234377 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.241074 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.213970 19360 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.233215 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.235846 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.244217 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.238586 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.244500 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.239166 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.246816 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.248713 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.226680 16486 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:18.141342 19370 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.245229 15913 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:18.235692 19275 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.237178 19415 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.252532 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.249764 19359 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.254211 19440 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.292603 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:18.253187 15950 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.214s (SENT)
I20260709 12:25:18.235805 19505 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:18.293380 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:18.293382 16487 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:18.293540 19505 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.294912 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.295775 19415 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.296512 19415 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.296836 19415 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:18.253834 15912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1321) took 2689 ms (client timeout 2233 ms). Trace:
W20260709 12:25:18.297343 15912 rpcz_store.cc:269] 0709 12:25:15.564786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.253641 (+2688855us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:18.253759 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:18.282910 16493 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:18.265967 16492 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:18.260763 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.243968 19033 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.212778 19361 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.285934 19187 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:18.254173 19523 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.253173 19520 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:18.288028 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:18.290627 15831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2762) took 3796 ms (client timeout 1529 ms). Trace:
I20260709 12:25:18.291201 19370 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.291661 19525 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.292177 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1808) took 1494 ms. Trace:
I20260709 12:25:18.295819 19505 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.256937 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:18.258147 16459 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.800s (SENT) [suppressed 41 similar messages]
I20260709 12:25:18.307134 15986 rpcz_store.cc:276] 0709 12:25:16.798053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.840527 (+ 42474us) service_pool.cc:224] Handling call
0709 12:25:16.943795 (+103268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.803699 (+859904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.291953 (+488254us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54001865d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:18.292125 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975976832}
I20260709 12:25:18.300952 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.309615 16494 raft_consensus.cc:2410] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 12:25:18.301774 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 318202us
W20260709 12:25:18.310192 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.304134 15831 rpcz_store.cc:269] 0709 12:25:14.494658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.517105 (+ 22447us) service_pool.cc:224] Handling call
0709 12:25:18.290465 (+3773360us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540024f4d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:18.290559 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2777521920}
I20260709 12:25:18.305491 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.301441 19415 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.260591 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:18.310261 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.308609 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50513.1us
I20260709 12:25:18.302860 19187 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:18.313549 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 56662.4us
I20260709 12:25:18.321942 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:18.322610 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 62111.1us
I20260709 12:25:18.323094 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.323361 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:18.304791 15911 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:18.320904 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.306581 19275 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.308523 19361 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.325162 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:18.251091 19360 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.327163 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:18.307088 19525 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:18.327907 16494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
W20260709 12:25:18.326786 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.336179 16494 raft_consensus.cc:606] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:18.336632 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.329824 16460 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:18.320173 19520 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.324123 19187 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.361598 19450 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.363503 19450 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.364038 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:18.344451 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.324690 19033 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.327409 19370 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.330788 19249 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:18.369390 19249 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:18.369782 19249 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.375742 19187 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.356958 19044 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:18.358235 19507 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:18.358736 19351 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.379760 19351 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.380167 19351 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.359086 19161 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:18.325546 19505 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.327852 19523 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:18.376500 19249 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.377681 19516 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.378237 19033 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:18.358361 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48615.2us
I20260709 12:25:18.338433 19525 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.392180 15802 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:18.392253 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:18.387836 19539 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:18.394047 16487 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:18.338263 19359 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:18.401933 19543 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:25:18.402230 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:18.407603 19476 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.410183 19476 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.410732 19173 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:18.390386 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.400929 19507 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:18.412086 19382 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.414824 19264 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:18.395212 19161 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.418766 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.390429 19258 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:18.415230 19264 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.427475 19264 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.415868 19359 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:18.419811 19523 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.439224 19507 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:25:18.420195 19161 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.432097 19513 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.453498 19513 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.454052 19513 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.453524 19525 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.456424 19525 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.457178 19311 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:18.457844 19249 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.457374 19360 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:18.460479 19359 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:18.442359 19538 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 12:25:18.463694 19455 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 2.556s	user 0.002s	sys 0.031s
I20260709 12:25:18.487375 19505 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:25:18.492741 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2660) took 4120 ms. Trace:
I20260709 12:25:18.494071 19459 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:18.493141 15908 rpcz_store.cc:276] 0709 12:25:14.372521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.372648 (+   127us) service_pool.cc:224] Handling call
0709 12:25:14.392967 (+ 20319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.723163 (+330196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.723194 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.011193 (+287999us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.685756 (+674563us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:15.685791 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.454606 (+768815us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540010bb54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:16.454652 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.463173 (+2008521us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:18.492561 (+ 29388us) raft_consensus.cc:1685] finished
0709 12:25:18.492582 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.492689 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":282180,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":19896,"spinlock_wait_cycles":365218944,"thread_start_us":848959,"threads_started":2,"wal-append.queue_time_us":727625}
I20260709 12:25:18.495144 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.496202 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.481151 19187 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.466400 19523 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.499246 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2669) took 3401 ms. Trace:
I20260709 12:25:18.499998 19523 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.467514 19161 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.500560 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2679) took 1662 ms. Trace:
I20260709 12:25:18.500887 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.500950 15905 rpcz_store.cc:276] 0709 12:25:16.838001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.940738 (+1102737us) service_pool.cc:224] Handling call
0709 12:25:17.945693 (+  4955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.984223 (+ 38530us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:17.984438 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.008337 (+ 23899us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.008392 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:18.008439 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.500348 (+491909us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b540010ca54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:18.500386 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.500495 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17492,"prepare.queue_time_us":345,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3377,"raft.queue_time_us":15520,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3810,"spinlock_wait_cycles":107328000,"thread_start_us":12490,"threads_started":1,"wal-append.queue_time_us":44139}
I20260709 12:25:18.503031 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.503571 15905 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:18.504331 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.505267 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.506207 19434 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.506494 19249 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.507014 19179 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.506814 19351 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:18.507493 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.508965 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.489537 19415 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.510251 19507 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:18.512233 19507 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:18.516263 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.516999 19258 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:18.517401 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.518275 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:18.457888 19311 consensus_queue.cc:1243] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:18.519260 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:18.520267 19465 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 2.344s	user 0.000s	sys 0.021s
I20260709 12:25:18.522833 18866 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.524356 19249 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.538184 15983 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.525630 19423 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:18.526512 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.527796 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 648) took 3232 ms. Trace:
I20260709 12:25:18.544613 15832 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:18.544446 16495 rpcz_store.cc:276] 0709 12:25:15.295169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.295345 (+   176us) service_pool.cc:224] Handling call
0709 12:25:15.295673 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:16.417837 (+1122164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.527503 (+2109666us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005ec254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:18.527720 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557122432}
I20260709 12:25:18.545310 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.529095 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.499629 15909 rpcz_store.cc:276] 0709 12:25:15.098002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.946964 (+1848962us) service_pool.cc:224] Handling call
0709 12:25:16.959205 (+ 12241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.679940 (+720735us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:17.835971 (+156031us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.897493 (+ 61522us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.897581 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:17.897651 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.494688 (+597037us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b18001c4e00. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:18.499042 (+  4354us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400217d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:18.499087 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.499194 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259585,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":108,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":30542,"spinlock_wait_cycles":1678124672,"thread_start_us":207776,"threads_started":2,"wal-append.queue_time_us":115076}
I20260709 12:25:18.546314 15829 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.532836 15984 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:18.467839 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:18.464963 19478 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 2.099s	user 0.011s	sys 0.030s
I20260709 12:25:18.541112 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:18.542637 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 527622us
I20260709 12:25:18.548736 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.529016 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.549504 15980 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:18.520880 19504 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.542755 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.543695 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:18.550884 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.551218 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.551678 15982 raft_consensus.cc:2410] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:18.551774 15985 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:18.552227 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.553639 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.553941 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.554580 15838 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.555078 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.555583 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:18.556327 16496 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.557376 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.558156 15834 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:25:18.536923 19425 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:18.562791 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.567948 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.568645 15835 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:18.544294 19423 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:18.462311 19513 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.558586 19411 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:18.558885 19504 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:18.580979 19504 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.582450 19351 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.586112 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1790) took 2932 ms. Trace:
I20260709 12:25:18.586647 15981 rpcz_store.cc:276] 0709 12:25:15.653949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.654065 (+   116us) service_pool.cc:224] Handling call
0709 12:25:15.678422 (+ 24357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.150635 (+472213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.150679 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.166395 (+ 15716us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.305585 (+139190us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:16.305639 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.305730 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.464454 (+2158724us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:18.585729 (+121275us) raft_consensus.cc:1685] finished
0709 12:25:18.585758 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.586024 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82713,"raft.queue_time_us":61320,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":12377,"spinlock_wait_cycles":6320512,"thread_start_us":503714,"threads_started":2,"wal-append.queue_time_us":164763}
I20260709 12:25:18.587888 19264 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.562315 19523 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:25:18.590863 19493 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.921s	user 0.000s	sys 0.006s
I20260709 12:25:18.592427 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 643) took 2908 ms. Trace:
I20260709 12:25:18.592890 15979 rpcz_store.cc:276] 0709 12:25:15.684328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.280737 (+596409us) service_pool.cc:224] Handling call
0709 12:25:16.313673 (+ 32936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.336131 (+ 22458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.336164 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.336606 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.962377 (+625771us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:16.962430 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.972530 (+ 10100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.496916 (+1524386us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:18.592070 (+ 95154us) raft_consensus.cc:1685] finished
0709 12:25:18.592110 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.592354 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22012,"raft.queue_time_us":49095,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2097,"spinlock_wait_cycles":4215040,"thread_start_us":555086,"threads_started":1,"wal-append.queue_time_us":1225900}
I20260709 12:25:18.596145 19411 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:18.596696 19411 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:18.580283 19423 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.604043 16495 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:18.606564 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.607398 19276 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.607775 19276 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:18.579721 19425 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:18.609310 16487 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:18.609543 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.610937 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.611508 15905 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:25:18.613545 15950 leader_election.cc:336] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.139s (SENT)
I20260709 12:25:18.617383 15829 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:18.610215 15909 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:18.622634 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.570123 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.622584 15838 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
W20260709 12:25:18.624296 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54237.7us
I20260709 12:25:18.625942 15952 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.626837 19525 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.627324 19525 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.627719 19525 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:18.578956 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 165811us
I20260709 12:25:18.636668 19096 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:18.637252 19376 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:18.638204 19544 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:18.562441 19507 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:25:18.636734 19187 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:25:18.639911 19507 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:18.640298 19507 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:18.641134 19507 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.641753 19311 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:18.642330 19311 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.642443 19507 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.642845 19311 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.646620 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.647188 15909 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.647400 15983 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:18.647822 15983 pending_rounds.cc:85] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 7
I20260709 12:25:18.648140 15983 pending_rounds.cc:107] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:18.648479 15983 raft_consensus.cc:2889] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.634039 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.669579 16496 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:18.605703 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.608558 19276 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.680454 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.637279 19096 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.684698 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.665321 19351 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:18.689864 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:18.691573 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.692440 15981 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:18.693903 15988 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:18.666692 19462 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.695510 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.696375 15980 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:18.609907 19425 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.700322 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:18.701628 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:18.710789 15987 raft_consensus.cc:2368] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13.
W20260709 12:25:18.711047 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 208684us
I20260709 12:25:18.690752 19096 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:18.733319 16457 connection.cc:256] RPC call timeout handler was delayed by -1.3440390119999392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 12:25:18.754510 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.682987 18866 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:18.709517 19415 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:18.762526 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.764036 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.770380 16496 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:25:18.779779 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.710186 19462 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.757521 19513 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:18.787259 16494 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:18.790930 16492 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:18.835305 15906 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:18.843192 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:18.845674 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.847554 16494 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:18.774009 19161 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:18.856640 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 175629us
I20260709 12:25:18.862632 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:18.842232 19472 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.842690 19351 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:18.870416 15802 connection.cc:256] RPC call timeout handler was delayed by -3.0742231260001063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:25:18.859526 19264 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:18.878002 15802 connection.cc:256] RPC call timeout handler was delayed by -1.4080391200000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 12:25:18.880455 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:18.885357 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.878221 19423 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.887471 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.888700 15838 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:18.879680 19360 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.892117 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:18.890456 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.894755 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.895254 15829 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.896616 15909 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:18.897583 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.899421 15832 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 12:25:18.902240 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.899809 15832 pending_rounds.cc:85] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 5
I20260709 12:25:18.903383 15832 pending_rounds.cc:107] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:25:18.875809 19472 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:18.911331 15829 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:18.903864 15832 raft_consensus.cc:2889] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.904750 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:18.911998 15831 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:18.907893 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.912768 15835 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:18.915393 19282 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:18.916929 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.917995 15835 raft_consensus.cc:2410] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:18.892293 19360 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:18.921067 15905 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:18.916951 15832 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:25:18.923513 15905 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:18.923923 15905 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:18.915874 19282 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.924732 15905 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:18.930610 15832 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:18.931880 15905 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.933734 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.932617 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.936192 15836 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 4.
I20260709 12:25:18.937740 19276 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.916282 19385 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:18.949985 15905 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:25:18.953816 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.954831 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.955636 15905 pending_rounds.cc:85] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 7
I20260709 12:25:18.970459 15905 pending_rounds.cc:107] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:25:18.957113 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.005337 15837 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:19.006556 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.007489 15837 raft_consensus.cc:2410] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:19.008320 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:18.948585 19546 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:25:18.975425 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.975958 15950 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.514s (SENT)
I20260709 12:25:19.009925 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:19.008955 15837 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:25:18.971832 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.935757 19282 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:19.011674 19560 log.cc:927] Time spent T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:25:18.988724 19311 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.015195 19311 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:19.015841 19311 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.978492 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:18.981388 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.981390 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:18.929598 19415 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:25:18.916865 19351 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:18.992543 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 146915us
I20260709 12:25:18.995127 19462 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:18.971715 19385 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:18.997610 15802 leader_election.cc:336] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.233s (SENT)
I20260709 12:25:19.044862 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:18.954787 15834 raft_consensus.cc:2376] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6. Re-sending same reply.
I20260709 12:25:19.026729 15905 raft_consensus.cc:2889] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:19.045228 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:19.048008 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 498829us
I20260709 12:25:19.048199 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.048751 15911 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:19.050264 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 139519us
I20260709 12:25:19.029711 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:19.051096 16496 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.030769 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.027171 15836 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:19.051754 15832 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:19.052106 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.052642 15836 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.053366 15912 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:19.027606 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 797923us
W20260709 12:25:19.032667 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56737.4us
I20260709 12:25:19.038633 15904 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:19.060731 15904 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:19.038839 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.027467 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:19.040140 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:19.041165 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:19.029138 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.049836 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:19.072469 16496 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:19.074290 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.071367 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:19.004372 19161 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:19.071413 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:19.076521 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.078123 15909 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:19.078512 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:19.091002 15834 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.091337 16494 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.086704 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2667) took 3989 ms. Trace:
W20260709 12:25:19.087067 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 89493.5us
I20260709 12:25:19.091995 15906 rpcz_store.cc:276] 0709 12:25:15.097504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.407672 (+1310168us) service_pool.cc:224] Handling call
0709 12:25:16.432904 (+ 25232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.835858 (+2402954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.086446 (+250588us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400299d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:19.086638 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5524451584}
I20260709 12:25:19.095136 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.096490 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.097090 15832 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:19.098030 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 840) took 2335 ms. Trace:
I20260709 12:25:19.061705 15904 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.103426 15904 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.984535 19360 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.098407 16489 rpcz_store.cc:276] 0709 12:25:16.763132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.784294 (+ 21162us) service_pool.cc:224] Handling call
0709 12:25:16.784786 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.610875 (+826089us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:17.808142 (+197267us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.524894 (+716752us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800431680. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe4323a
0709 12:25:18.722717 (+197823us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.979102 (+256385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.979165 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:18.979229 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.097820 (+118591us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:19.097867 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.097972 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3627,"prepare.queue_time_us":569647,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":9373,"raft.queue_time_us":207836,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":3308,"spinlock_wait_cycles":1923485312,"thread_start_us":703403,"threads_started":4,"wal-append.queue_time_us":161496}
I20260709 12:25:19.109764 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.076397 19462 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:19.117141 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 66313.5us
I20260709 12:25:19.122061 16457 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:19.122632 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.124492 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.126006 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.126681 15912 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:19.129345 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 71394.6us
I20260709 12:25:19.047509 19476 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:25:19.130417 15830 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:19.095080 19311 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.132022 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 60694.1us
I20260709 12:25:19.135066 15830 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:19.137090 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.105981 19292 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:19.143615 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.096103 19187 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:25:19.133422 19360 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:19.137092 19476 consensus_queue.cc:1243] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:19.112195 19460 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 12:25:19.170595 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.145133 19462 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:19.136782 19472 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:19.164484 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 124425us
I20260709 12:25:19.143908 19429 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:19.142352 19292 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:19.150352 19525 consensus_meta.cc:287] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 12:25:19.154745 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.168705 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.174563 15834 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:19.144119 19564 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.159344 19566 raft_consensus.cc:2764] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:19.145358 19311 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.175565 19221 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:19.219899 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 51277.1us
I20260709 12:25:19.181128 19462 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.181759 19429 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.227594 19462 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:19.227869 19429 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.221673 19521 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:19.198820 19569 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:25:19.220016 19572 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:19.227195 19504 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.001s
I20260709 12:25:19.200505 19292 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:19.280189 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 59015.5us
I20260709 12:25:19.182014 19294 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:25:19.286437 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 107713us
W20260709 12:25:19.286953 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 52152.9us
I20260709 12:25:19.287209 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.223542 19523 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:19.235839 19575 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:25:19.291507 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 136826us
I20260709 12:25:19.292668 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.294447 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:19.297665 16457 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.232250 15912 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:19.159597 19385 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:19.305646 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 212900us
W20260709 12:25:19.303390 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 232089us
I20260709 12:25:19.203217 19525 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.310356 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:19.312458 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 145192us
I20260709 12:25:19.286671 19572 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:19.329605 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 219935us
I20260709 12:25:19.331574 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.343874 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:19.329993 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.296864 19551 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:19.343912 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46418.6us
I20260709 12:25:19.280284 19504 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.290918 19264 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:25:19.369606 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82483.3us
I20260709 12:25:19.348129 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:19.350708 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.370891 16460 leader_election.cc:400] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13.
I20260709 12:25:19.371397 16460 leader_election.cc:403] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:25:19.371501 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 64694.9us
I20260709 12:25:19.352576 15838 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:25:19.374001 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.352658 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.352424 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.378206 15834 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:19.347235 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 167954us
I20260709 12:25:19.368434 15876 leader_election.cc:400] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8.
I20260709 12:25:19.380018 15876 leader_election.cc:403] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:25:19.380826 15831 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:19.385684 16494 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:19.387168 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.329187 19426 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.343000 19572 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.329439 19580 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.389181 16457 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.311435 19586 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:19.398850 15836 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:19.297026 19521 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:25:19.344147 19476 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.305181 19179 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 12:25:19.409049 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.369310 19541 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:19.346922 19566 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:19.352533 19487 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.414314 19376 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.495502 15904 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:19.413945 19568 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:19.394980 19161 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:19.345233 19294 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:25:19.471367 15834 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:19.369274 19359 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.505874 15911 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:19.400964 19586 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.399971 19576 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:19.515588 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:19.525408 15988 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.388473 19587 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:19.400549 19249 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13.
W20260709 12:25:19.556914 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 184299us
I20260709 12:25:19.556802 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:19.445386 19413 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:25:19.575495 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:19.458952 19426 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:25:19.509419 19161 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.528508 19576 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.525528 19586 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.518733 19487 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:19.594200 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 205075us
W20260709 12:25:19.601781 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 205951us
I20260709 12:25:19.576262 19513 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:19.404120 19580 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.616770 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:19.575943 19596 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.583243 19415 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:19.543576 19359 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.610018 19576 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:19.609923 19587 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:19.616146 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:19.622282 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 248340us
I20260709 12:25:19.645607 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:19.648986 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.652545 19595 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:19.653297 19595 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:19.653659 19595 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:19.653988 19595 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.658420 19359 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:19.659288 19359 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:19.659449 19545 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.891s	user 0.002s	sys 0.003s
I20260709 12:25:19.659808 19359 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.626214 19597 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:25:19.661497 19581 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:25:19.624140 15988 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
W20260709 12:25:19.613782 19577 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.378s	user 0.002s	sys 0.002s
I20260709 12:25:19.578974 19376 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:19.596735 19161 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:19.627657 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 279617us
I20260709 12:25:19.675096 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.522591 19584 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:25:19.614472 19589 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:19.412683 19578 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.197s
I20260709 12:25:19.672142 19376 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.640235 19415 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:19.649403 19525 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:19.625455 19513 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.676067 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:19.749951 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:19.751112 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:19.678750 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:19.752194 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73530.1us
I20260709 12:25:19.759402 19513 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:19.746618 19258 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:19.744832 19376 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.678359 19606 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:19.754746 19351 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:25:19.745761 19600 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:25:19.729588 19594 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:19.779068 19411 consensus_meta.cc:287] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.133s	user 0.010s	sys 0.000s
W20260709 12:25:19.774823 19507 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.132s	user 0.011s	sys 0.002s
I20260709 12:25:19.796347 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:19.795475 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.776846 19096 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.018s	user 0.011s	sys 0.000s
W20260709 12:25:19.760986 19429 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.000s
I20260709 12:25:19.794090 19525 raft_consensus.cc:3055] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:19.757910 19426 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:19.777865 19282 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.000s
W20260709 12:25:19.788329 19360 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.002s
I20260709 12:25:19.836480 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.786001 19580 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:19.860970 19525 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:19.869841 19525 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.863111 19426 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:19.870827 19426 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.870970 19525 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.851701 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.873104 19282 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.875384 19282 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:19.851979 15833 raft_consensus.cc:2410] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:19.852306 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.877732 15912 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:19.877811 19572 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.878624 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.879318 15912 raft_consensus.cc:2368] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:19.880070 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.761170 19504 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:19.787634 19258 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:19.781301 19603 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.793524 19351 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:19.786942 19359 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:19.850899 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:19.873528 15913 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:25:19.810005 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.860812 19096 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.851781 19411 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.883033 15988 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:19.883548 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.884616 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:19.900743 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.900916 15986 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.886204 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.791368 19606 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:19.904699 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:19.905411 15910 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.025s	sys 0.025s
I20260709 12:25:19.885430 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:19.905827 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.901903 15833 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.893158 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:19.886857 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.910741 15837 raft_consensus.cc:2393] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 6: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:19.887668 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.911535 15835 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:19.888273 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.888878 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.894999 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.896057 15908 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:19.893481 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:19.890853 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 572) took 1048 ms. Trace:
I20260709 12:25:19.919680 15831 raft_consensus.cc:2410] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:25:19.919762 16492 rpcz_store.cc:276] 0709 12:25:18.842687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.842843 (+   156us) service_pool.cc:224] Handling call
0709 12:25:19.890102 (+1047259us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b540061a6a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc21adc0 00007f03cc2a6e18 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:19.890688 (+   586us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400619ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:19.890801 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080804352}
I20260709 12:25:19.881016 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.900944 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:19.906855 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:19.908792 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:19.905841 15910 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.025s	sys 0.025s
I20260709 12:25:19.914091 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.729380 19589 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.915374 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:19.916141 15982 raft_consensus.cc:2393] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:19.825336 19541 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:19.955495 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.956189 15913 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:19.956332 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.956934 15838 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:19.926692 15829 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:19.955542 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 306597us
I20260709 12:25:19.958873 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:19.959496 15834 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:19.959964 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.957338 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:19.956398 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47712.1us
W20260709 12:25:19.889482 19221 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.005s
I20260709 12:25:19.958837 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2689) took 1833 ms. Trace:
I20260709 12:25:19.967283 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:19.971335 15982 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:19.894692 19598 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:25:19.915796 19312 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.973819 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.889289 19423 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:19.977260 15802 leader_election.cc:400] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:19.985409 15802 leader_election.cc:403] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:25:19.895401 19411 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:19.921710 19360 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:19.978770 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:20.005451 15911 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.955508 19415 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.769979 19587 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.892925 19161 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.008791 19589 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:19.977613 15953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.037s
W20260709 12:25:20.025698 15953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.005s	sys 0.038s
W20260709 12:25:20.026234 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 639107us
I20260709 12:25:19.955384 19548 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.862073 19429 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:19.960415 19568 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:19.991495 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 375460us
I20260709 12:25:20.038117 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.993875 15834 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:20.041687 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:20.042443 15834 raft_consensus.cc:2410] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:19.992414 19221 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.044654 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:19.967886 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:20.003074 15986 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:20.000597 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:19.964741 19359 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.049326 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:19.882577 19351 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:19.980486 15833 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:20.062778 15834 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:20.015053 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:19.977764 19385 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.064971 15907 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:19.905196 19572 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:19.887856 19096 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:19.881919 19258 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:20.068060 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 100229us
I20260709 12:25:20.068619 19521 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:19.985842 19610 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:20.103456 19610 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:20.104360 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.103058 19521 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.105738 19610 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:20.107656 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 92684.6us
I20260709 12:25:20.104063 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:20.004895 19585 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:20.035460 15911 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:20.047315 16496 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:20.109831 15834 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.047839 15986 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:20.048213 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:20.046069 19382 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:19.881374 19603 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.010739 15981 pending_rounds.cc:85] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 7
I20260709 12:25:20.118227 15981 pending_rounds.cc:107] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:20.064771 19385 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.051499 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:20.036435 19548 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.017117 19576 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.058508 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:20.058794 19586 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.011579 19360 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.116977 19351 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:20.030876 19472 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:20.028290 19621 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.037773 19568 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.967542 15910 rpcz_store.cc:276] 0709 12:25:18.125487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.218890 (+ 93403us) service_pool.cc:224] Handling call
0709 12:25:18.219186 (+   296us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:18.566764 (+347578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.566808 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:18.578740 (+ 11932us) log.cc:844] Serialized 78 byte log entry
0709 12:25:18.847154 (+268414us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:18.858198 (+ 11044us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.953087 (+1094889us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.958548 (+  5461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.958623 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.958662 (+    39us) raft_consensus.cc:1685] finished
0709 12:25:19.958675 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.958791 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1105554,"prepare.queue_time_us":142227,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":63,"raft.queue_time_us":607641,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":36744,"thread_start_us":1091098,"threads_started":2,"wal-append.queue_time_us":309250}
I20260709 12:25:20.124008 19385 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.113193 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:20.064477 19584 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 4. Current term is 5.
I20260709 12:25:20.116567 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.156603 15911 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:20.067184 19462 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.002s
I20260709 12:25:20.117179 15838 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:20.118520 15981 raft_consensus.cc:2889] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:20.051499 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:20.112879 19292 consensus_meta.cc:287] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.822s	user 0.008s	sys 0.004s
I20260709 12:25:20.125010 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:20.127110 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.126005 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:20.128942 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:19.991562 19312 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.117519 19610 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.117069 19591 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.061437 19596 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:25:20.134305 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:20.135596 15837 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:20.136277 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.137228 16486 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:20.143051 16493 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:20.128786 19487 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.002s
I20260709 12:25:20.146993 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.108618 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.149412 15987 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 5: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:20.150458 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:20.123732 19382 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:20.158470 15838 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.123857 19620 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.163565 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.164081 19521 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.229874 15913 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:20.165612 16487 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:20.163569 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.167093 15835 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.120004 19513 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:20.034178 19606 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:20.174069 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45213.6us
W20260709 12:25:20.231163 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 94959.4us
I20260709 12:25:20.148684 19621 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:20.153060 19568 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.175432 16495 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:20.227191 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 118672us
I20260709 12:25:20.228381 16486 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.232471 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.229552 19487 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8.
I20260709 12:25:20.233196 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.285377 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.233991 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:20.228765 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:20.286260 15982 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.235780 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:20.286787 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:20.287222 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51544.7us
I20260709 12:25:20.288208 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.172065 19610 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:20.119824 19585 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.255236 15802 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:20.282451 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 50051.9us
I20260709 12:25:20.233021 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:20.282900 15913 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:20.230194 18866 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:20.236227 19621 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.171615 19625 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 12:25:20.153564 19541 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.316340 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.284164 16488 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:20.288272 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:20.147680 19472 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.235716 19221 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.171885 19292 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.236600 19590 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:20.290074 15835 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:20.291268 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:20.170778 19462 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:20.289510 19619 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:25:20.318205 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:20.318243 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:20.313596 19622 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 12:25:20.319772 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:20.312247 19631 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:20.279358 19504 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.339596 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51402.9us
I20260709 12:25:20.283595 19521 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.346702 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.319278 15982 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:20.305862 19624 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:25:20.303894 19360 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:20.289585 19571 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.215s	user 0.006s	sys 0.001s
W20260709 12:25:20.345839 19425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.004s	sys 0.021s
I20260709 12:25:20.354204 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:20.506681 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 152583us
I20260709 12:25:20.301625 15904 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:20.318782 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:20.509805 15913 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:20.447553 15986 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:20.314848 19429 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.314536 19312 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.479578 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.529624 15982 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:20.530622 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:20.531226 15982 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:20.479980 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 159130us
I20260709 12:25:20.488785 19487 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.307343 19629 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:20.294040 19415 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:20.306416 19585 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.322839 19161 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.346437 19594 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.304759 19476 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:20.293322 19610 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.314875 19586 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:20.489379 15833 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.310611 19611 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.290057 19411 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.162s
I20260709 12:25:20.339496 19564 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.514652 19617 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.516185 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 658) took 1834 ms. Trace:
W20260709 12:25:20.557092 19623 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
W20260709 12:25:20.520792 19630 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:25:20.306208 19635 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.351169 19096 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:20.292572 19615 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.429s
I20260709 12:25:20.448614 19264 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:20.311339 19556 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.286s	user 0.001s	sys 0.001s
I20260709 12:25:20.537501 19561 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:20.537765 19644 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:20.537854 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:20.538686 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.540449 19645 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.541306 19521 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.487444 19590 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:20.543032 15982 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
W20260709 12:25:20.513564 19425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.005s	sys 0.022s
I20260709 12:25:20.310345 19609 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.199s
I20260709 12:25:20.313236 19382 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.502765 19221 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:20.527036 19555 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 1.346s	user 0.008s	sys 0.005s
I20260709 12:25:20.685508 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:20.686316 15986 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.680029 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:20.541671 19634 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:25:20.350209 18866 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.481645 19504 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:20.555495 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 300320us
I20260709 12:25:20.697455 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:20.531827 19572 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.544267 19629 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:20.519305 19292 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:20.580531 19551 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 1.211s	user 0.012s	sys 0.000s
I20260709 12:25:20.589772 15983 rpcz_store.cc:276] 0709 12:25:18.681992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.686334 (+  4342us) service_pool.cc:224] Handling call
0709 12:25:18.686768 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:18.687284 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.687327 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.688060 (+   733us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.916061 (+228001us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:19.110845 (+194784us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.059780 (+948935us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:20.293804 (+234024us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b1800433ea0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287
0709 12:25:20.293911 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.293984 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.515956 (+221972us) raft_consensus.cc:1685] finished
0709 12:25:20.515975 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.516122 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":303348,"prepare.run_cpu_time_us":6531,"prepare.run_wall_time_us":49697,"raft.queue_time_us":178865,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":22362,"spinlock_wait_cycles":27033728,"thread_start_us":512705,"threads_started":3,"wal-append.queue_time_us":276777}
I20260709 12:25:20.548542 19487 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:20.665668 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.630853 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 649) took 2244 ms. Trace:
I20260709 12:25:20.622707 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1812) took 1105 ms. Trace:
I20260709 12:25:20.553118 19415 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.624552 19472 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:20.556784 19585 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:20.632548 19595 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.978s	user 0.002s	sys 0.008s
I20260709 12:25:20.557340 19576 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:20.653704 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2704) took 1511 ms. Trace:
I20260709 12:25:20.620143 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1818) took 1019 ms. Trace:
W20260709 12:25:20.619539 19426 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.007s
I20260709 12:25:20.548341 19429 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:20.605602 19507 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.618242 19462 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.622180 19385 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:20.617302 19641 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:25:20.549842 19312 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:25:20.580322 19603 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:20.617748 19376 consensus_meta.cc:287] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.830s	user 0.004s	sys 0.008s
I20260709 12:25:20.750826 19597 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:20.589589 19617 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.557062 19476 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:20.681478 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 147957us
I20260709 12:25:20.674769 16496 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
W20260709 12:25:20.747977 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50660.1us
W20260709 12:25:20.790886 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.791170 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:20.671721 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 222839us
I20260709 12:25:20.549260 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1286) took 1037 ms. Trace:
W20260709 12:25:20.687651 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 365422us
I20260709 12:25:20.693825 19609 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:20.694780 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1284) took 2142 ms. Trace:
W20260709 12:25:20.695024 19638 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:25:20.704653 15908 rpcz_store.cc:276] 0709 12:25:18.386262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.865097 (+478835us) service_pool.cc:224] Handling call
0709 12:25:18.865435 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.922877 (+1057442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.630581 (+707704us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400151dd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:20.630788 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369847552}
I20260709 12:25:20.704109 15987 rpcz_store.cc:276] 0709 12:25:19.519504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.560295 (+ 40791us) service_pool.cc:224] Handling call
0709 12:25:20.622473 (+1062178us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002c6354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:20.622640 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315185024}
I20260709 12:25:20.747224 15983 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.680682 19096 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:20.752943 15835 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:20.691828 19611 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:20.765908 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:20.749338 15981 rpcz_store.cc:276] 0709 12:25:19.601199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.992274 (+391075us) service_pool.cc:224] Handling call
0709 12:25:20.009407 (+ 17133us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:20.233880 (+224473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.233916 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:20.234769 (+   853us) log.cc:844] Serialized 78 byte log entry
0709 12:25:20.479280 (+244511us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:20.479317 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.479378 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.619901 (+140523us) raft_consensus.cc:1685] finished
0709 12:25:20.619923 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.620084 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12097,"raft.queue_time_us":12221,"raft.run_cpu_time_us":1032,"raft.run_wall_time_us":42774,"thread_start_us":186721,"threads_started":1,"wal-append.queue_time_us":270274}
I20260709 12:25:20.764125 15986 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:20.748534 15907 rpcz_store.cc:276] 0709 12:25:19.142671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.143393 (+   722us) service_pool.cc:224] Handling call
0709 12:25:20.611169 (+1467776us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400420ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:20.653628 (+ 42459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116785024}
I20260709 12:25:20.777340 19429 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:20.713140 19551 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:20.787057 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 77753.5us
I20260709 12:25:20.791793 15985 rpcz_store.cc:276] 0709 12:25:19.512431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.512587 (+   156us) service_pool.cc:224] Handling call
0709 12:25:19.513003 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.717308 (+204305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.717358 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.719406 (+  2048us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.986248 (+266842us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:19.986298 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.986385 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.548985 (+562600us) raft_consensus.cc:1685] finished
0709 12:25:20.549011 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.549190 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11808,"raft.queue_time_us":124117,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":11952,"thread_start_us":458017,"threads_started":2,"wal-append.queue_time_us":395357}
I20260709 12:25:20.793736 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.753923 19595 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.795372 19312 consensus_queue.cc:1243] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:20.798992 15987 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:20.751696 19258 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:20.808079 19597 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.817227 19276 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:20.817078 19597 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.817535 19443 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:20.817612 19276 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:20.818058 19443 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:20.818626 19276 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.821429 19476 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.822316 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 662) took 2105 ms. Trace:
I20260709 12:25:20.823736 19385 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:20.822793 15905 rpcz_store.cc:276] 0709 12:25:18.716586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.048116 (+331530us) service_pool.cc:224] Handling call
0709 12:25:19.048629 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.048800 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:19.154496 (+105696us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.821937 (+1667441us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b18003771a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287
0709 12:25:20.822024 (+    87us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.822069 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:20.822109 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.822168 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.822265 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181305,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":139526,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":47431,"spinlock_wait_cycles":14348544,"thread_start_us":515756,"threads_started":3,"wal-append.queue_time_us":522084,"wal-append.run_cpu_time_us":988,"wal-append.run_wall_time_us":1002567}
I20260709 12:25:20.824095 16490 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:25:20.814901 19434 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.754089 19585 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.827050 19585 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.798601 19590 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.830441 19597 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.795670 19603 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:20.831735 15988 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:20.831923 19595 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:20.803123 19425 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:20.832831 19425 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.833494 16488 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:20.834875 16494 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:25:20.836292 19568 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
I20260709 12:25:20.778952 19507 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.836759 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.839042 19507 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.839284 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:20.839653 19411 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.840122 19312 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.841120 19312 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.810701 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.765996 19426 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.842130 19521 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.842562 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:20.797664 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1822) took 1071 ms. Trace:
I20260709 12:25:20.793622 15984 rpcz_store.cc:276] 0709 12:25:18.552746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.552845 (+    99us) service_pool.cc:224] Handling call
0709 12:25:18.553167 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:18.568089 (+ 14922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.568133 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.568808 (+   675us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.888191 (+319383us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:18.891551 (+  3360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.891635 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.290666 (+1399031us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:20.694468 (+403802us) raft_consensus.cc:1685] finished
0709 12:25:20.694488 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.694714 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6455,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":1855,"spinlock_wait_cycles":27190528,"thread_start_us":277436,"threads_started":1,"wal-append.queue_time_us":367723}
I20260709 12:25:20.843358 19264 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:20.815351 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1823) took 1089 ms. Trace:
I20260709 12:25:20.843745 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.822398 19476 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.844204 19096 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:20.846784 19621 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
I20260709 12:25:20.795994 19609 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:20.841405 15910 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:20.786293 19376 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.794857 19617 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.843825 15987 rpcz_store.cc:276] 0709 12:25:19.726399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.798480 (+1072081us) service_pool.cc:224] Handling call
0709 12:25:20.798805 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.815123 (+ 16318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.815302 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:20.847090 15983 rpcz_store.cc:276] 0709 12:25:19.726030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.713692 (+987662us) service_pool.cc:224] Handling call
0709 12:25:20.714030 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.797366 (+ 83336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.797600 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:20.848975 15984 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:20.849674 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:20.850162 15829 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.841267 19411 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:20.860031 19411 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:20.843756 19264 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:20.862326 19264 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.863092 19603 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:20.863592 19603 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:20.863757 19221 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.864391 19221 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.865463 19359 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.864621 19603 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.865957 19359 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.866526 19221 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.866730 19603 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.868032 19359 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.869112 19521 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:20.841512 19312 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.870146 19312 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.806967 19429 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:20.871834 19429 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.873175 19429 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.873450 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.874179 19523 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.874626 19523 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.874579 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:20.876199 19376 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:20.876251 15803 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:20.876658 19523 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.855350 19434 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:20.889850 19434 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:20.890237 19462 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.890499 19434 consensus_queue.cc:1243] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:20.891103 19548 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.856544 19504 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.891770 19521 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:20.857115 19567 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.712s	user 0.003s	sys 0.000s
I20260709 12:25:20.858127 15986 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:20.805461 19651 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:25:20.836740 19568 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.852746 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.843366 19426 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.877642 19594 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.801153 16492 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:20.878132 19646 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.878744 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:20.904135 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:20.905731 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.878376 19609 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:20.879287 19640 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
I20260709 12:25:20.879379 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:20.879684 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.908495 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1285) took 2273 ms. Trace:
I20260709 12:25:20.857928 19615 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.911974 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.912876 15987 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:20.857539 19621 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.880867 19584 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.880945 15829 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:20.916417 19584 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:20.878389 19423 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:20.916836 19584 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.917174 19423 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:20.918061 19423 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.918793 19650 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:20.919556 19609 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.919463 19650 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.863612 19264 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:20.883502 19626 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.599s	user 0.000s	sys 0.000s
I20260709 12:25:20.925793 19650 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.925887 19548 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:20.926115 19594 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.926851 19594 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:20.884457 19450 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:20.834939 19425 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:20.885723 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 65691.8us
I20260709 12:25:20.927835 19450 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:20.927762 19594 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:20.885242 15981 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.929095 19504 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:20.928767 19450 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.929584 19504 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:20.929406 19586 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:20.799580 19611 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:20.930521 19504 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:20.854766 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 63650.7us
I20260709 12:25:20.851560 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 666) took 1336 ms. Trace:
I20260709 12:25:20.899338 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:20.902141 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.937070 15986 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:20.908830 15979 rpcz_store.cc:276] 0709 12:25:18.635160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.635337 (+   177us) service_pool.cc:224] Handling call
0709 12:25:18.635779 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.648185 (+ 12406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.648213 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.673280 (+ 25067us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.971302 (+298022us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:18.971356 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.971444 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.856560 (+1885116us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:20.899213 (+ 42653us) raft_consensus.cc:1685] finished
0709 12:25:20.899231 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.908437 (+  9206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11989,"raft.queue_time_us":12251,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8230,"spinlock_wait_cycles":37357312,"thread_start_us":246325,"threads_started":1,"wal-append.queue_time_us":378880}
I20260709 12:25:20.915360 19462 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.915634 19615 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:20.915838 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.933166 15802 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:20.941311 15987 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:20.938074 15980 rpcz_store.cc:276] 0709 12:25:19.514830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.514950 (+   120us) service_pool.cc:224] Handling call
0709 12:25:20.624960 (+1110010us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5800003998. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d127cfc0 00007f03d1267929 00007f03d12673d2 00007f03ca7debd4
0709 12:25:20.625160 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.625393 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:20.625739 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.851141 (+225402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.851208 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:20.851264 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.851345 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.851490 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4630,"prepare.queue_time_us":3633,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":73320,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":6799104,"thread_start_us":185941,"threads_started":1}
I20260709 12:25:20.942649 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.943881 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.943426 15979 raft_consensus.cc:2393] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:20.911767 19426 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:20.911814 19434 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:20.949564 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:20.950564 15802 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:20.948763 19648 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:20.913400 19376 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.955322 15831 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:20.934283 19487 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.973142 19568 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:20.974905 19621 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:20.975279 19650 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.976342 19646 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:20.976845 19646 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:20.977900 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1824) took 1180 ms. Trace:
I20260709 12:25:20.978278 15981 rpcz_store.cc:276] 0709 12:25:19.797404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.805878 (+1008474us) service_pool.cc:224] Handling call
0709 12:25:20.806253 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.929095 (+122842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.977676 (+ 48581us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b540011a8d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:20.977845 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181226752}
W20260709 12:25:20.993281 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 469644us
I20260709 12:25:20.941259 19548 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:20.931844 19611 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.904260 19610 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.005415 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.005996 15835 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.007814 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:20.961417 19359 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.014274 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.015818 15830 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.956489 19615 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:21.015188 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:20.999771 19616 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.960966 19648 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:21.020254 16488 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:20.998528 19376 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:20.853986 19629 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.023283 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:21.001201 19487 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:21.025939 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:21.028942 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:21.015375 19650 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.031191 16494 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:21.015672 19360 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.044974 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:21.021725 19611 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:21.046391 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:21.056742 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:21.000257 19312 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.060160 15986 raft_consensus.cc:2410] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:21.031231 19487 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:21.063776 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.031164 19586 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:21.074173 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.075309 15904 raft_consensus.cc:2410] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:21.056384 19629 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:21.087639 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 203559us
I20260709 12:25:21.081669 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.082904 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.012131 19548 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.085529 16489 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:21.097510 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:21.090376 15904 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.095184 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.100281 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:21.101850 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:21.061416 19096 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:21.046244 19351 consensus_queue.cc:1175] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fd62f0fa06a4561a0a7101b85942f86" responder_term: 7 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:21.105146 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.107040 15830 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:21.108040 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.110831 15904 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:21.112416 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:21.112915 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.114023 16490 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:21.116086 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.116660 15904 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:21.119086 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:21.122853 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.123498 15904 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.123694 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:21.124773 16495 raft_consensus.cc:2410] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:25:21.110371 19606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.007s	sys 0.011s
I20260709 12:25:21.139627 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.145576 15830 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 5: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:21.057473 19650 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.059403 19360 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:21.140964 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.144528 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.155396 15905 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:21.027906 19616 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.086048 19513 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:25:21.164469 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.168004 15908 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:21.117287 19434 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:21.168166 15904 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:21.158677 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.170034 15987 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:21.153332 19606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.007s	sys 0.012s
I20260709 12:25:21.171819 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:21.157578 19426 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:21.297308 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:21.299268 19426 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:21.172642 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 265141us
I20260709 12:25:21.300675 19434 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.301734 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:21.165720 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.194106 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.199824 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.202071 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.295817 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 183479us
I20260709 12:25:21.304594 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:21.308595 15834 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:21.117532 19587 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 12:25:21.309468 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 193710us
I20260709 12:25:21.312448 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1764) took 1392 ms. Trace:
I20260709 12:25:21.315042 15837 rpcz_store.cc:276] 0709 12:25:19.919928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.987742 (+ 67814us) service_pool.cc:224] Handling call
0709 12:25:20.012079 (+ 24337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.227360 (+215281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.312239 (+1084879us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540021ff54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:21.312392 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273666944}
I20260709 12:25:21.316435 15837 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:21.160164 19649 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:21.324800 19462 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:21.184953 19646 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:21.351375 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.349799 15835 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:21.353432 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:21.354182 15835 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:21.355547 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.356281 15835 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.143187 19487 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.320425 19523 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.108620 19615 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.371939 19584 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:21.373090 19656 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 12:25:21.373736 19657 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.264s	user 0.000s	sys 0.000s
I20260709 12:25:21.377496 19487 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.378217 19312 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:21.386821 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 70911us
I20260709 12:25:21.097402 19648 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.327746 19462 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:21.387909 19659 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 12:25:21.378829 19360 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:21.403781 15987 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:21.385739 19649 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:21.402513 19476 consensus_meta.cc:287] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.001s
I20260709 12:25:21.396144 19610 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:21.431437 15835 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:21.435659 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:21.437691 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.408203 19312 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.440979 19312 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:21.442698 19661 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:25:21.385370 19523 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.407979 19376 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:21.443061 19312 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:21.460070 19264 consensus_meta.cc:287] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 12:25:21.461683 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:21.464355 19603 consensus_meta.cc:287] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.000s
I20260709 12:25:21.464849 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 661) took 1340 ms. Trace:
I20260709 12:25:21.421087 19590 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.465339 16496 rpcz_store.cc:276] 0709 12:25:20.124602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.124756 (+   154us) service_pool.cc:224] Handling call
0709 12:25:21.464637 (+1339881us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54004da3d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:21.464761 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104699136}
I20260709 12:25:21.469919 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:21.474596 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1346) took 1633 ms. Trace:
I20260709 12:25:21.475216 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:21.455564 19664 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:25:21.478860 19359 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:21.480660 19654 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260709 12:25:21.481822 19462 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:21.482877 19650 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:21.484617 19616 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:21.490207 19617 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.001s
I20260709 12:25:21.490639 19617 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:21.492842 19632 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.184s	user 0.002s	sys 0.000s
I20260709 12:25:21.495615 15982 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:21.486095 19584 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:21.496129 19429 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.002s
I20260709 12:25:21.497599 19523 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:21.454167 19589 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:21.498241 19589 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:21.499099 19589 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.500273 19589 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:21.503002 19662 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
W20260709 12:25:21.506040 19633 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.192s	user 0.000s	sys 0.002s
I20260709 12:25:21.474939 15906 rpcz_store.cc:276] 0709 12:25:19.840880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.288456 (+447576us) service_pool.cc:224] Handling call
0709 12:25:20.288684 (+   228us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:20.314339 (+ 25655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.314373 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:20.314968 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 12:25:20.636685 (+321717us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b180042cc40. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:25:20.933060 (+296375us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:20.933101 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.933160 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.457420 (+524260us) raft_consensus.cc:1685] finished
0709 12:25:21.457443 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.474535 (+ 17092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25229,"raft.queue_time_us":26215,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":26481,"spinlock_wait_cycles":10428288,"thread_start_us":296172,"threads_started":1,"wal-append.queue_time_us":691981}
I20260709 12:25:21.478976 19590 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.512718 19590 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:21.515198 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 657) took 1469 ms. Trace:
W20260709 12:25:21.520753 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 43959.7us
I20260709 12:25:21.517083 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2816) took 1609 ms. Trace:
I20260709 12:25:21.471724 19548 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:21.505373 19603 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:21.471959 19249 raft_consensus.cc:993] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:25:21.536586 15836 rpcz_store.cc:276] 0709 12:25:19.907777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.953804 (+ 46027us) service_pool.cc:224] Handling call
0709 12:25:19.961343 (+  7539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.670263 (+708920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.670294 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.670735 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:25:20.954965 (+284230us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:20.955013 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.516618 (+561605us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400083754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:21.516678 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.516732 (+    54us) raft_consensus.cc:1685] finished
0709 12:25:21.516752 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.516996 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1616,"raft.queue_time_us":27520,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1166,"spinlock_wait_cycles":1563378560,"thread_start_us":263571,"threads_started":1,"wal-append.queue_time_us":360851}
I20260709 12:25:21.594944 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 672) took 1427 ms. Trace:
I20260709 12:25:21.595151 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:21.595903 15836 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.535884 16489 rpcz_store.cc:276] 0709 12:25:20.046309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.046595 (+   286us) service_pool.cc:224] Handling call
0709 12:25:20.046850 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.104267 (+1057417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.514920 (+410653us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400493754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:21.515127 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388198144}
I20260709 12:25:21.541874 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:21.597169 15984 raft_consensus.cc:2410] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:21.543151 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:21.545743 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:21.615885 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.617304 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.618393 15911 raft_consensus.cc:2410] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:21.595431 15985 rpcz_store.cc:276] 0709 12:25:20.167900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.809010 (+641110us) service_pool.cc:224] Handling call
0709 12:25:20.809402 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:20.809848 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.809888 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:20.815672 (+  5784us) log.cc:844] Serialized 52 byte log entry
0709 12:25:21.061557 (+245885us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:21.061595 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.061670 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:21.594686 (+533016us) raft_consensus.cc:1685] finished
0709 12:25:21.594714 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:21.594874 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66753,"raft.queue_time_us":3522,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5490,"thread_start_us":235393,"threads_started":1,"wal-append.queue_time_us":313088}
I20260709 12:25:21.657472 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:21.658217 16492 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:21.658670 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.659317 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:21.661412 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.662145 15911 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:21.662729 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.666525 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.666847 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.667110 15906 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:21.667404 15909 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:21.667870 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:21.664018 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.669703 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:21.672242 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:21.590519 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 257088us
W20260709 12:25:21.593273 19678 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:25:21.540714 19617 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:21.673120 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:21.679039 15836 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:21.656788 19434 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.593912 19603 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:21.698104 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.585479 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:21.670292 15908 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:21.690644 15980 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:21.684046 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:21.675498 15985 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:22.835155 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1838) took 1160 ms. Trace:
I20260709 12:25:22.835515 15985 rpcz_store.cc:276] 0709 12:25:21.674752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.674904 (+   152us) service_pool.cc:224] Handling call
0709 12:25:21.675268 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.834721 (+1159453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.834995 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:22.839856 19276 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.681285 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:21.996966 15836 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:22.844007 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1776) took 1502 ms. Trace:
I20260709 12:25:22.844347 15836 rpcz_store.cc:276] 0709 12:25:21.341575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.995799 (+654224us) service_pool.cc:224] Handling call
0709 12:25:21.996471 (+   672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.843721 (+847250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.843943 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:22.846146 19711 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.844033 15987 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:22.846962 19711 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:21.998065 15834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42230
I20260709 12:25:22.849900 19711 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:22.851361 15835 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:25:22.051620 15952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.002s	sys 0.033s
W20260709 12:25:22.856621 15952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.002s	sys 0.033s
W20260709 12:25:22.087371 15802 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.012s	sys 0.017s
W20260709 12:25:22.857347 15802 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.684s	user 0.012s	sys 0.017s
W20260709 12:25:22.857826 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.68442e+06us
W20260709 12:25:22.098898 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 513415us
I20260709 12:25:22.110289 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:22.111693 15953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.008s	sys 0.008s
W20260709 12:25:22.129935 15830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.009s	sys 0.015s
W20260709 12:25:22.139943 16495 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.018s
W20260709 12:25:22.147298 15878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.006s	sys 0.010s
I20260709 12:25:22.193316 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:22.198992 16490 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:25:22.200951 16489 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:22.206418 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:22.306695 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:22.311127 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.373471 19705 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.376411 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.415333 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1348) took 2571 ms. Trace:
W20260709 12:25:22.457144 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.535542 19710 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:22.542567 15950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.153s	user 0.030s	sys 0.066s
W20260709 12:25:22.555115 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.753937 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1828) took 2433 ms. Trace:
I20260709 12:25:22.754101 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 767) took 2713 ms. Trace:
I20260709 12:25:22.765650 19709 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:22.766000 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:22.082346 18866 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:21.654233 19096 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:21.978462 19292 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:23.053720 19096 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.054566 19292 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:23.055755 19292 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.057377 19292 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:22.545148 19382 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:23.060159 19382 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.062880 19382 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:21.893760 19425 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.753340 19423 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.654752 19258 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.066248 19258 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.068398 19258 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:21.656992 19312 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.756916 19504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.600s	user 0.029s	sys 0.035s
I20260709 12:25:21.663333 19311 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:21.881834 19411 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.074802 19411 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.741518 19415 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:21.704872 19434 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.083863 15907 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:21.826282 19443 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:21.719841 19450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.014s	sys 0.019s
I20260709 12:25:21.679734 19523 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.097003 19584 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:23.096904 19523 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.701792 19603 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.099246 19415 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.099920 19415 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.101925 19415 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:23.099298 19523 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:22.016546 19608 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.997s	user 0.000s	sys 0.003s
W20260709 12:25:21.734107 19611 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.007s
I20260709 12:25:23.109519 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2807) took 4128 ms. Trace:
I20260709 12:25:23.109918 15832 rpcz_store.cc:276] 0709 12:25:18.980788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.103225 (+122437us) service_pool.cc:224] Handling call
0709 12:25:19.103506 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.391047 (+287541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.391090 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.392810 (+  1720us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.698499 (+305689us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:20.004274 (+305775us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.120440 (+116166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.123043 (+  2603us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.015717 (+1892674us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:23.109005 (+1093288us) raft_consensus.cc:1685] finished
0709 12:25:23.109117 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.109330 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12353,"prepare.queue_time_us":74304,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":145970,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":25317,"spinlock_wait_cycles":7550336,"thread_start_us":831447,"threads_started":4,"wal-append.queue_time_us":518783}
I20260709 12:25:21.702739 19487 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.112883 19487 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.113372 19487 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.117633 15905 raft_consensus.cc:2410] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:23.119136 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1356) took 1501 ms. Trace:
I20260709 12:25:23.119508 15905 rpcz_store.cc:276] 0709 12:25:21.617240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.658351 (+ 41111us) service_pool.cc:224] Handling call
0709 12:25:23.118895 (+1460544us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400196ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:23.119081 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352562944}
I20260709 12:25:22.144238 19621 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:23.121824 19621 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:21.745121 19629 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:25:21.668965 19548 raft_consensus.cc:1081] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:25:23.125982 19603 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:21.852694 19586 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:23.128327 19621 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:21.886251 19628 log.cc:927] Time spent T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 1.630s	user 0.001s	sys 0.001s
I20260709 12:25:21.593912 19645 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:25:21.655400 19649 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.135551 19603 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:21.747659 19658 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:25:23.139459 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 669) took 3240 ms. Trace:
W20260709 12:25:22.126791 19668 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.668s	user 0.003s	sys 0.001s
I20260709 12:25:22.779712 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1766) took 2859 ms. Trace:
I20260709 12:25:23.142838 15833 rpcz_store.cc:276] 0709 12:25:19.920496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.062778 (+142282us) service_pool.cc:224] Handling call
0709 12:25:20.063037 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.581474 (+518437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.774555 (+2193081us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540020e254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:22.779411 (+  4856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979897088}
I20260709 12:25:22.172789 19648 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:22.169561 19674 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.713s	user 0.002s	sys 0.002s
W20260709 12:25:21.718658 19680 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:25:23.153421 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 782) took 2219 ms. Trace:
W20260709 12:25:21.722030 19693 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:25:22.312009 19699 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:22.784253 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1837) took 1453 ms. Trace:
I20260709 12:25:22.813347 19692 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:23.161891 19692 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.160771 15988 rpcz_store.cc:276] 0709 12:25:21.321775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.321891 (+   116us) service_pool.cc:224] Handling call
0709 12:25:21.322197 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.322387 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:21.591233 (+268846us) log.cc:844] Serialized 14 byte log entry
0709 12:25:21.663216 (+ 71983us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.541853 (+878637us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18002dffa0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:22.554340 (+ 12487us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.558003 (+  3663us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18002dffa0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:22.744643 (+186640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:22.745890 (+  1247us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:22.756088 (+ 10198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.764702 (+  8614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.774805 (+ 10103us) inbound_call.cc:177] Queueing success response
0709 12:25:22.858178 (+ 83373us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18002dffa0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
Metrics: {"mutex_wait_us":1032530,"prepare.queue_time_us":431674,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":83446,"raft.queue_time_us":1141358,"raft.run_cpu_time_us":531,"raft.run_wall_time_us":36480,"spinlock_wait_cycles":53474048,"thread_start_us":233613,"threads_started":1}
I20260709 12:25:23.164273 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:22.813464 19713 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.819205 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:22.819973 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1841) took 1130 ms. Trace:
I20260709 12:25:23.165752 19692 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.165628 15980 rpcz_store.cc:276] 0709 12:25:21.689737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.689938 (+   201us) service_pool.cc:224] Handling call
0709 12:25:21.690272 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.819420 (+1129148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.819786 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.166853 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.139866 15913 rpcz_store.cc:276] 0709 12:25:19.898673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.523895 (+625222us) service_pool.cc:224] Handling call
0709 12:25:20.524450 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.783723 (+259273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.783769 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.784318 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.103214 (+318896us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:21.103252 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.516042 (+412790us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400431554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:21.516103 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.138854 (+1622751us) raft_consensus.cc:1685] finished
0709 12:25:23.138899 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.139235 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4901,"raft.queue_time_us":7763,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7733,"spinlock_wait_cycles":591638400,"thread_start_us":318572,"threads_started":1,"wal-append.queue_time_us":736153}
I20260709 12:25:22.820191 15979 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:22.822242 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1840) took 1138 ms. Trace:
I20260709 12:25:22.821846 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:22.826325 19714 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.812191 16460 connection.cc:256] RPC call timeout handler was delayed by -1.1665787629999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3089s for a response
W20260709 12:25:22.865226 15878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.007s	sys 0.010s
W20260709 12:25:22.864603 19708 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 12:25:23.165493 15984 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.864540 15834 raft_consensus.cc:606] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Received request to transfer leadership
I20260709 12:25:23.168839 15980 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:22.866638 15982 rpcz_store.cc:276] 0709 12:25:20.320712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.679773 (+359061us) service_pool.cc:224] Handling call
0709 12:25:22.560936 (+1881163us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400186ad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:22.753657 (+192721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856358272}
W20260709 12:25:22.870373 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.175968 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.871086 15830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.488s	user 0.010s	sys 0.016s
I20260709 12:25:23.177070 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2822) took 2170 ms. Trace:
I20260709 12:25:23.177443 15988 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:23.177603 19411 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.872004 16492 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:22.871829 19705 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.178305 19411 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.178712 19609 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:23.179479 19609 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.180238 19705 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:23.180363 19411 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:22.872001 19594 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:22.872478 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 566212us
I20260709 12:25:23.181833 19609 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.183859 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42230 (request call id 0) took 2172 ms. Trace:
I20260709 12:25:23.184227 15834 rpcz_store.cc:276] 0709 12:25:21.016801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.997683 (+980882us) service_pool.cc:224] Handling call
0709 12:25:23.183758 (+1186075us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:22.869536 15950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.480s	user 0.030s	sys 0.066s
W20260709 12:25:23.185330 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.866895 15831 rpcz_store.cc:276] 0709 12:25:20.040737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.123936 (+ 83199us) service_pool.cc:224] Handling call
0709 12:25:20.135210 (+ 11274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.967361 (+832151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.745128 (+1777767us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540003b1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:22.753872 (+  8744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885707520}
W20260709 12:25:22.879120 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.186662 19692 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.187193 19692 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:22.878888 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.190030 19621 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.190285 15831 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:23.190714 19621 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:23.192624 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.883486 16495 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.413s	user 0.000s	sys 0.019s
I20260709 12:25:23.196466 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:22.883620 19711 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.884054 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.894675 15987 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:22.893385 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:22.895879 15838 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:22.896541 19709 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.203367 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 785) took 1035 ms. Trace:
W20260709 12:25:23.203547 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.204016 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.913578 19707 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.128s	user 0.000s	sys 0.003s
I20260709 12:25:22.933851 19221 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:23.205498 19221 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:22.948776 19161 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:23.206514 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.197189 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:22.998302 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2832) took 1892 ms. Trace:
W20260709 12:25:22.955233 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 59400.7us
W20260709 12:25:23.014341 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 112939us
W20260709 12:25:22.985198 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 54175.9us
I20260709 12:25:23.042712 15730 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 4 to 7, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 7 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.044963 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 590) took 1508 ms. Trace:
W20260709 12:25:23.051007 15732 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 280) took 20816 ms (client timeout 15000 ms). Trace:
I20260709 12:25:23.063182 19513 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:23.064600 19425 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.070087 19312 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.070919 19423 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:23.071733 19504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.985s	user 0.031s	sys 0.036s
I20260709 12:25:23.092279 19434 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.091070 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1360) took 1427 ms. Trace:
I20260709 12:25:23.092805 19443 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:23.095444 19450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.163s	user 0.015s	sys 0.020s
W20260709 12:25:23.121156 19595 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.020s
I20260709 12:25:23.125156 19249 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.365976 16492 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:23.128676 19586 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:23.154379 19487 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.153896 15829 rpcz_store.cc:276] 0709 12:25:20.934133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.934268 (+   135us) service_pool.cc:224] Handling call
0709 12:25:20.934550 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.946171 (+ 11621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.946213 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.955595 (+  9382us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.078100 (+122505us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:21.078139 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.078202 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.168651 (+1090449us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:23.152882 (+984231us) raft_consensus.cc:1685] finished
0709 12:25:23.152910 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.153223 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10857,"raft.queue_time_us":14179,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":11673,"spinlock_wait_cycles":11766656,"thread_start_us":57070,"threads_started":1,"wal-append.queue_time_us":391177}
I20260709 12:25:23.158910 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1303) took 2090 ms. Trace:
I20260709 12:25:23.159976 19699 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.165480 19713 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:22.856995 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.4627e+06us
W20260709 12:25:22.864959 15953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.478s	user 0.008s	sys 0.009s
I20260709 12:25:22.870952 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1361) took 1207 ms. Trace:
I20260709 12:25:23.193497 15833 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:23.419818 15834 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:23.194185 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:23.177454 15830 rpcz_store.cc:276] 0709 12:25:21.006147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.302702 (+296555us) service_pool.cc:224] Handling call
0709 12:25:21.303009 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.303207 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:21.383044 (+ 79837us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.176565 (+1793521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:23.176656 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:23.176732 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.176813 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.176966 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24457,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":13279,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":1899264,"thread_start_us":1871680,"threads_started":2,"wal-append.queue_time_us":356258,"wal-append.run_cpu_time_us":1386,"wal-append.run_wall_time_us":1017575}
I20260709 12:25:22.865921 15910 rpcz_store.cc:276] 0709 12:25:19.843416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.352006 (+508590us) service_pool.cc:224] Handling call
0709 12:25:20.841126 (+489120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.854295 (+ 13169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.414757 (+1560462us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400305550. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:22.415079 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124087552}
I20260709 12:25:23.195652 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:23.195907 15908 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:23.192888 19621 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:22.880504 19710 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.175400 15983 rpcz_store.cc:276] 0709 12:25:21.683678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.683799 (+   121us) service_pool.cc:224] Handling call
0709 12:25:22.822047 (+1138248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.203743 15838 rpcz_store.cc:276] 0709 12:25:22.167775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.765467 (+597692us) service_pool.cc:224] Handling call
0709 12:25:23.203275 (+437808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:22.911825 19717 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:23.205072 19709 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:23.210832 15987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1839) took 1529 ms (client timeout 1610 ms). Trace:
I20260709 12:25:23.231452 15836 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:23.206642 19411 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.309425 15913 raft_consensus.cc:2393] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:23.309638 15986 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:23.305572 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 96950.3us
I20260709 12:25:23.202507 15906 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:23.311749 19423 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.318056 15984 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:23.309226 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:23.321159 15907 rpcz_store.cc:276] 0709 12:25:21.663643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.663808 (+   165us) service_pool.cc:224] Handling call
0709 12:25:23.086998 (+1423190us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400073854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:23.090991 (+  3993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3252734208}
I20260709 12:25:23.308013 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:23.231571 19292 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.197321 19561 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.450699 19561 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.451768 16494 raft_consensus.cc:2376] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6. Re-sending same reply.
I20260709 12:25:23.262125 19609 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:23.196120 19594 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:23.453557 19411 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.454125 19594 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.455865 19411 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.363878 15730 catalog_manager.cc:5697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 5 to 8, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 8 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.457921 15730 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 5, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:23.459231 15838 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:23.459822 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:23.397764 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 672) took 1177 ms. Trace:
I20260709 12:25:23.369220 19434 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.461470 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:23.462091 15832 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:23.461886 19434 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.463092 19415 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.463780 19415 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.420964 15912 rpcz_store.cc:276] 0709 12:25:21.663916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.664123 (+   207us) service_pool.cc:224] Handling call
0709 12:25:22.870856 (+1206733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.464073 19434 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.461246 16492 rpcz_store.cc:276] 0709 12:25:22.189821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.192643 (+  2822us) service_pool.cc:224] Handling call
0709 12:25:23.366623 (+1173980us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:23.464766 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 270725us
I20260709 12:25:23.465365 19311 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:23.362430 15802 connection.cc:256] RPC call timeout handler was delayed by -1.6223373439997886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31150000000000005s for a response
I20260709 12:25:23.202652 19603 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:23.366528 19595 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.005s	sys 0.020s
I20260709 12:25:23.232010 15837 rpcz_store.cc:276] 0709 12:25:21.105890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.318822 (+212932us) service_pool.cc:224] Handling call
0709 12:25:21.319061 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:21.331933 (+ 12872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.332064 (+   131us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:22.854789 (+1522725us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180044e3c0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a
0709 12:25:22.855298 (+   509us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b2c00057528. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:25:22.855914 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:25:22.885358 (+ 29444us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:22.980072 (+ 94714us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.997513 (+ 17441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.997697 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.997777 (+    80us) raft_consensus.cc:1685] finished
0709 12:25:22.997797 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.998059 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12494,"prepare.queue_time_us":129085,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":52273,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":13738,"spinlock_wait_cycles":48084608,"thread_start_us":124734,"threads_started":3,"wal-append.queue_time_us":42159}
W20260709 12:25:23.438531 15987 rpcz_store.cc:269] 0709 12:25:21.680909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.681028 (+   119us) service_pool.cc:224] Handling call
0709 12:25:23.205767 (+1524739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.448520 19705 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:23.448899 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.449452 15905 raft_consensus.cc:2410] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:23.486879 15833 raft_consensus.cc:2410] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:23.449817 19548 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.487576 19548 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.487809 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:23.452988 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 675) took 1252 ms. Trace:
I20260709 12:25:23.362149 16496 rpcz_store.cc:276] 0709 12:25:21.536810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.536941 (+   131us) service_pool.cc:224] Handling call
0709 12:25:21.537247 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:22.948217 (+1410970us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:22.948264 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:22.948321 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:22.948374 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.043657 (+ 95283us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400619ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:23.043701 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.044766 (+  1065us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26300,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"spinlock_wait_cycles":3242918656}
I20260709 12:25:23.421957 15908 pending_rounds.cc:85] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 7
I20260709 12:25:23.488863 16494 rpcz_store.cc:276] 0709 12:25:22.200170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.205909 (+  5739us) service_pool.cc:224] Handling call
0709 12:25:23.452835 (+1246926us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54004da3d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:23.452940 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352563584}
I20260709 12:25:23.305174 19711 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.489746 19548 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.489494 15908 pending_rounds.cc:107] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:23.490289 15908 raft_consensus.cc:2889] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:23.466287 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 158358us
I20260709 12:25:23.491263 19711 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:23.494859 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:23.495311 19425 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.495837 19717 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.497129 15911 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.497459 15831 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:23.498104 19717 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.365993 19426 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:23.498724 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:23.499423 19523 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.499342 19426 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.499971 19523 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.500339 19523 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.501461 19561 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:23.501709 19426 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.423224 19249 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:23.504129 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 60550.7us
W20260709 12:25:23.513010 15802 connection.cc:256] RPC call timeout handler was delayed by -1.5260373439996329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32220000000000004s for a response
I20260709 12:25:23.508539 16492 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:23.308351 19692 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:23.509871 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.515421 19603 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.515625 19292 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.517112 19312 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.517346 19730 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:23.517717 19249 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.518015 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:23.518457 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.517726 19292 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.519110 15982 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:23.313875 15732 rpcz_store.cc:269] 0709 12:25:02.234482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.237259 (+  2777us) service_pool.cc:224] Handling call
0709 12:25:23.050732 (+20813473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:14.121096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:14.121751 (+   655us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:14.121804 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:25:14.121840 (+    36us) tablet.cc:662] Decoding operations
0709 12:25:14.174818 (+ 52978us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:14.174908 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:14.174934 (+    26us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:25:14.176977 (+  2043us) tablet.cc:701] Row locks acquired
0709 12:25:14.177030 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:25:14.214160 (+ 37130us) write_op.cc:270] Start()
0709 12:25:14.300114 (+ 85954us) write_op.cc:276] Timestamp: P: 1783599914193769 usec, L: 0
0709 12:25:14.307039 (+  6925us) op_driver.cc:348] REPLICATION: starting
0709 12:25:14.416186 (+109147us) log.cc:844] Serialized 11796 byte log entry
0709 12:25:16.261915 (+1845729us) op_driver.cc:464] REPLICATION: finished
0709 12:25:16.457103 (+195188us) write_op.cc:301] APPLY: starting
0709 12:25:16.457201 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:16.512075 (+ 54874us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:16.512202 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:17.690881 (+1178679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:17.691537 (+   656us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 12:25:17.691611 (+    74us) write_op.cc:312] APPLY: finished
0709 12:25:17.692360 (+   749us) log.cc:844] Serialized 200 byte log entry
0709 12:25:17.839396 (+147036us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:17.861112 (+ 21716us) write_op.cc:454] Released schema lock
0709 12:25:17.874559 (+ 13447us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:17.881710 (+  7151us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:17.881779 (+    69us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":345479,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":177215,"apply.run_cpu_time_us":27871,"apply.run_wall_time_us":1424497,"num_ops":30,"prepare.queue_time_us":114708,"prepare.run_cpu_time_us":29650,"prepare.run_wall_time_us":388616,"raft.queue_time_us":834657,"raft.run_cpu_time_us":26089,"raft.run_wall_time_us":227157,"replication_time_us":1895120,"thread_start_us":727899,"threads_started":5,"wal-append.queue_time_us":582515,"wal-append.run_cpu_time_us":39056,"wal-append.run_wall_time_us":3094387}]]}
I20260709 12:25:23.517733 19312 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:23.520515 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.460863 15730 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 6 to 8, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 8 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:23.305769 19716 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:23.305281 19161 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.526585 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.422523 15981 rpcz_store.cc:276] 0709 12:25:21.069633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.069766 (+   133us) service_pool.cc:224] Handling call
0709 12:25:21.070201 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:21.310495 (+240294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.310543 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:21.311184 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 12:25:21.388097 (+ 76913us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:21.388185 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.500411 (+112226us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000c7e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:21.500458 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.156020 (+1655562us) raft_consensus.cc:1685] finished
0709 12:25:23.157139 (+  1119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.158725 (+  1586us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13161,"raft.queue_time_us":16142,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8234,"spinlock_wait_cycles":521270016,"thread_start_us":76317,"threads_started":1,"wal-append.queue_time_us":233187}
W20260709 12:25:23.508992 16459 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.640s (SENT) [suppressed 9 similar messages]
I20260709 12:25:23.527464 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:23.530779 15987 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 5.
I20260709 12:25:23.530825 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.531023 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:23.531418 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:23.537225 15907 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:23.538879 19713 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.539685 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.540674 19586 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.453615 19609 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.545650 19710 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.548851 15911 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:23.580513 19586 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:23.558213 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.566828 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 53489.1us
I20260709 12:25:23.584070 19561 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:23.585064 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 86472.7us
I20260709 12:25:23.585582 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:23.585278 15730 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 3 to 6, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:23.578629 15988 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:23.456939 19594 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.592622 19161 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:23.588377 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 125533us
I20260709 12:25:23.593071 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.593447 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.593712 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:23.594063 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:23.594477 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.595139 15834 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:23.595378 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:23.596282 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 108919us
I20260709 12:25:23.596592 15907 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:23.423321 19714 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.598335 19249 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:23.598759 19714 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.517907 19730 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.600371 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.601308 19629 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.601472 15831 raft_consensus.cc:2410] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:25:23.601797 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.438203 19450 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.602119 19730 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.602341 19548 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:23.482986 19513 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.305161 19221 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.580749 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:23.570020 15906 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:23.587219 15802 leader_election.cc:336] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.964s (SENT)
I20260709 12:25:23.594115 15835 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:23.593725 15836 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:23.601732 19629 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.572352 19716 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.581912 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:23.603974 15838 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:23.519937 19487 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.570669 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:23.602591 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.602733 19548 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:23.571389 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:23.611167 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:23.611863 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:23.661860 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.720134 19221 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.719725 15730 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 3, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 3 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.721338 15837 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:23.611371 15986 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:23.661710 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.682523 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:23.724474 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 62993.4us
I20260709 12:25:23.671702 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.661792 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:23.726614 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 155454us
I20260709 12:25:23.608583 19411 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.728785 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:23.729048 15908 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:23.729513 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:23.610034 19561 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:23.733125 15906 raft_consensus.cc:2410] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:25:23.609788 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 143928us
W20260709 12:25:23.733809 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 224826us
I20260709 12:25:23.736050 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:23.736621 15911 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:23.738363 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:23.613613 19629 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.735226 15905 raft_consensus.cc:2376] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8. Re-sending same reply.
I20260709 12:25:23.741178 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:23.744755 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:23.745561 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:23.746609 15912 raft_consensus.cc:2410] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:23.696163 19504 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.612735 19603 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.688879 19311 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:23.661438 19594 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:23.753217 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 159655us
I20260709 12:25:23.730903 19161 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:23.757877 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74932.3us
I20260709 12:25:23.602617 19450 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.746395 19714 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:23.616580 19312 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.741752 15913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:25:23.775518 15913 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.775950 15913 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:23.755594 19415 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.672174 19730 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:25:23.772818 16494 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:23.768957 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:23.771536 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.777814 19487 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:25:23.774169 19710 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.784554 19710 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.784972 19710 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.787120 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 589) took 2326 ms. Trace:
I20260709 12:25:23.753840 19739 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.778483 15910 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:23.789949 15952 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:23.733263 19548 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.769477 19258 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:23.790236 15730 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 5 to 7, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 7 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.769141 19736 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.756973 19523 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.803320 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:23.821568 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:23.818749 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74053.6us
I20260709 12:25:23.771807 19161 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.803503 19609 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:23.812723 19648 consensus_meta.cc:287] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
I20260709 12:25:23.807619 19443 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.788059 19594 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:23.829802 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 242610us
I20260709 12:25:23.831892 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:23.833061 19611 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.833600 19611 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:23.834540 16518 debug-util.cc:398] Leaking SignalData structure 0x7b08002669e0 after lost signal to thread 14652
W20260709 12:25:23.835666 16518 debug-util.cc:398] Leaking SignalData structure 0x7b080021e580 after lost signal to thread 15769
W20260709 12:25:23.836011 16518 debug-util.cc:398] Leaking SignalData structure 0x7b0800268180 after lost signal to thread 15783
I20260709 12:25:23.837384 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.791895 19415 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.841017 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:23.861954 16518 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad580 after lost signal to thread 15862
W20260709 12:25:23.862699 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 120340us
I20260709 12:25:23.857957 15985 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:23.840684 15913 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.790800 19504 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.827744 19713 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.825666 19645 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:23.869266 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.886667 15904 raft_consensus.cc:2410] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:23.887208 19443 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:23.880571 16518 debug-util.cc:398] Leaking SignalData structure 0x7b0800372900 after lost signal to thread 15937
I20260709 12:25:23.826218 19603 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:23.827764 19736 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:23.867166 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.886453 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:23.866940 19548 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.891975 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:23.895051 15913 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.895910 19594 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:23.921559 16518 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca420 after lost signal to thread 16012
W20260709 12:25:23.923026 16518 debug-util.cc:398] Leaking SignalData structure 0x7b08002349a0 after lost signal to thread 16521
I20260709 12:25:23.896605 19648 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:23.899313 19741 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:23.902199 15987 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:23.858588 19561 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.906687 19504 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.907526 19161 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:23.885008 19713 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:23.910786 19312 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:23.911413 19739 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:23.911988 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:23.891899 15829 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:23.917271 19709 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.917510 19523 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.917508 19716 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.892697 19513 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.867129 19423 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.888516 19645 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.829028 19258 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.909479 19595 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:23.953655 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:23.858808 19730 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:25:23.887694 19434 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.894405 19603 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.882138 19249 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:25:23.964246 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 185794us
I20260709 12:25:23.957180 18866 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.939007 19741 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:23.971640 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 139825us
I20260709 12:25:23.964476 19709 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.977821 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:23.960448 19713 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.881894 19311 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.979529 15952 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:23.962066 19161 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:25:23.983489 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:23.984189 19312 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:23.959398 19594 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:23.971072 19513 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.002593 16494 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:23.990027 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:23.970515 19645 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.989301 19749 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.973273 19415 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:23.953802 19443 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:23.992043 19434 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:23.988266 19603 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.995927 19741 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.015565 19513 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.018069 19710 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:24.018620 19728 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
I20260709 12:25:24.019001 19747 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:23.997605 19709 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.976235 19699 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:24.037711 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 157369us
W20260709 12:25:24.032543 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 143307us
I20260709 12:25:23.992704 19423 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.045082 19730 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.032131 19739 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:24.064603 16459 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.019819 19450 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.028290 19648 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.029311 19425 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:24.045651 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 66216.2us
W20260709 12:25:24.049465 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 66077.3us
I20260709 12:25:24.050139 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.008960 18866 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.050987 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.081403 18866 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.081923 19513 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:24.082495 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:23.787523 16495 rpcz_store.cc:276] 0709 12:25:21.450440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.450614 (+   174us) service_pool.cc:224] Handling call
0709 12:25:21.450959 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.451162 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:23.196893 (+1745731us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.748190 (+551297us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.752349 (+  4159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:23.758766 (+  6417us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:23.769265 (+ 10499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.769343 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.776783 (+  7440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111420,"prepare.queue_time_us":478267,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":86250,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21117,"thread_start_us":2167200,"threads_started":3,"wal-append.queue_time_us":407515}
W20260709 12:25:24.084192 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72112.6us
W20260709 12:25:24.084635 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 159023us
W20260709 12:25:24.088004 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 98059.6us
I20260709 12:25:24.052145 19754 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:24.088644 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.062172 19710 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:24.065416 19161 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:24.096418 19754 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.096866 19754 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.098605 19648 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:24.100010 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.102161 19487 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:24.102574 19487 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:24.103441 19487 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.104997 19487 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.107190 15952 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:24.108363 19752 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:24.068598 19730 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.110224 19752 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:24.111361 19730 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:24.116325 19733 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.394s	user 0.002s	sys 0.000s
I20260709 12:25:24.062589 19423 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.029495 19749 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.074484 19748 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:24.076265 19425 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.124894 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.128489 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.081403 19443 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.129927 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.089414 19513 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:24.133792 15987 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:24.137557 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:24.138324 15986 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.141151 19757 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:24.133587 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 51205.2us
I20260709 12:25:24.151486 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.151607 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.151693 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.152119 15985 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:24.152830 15988 raft_consensus.cc:2410] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:25:24.156100 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.156606 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.132077 19425 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.158628 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:24.158330 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.156913 15831 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:24.141673 19757 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:24.165647 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.040052 19736 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.168805 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.125932 19748 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.159695 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.169430 15832 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:24.170922 15835 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:24.155855 19561 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:24.161494 15830 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:24.164253 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.164531 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.165637 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.167809 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.139472 19161 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.144017 19513 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.142997 19443 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:24.170418 15836 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.148639 19548 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:24.174810 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:24.182322 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.184527 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95954us
I20260709 12:25:24.184535 15833 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:24.185758 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.190618 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:24.191310 15835 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:24.193262 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.198426 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.213279 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:24.197227 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.179311 19561 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.164611 19603 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.216511 15831 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:24.223531 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.172389 19748 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.220911 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.198608 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.183204 19714 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.224018 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.189200 19423 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:24.189661 19513 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:24.226810 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1358) took 2565 ms (client timeout 1782 ms). Trace:
I20260709 12:25:24.236222 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.227766 19629 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.225138 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:24.189466 19548 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.231293 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.233287 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.220520 19443 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:24.216065 19766 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:24.236476 15904 rpcz_store.cc:269] 0709 12:25:21.661418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.662494 (+  1076us) service_pool.cc:224] Handling call
0709 12:25:24.220548 (+2558054us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54004213d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:24.226734 (+  6186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5005565824}
I20260709 12:25:24.233103 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:24.241608 16492 raft_consensus.cc:2410] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:24.233871 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:24.242381 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74676.2us
I20260709 12:25:24.224785 19561 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.249675 19716 raft_consensus.cc:993] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:25:24.249796 19749 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.284507 16496 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:24.249975 15832 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:24.250304 19603 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.251995 19748 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.255352 15829 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:24.241732 19548 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.271090 15836 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:24.272161 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.260524 19713 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.237316 19730 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.234823 19423 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.265965 19258 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.273298 19766 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.262516 19732 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:24.297363 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.297966 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.298985 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.299691 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.301476 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.301564 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.264197 19249 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:24.307397 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:24.308466 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 83486.8us
I20260709 12:25:24.381496 15834 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:25:24.282027 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 217492us
I20260709 12:25:24.290413 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.317346 15983 raft_consensus.cc:2410] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:24.338744 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:24.340180 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74811.9us
I20260709 12:25:24.383431 16490 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:24.313956 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:24.276046 19692 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.284384 19312 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.385176 19312 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:24.385497 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 97395.1us
W20260709 12:25:24.386401 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.372617 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.288200 18866 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:24.369971 15879 connection.cc:256] RPC call timeout handler was delayed by -1.0310574820000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:25:24.377861 15986 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:24.292210 19411 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.378794 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.379307 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.388018 15904 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:24.395159 15988 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:24.261025 19754 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.389093 15980 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:24.338165 19423 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.400700 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.398039 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:24.402060 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.400579 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.386926 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.407624 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.380386 19594 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.410629 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.388535 19249 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:24.380017 19732 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:24.467703 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.397753 19603 raft_consensus.cc:1081] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:25:24.379386 19766 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.387529 19699 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.380635 19645 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.339857 19730 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.517342 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.472589 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:24.477753 15910 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:24.478084 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:24.476286 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 86814.1us
I20260709 12:25:24.490192 15983 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:24.519264 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.519649 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.520310 15908 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:24.472946 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.472743 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.509609 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:24.509660 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:24.510324 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:24.517022 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 116491us
I20260709 12:25:24.524363 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:24.303299 19757 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.524421 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.517503 15911 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.520103 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:24.523454 16486 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:24.531788 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.475785 19754 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.532541 15910 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:24.536453 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.540904 16495 raft_consensus.cc:3055] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:24.541415 16495 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:24.400142 19411 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.472694 19312 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.532704 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.545311 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.478443 19629 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.553929 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.554250 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.474502 19258 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:24.554734 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.553948 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.560900 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.561270 15988 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:24.561453 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.561753 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.562299 15908 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:24.561496 15987 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:24.563319 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:24.533264 19648 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.556406 16495 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.470111 18866 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.473748 19594 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.411369 19443 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.587736 19713 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.588513 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.589255 19645 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.590385 19730 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:24.590556 19769 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:24.592427 19699 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.593675 15909 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:24.594157 19594 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.592620 15912 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:24.594604 19699 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.602029 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.573645 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:24.574041 19770 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:25:24.554622 19718 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.574605 19450 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:24.577857 19771 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:24.578775 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:24.645805 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72226.3us
I20260709 12:25:24.579722 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:24.580435 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.646802 16486 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:24.581252 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:24.647643 15983 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:24.583408 18866 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:24.583694 19709 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:25:24.584359 15911 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:24.657585 19709 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.658202 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.658478 16487 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.658838 15911 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:24.659608 19709 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.659827 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.660374 15838 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:24.660776 19699 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:24.660895 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:24.661338 19699 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.661790 19699 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:24.662180 19738 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.944s	user 0.003s	sys 0.000s
I20260709 12:25:24.479290 19548 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:24.604480 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 45549.9us
I20260709 12:25:24.483494 19425 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.605585 19775 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:24.607146 19411 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.607829 15905 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:24.572682 15908 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:24.570106 19648 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.612118 15835 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:24.560832 19609 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:24.482698 19249 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.651913 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.644677 19450 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.584564 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.657356 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.611320 16495 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:24.645265 19741 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.005s
I20260709 12:25:24.674249 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:24.677290 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.678287 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.650516 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.681229 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.714550 15912 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:24.573021 19768 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:24.644032 19718 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.684885 19411 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:24.687867 19425 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.689766 19611 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.690069 15837 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:24.692498 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:24.700706 19763 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
W20260709 12:25:24.703382 19764 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.430s	user 0.010s	sys 0.008s
I20260709 12:25:24.483402 19732 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.723212 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:24.704145 19548 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:24.704496 19434 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.683879 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.716370 16494 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:24.713593 15906 raft_consensus.cc:2376] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12. Re-sending same reply.
W20260709 12:25:24.776337 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 92550us
I20260709 12:25:24.777218 16490 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:24.724300 15983 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 6.
I20260709 12:25:24.679183 19648 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.716029 19768 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.726081 19730 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:24.745194 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 358408us
I20260709 12:25:24.749547 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.679320 19609 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.712900 19450 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.721803 19423 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:24.743497 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.747721 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.739293 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.761992 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:24.737478 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:24.821084 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 83684.7us
I20260709 12:25:24.716972 19718 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.777241 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.819641 15909 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:24.793390 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.795926 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.715981 19411 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.815280 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:24.749085 19249 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.748128 19611 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.721416 19741 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.800292 15912 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:24.814476 19609 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:24.836261 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 59118.4us
I20260709 12:25:24.824677 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:24.842849 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:24.824057 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48854.1us
I20260709 12:25:24.837911 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.819821 19311 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:24.791735 19434 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.846613 15837 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:24.846195 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 438611us
I20260709 12:25:24.847483 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.844769 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.843278 15836 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:24.849623 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.850595 15909 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:24.850243 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.803552 19768 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.792533 19776 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.853863 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:24.836436 19736 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.843657 19594 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.877573 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:24.851692 19513 consensus_meta.cc:287] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:25:24.840446 19711 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:24.840312 19411 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.883160 16487 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:24.846621 19434 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.845263 19752 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.858027 15986 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.857141 19776 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.854064 19548 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.917290 19776 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.877507 19425 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:24.918107 19425 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:24.854821 19258 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.919025 16490 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.919051 19425 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.898516 19443 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.898795 19513 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.921556 19443 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.894871 19749 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:24.901098 19752 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:24.909893 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:24.935720 16459 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:24.911197 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.879462 19734 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:24.900976 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47184.4us
I20260709 12:25:24.818769 19766 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:24.941915 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:24.927819 15836 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:24.912955 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.933799 16495 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:24.888622 19594 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:24.888489 19595 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:24.850041 19737 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:25:24.974282 15986 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:24.974471 16490 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:24.947863 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:24.950774 16459 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.951161 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:24.979893 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.981288 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.904335 19434 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:24.954555 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 98133.2us
I20260709 12:25:24.955504 19741 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:24.956295 19513 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.961128 19311 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.991844 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.992353 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.965536 19450 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.941560 19752 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.972620 19594 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.002563 19450 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.003371 15833 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:25.004460 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:24.985613 19443 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:24.984521 19794 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.011392 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:25.012219 16495 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:25.013572 15835 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:25.016139 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 863) took 1509 ms. Trace:
I20260709 12:25:25.016505 16496 rpcz_store.cc:276] 0709 12:25:23.506992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.523182 (+ 16190us) service_pool.cc:224] Handling call
0709 12:25:25.015979 (+1492797us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:25.016090 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530934144}
W20260709 12:25:25.017716 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.019395 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.968575 15834 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.000s
I20260709 12:25:24.941481 19734 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.022440 19734 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.899484 19787 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:25.023402 19787 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:25.024641 19787 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:24.991849 19780 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.929852 19749 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:24.997164 19311 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.032606 19311 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.987036 15832 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:25.033294 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.963465 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:24.946656 19711 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.954586 19423 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:25.020376 15834 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:25.020785 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:25.043926 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:25.023434 19741 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.984117 19548 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:24.980470 15831 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:25.028486 16490 pending_rounds.cc:85] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 9
I20260709 12:25:25.045969 16490 pending_rounds.cc:107] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:25.046312 16490 raft_consensus.cc:2889] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.046705 16490 pending_rounds.cc:107] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:25:25.046924 16490 raft_consensus.cc:2889] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.030368 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:24.953748 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:24.986380 19692 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:24.990319 19746 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.034159 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.035390 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.027463 19766 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:25.066243 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 112608us
W20260709 12:25:25.051970 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 176019us
I20260709 12:25:25.044039 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:25.058941 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.059649 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.061527 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:25.067657 15982 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.060943 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.063113 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.068780 15988 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.069777 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.080237 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.080950 15833 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.081460 16496 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:25.066351 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.058450 19786 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:25.101702 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.102336 15835 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.039230 19711 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:25.106118 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.044782 19504 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:25.106947 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.089051 15979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:36158
I20260709 12:25:25.108161 15979 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.108603 15979 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.106942 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.083508 16489 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:25.109867 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:25.111143 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.111291 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.111243 15907 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.032702 19749 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.058797 19692 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:25.066293 19746 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:25.122457 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.088112 19221 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:25:25.107375 19716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.003s	sys 0.015s
I20260709 12:25:25.039721 19794 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:25.042462 19699 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.042047 19648 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.129205 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.132406 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.127946 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.116797 19713 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:25.124248 19757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.019s
I20260709 12:25:25.113210 19711 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.138453 15907 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:25.139760 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 98525.4us
I20260709 12:25:25.140625 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.068200 19741 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.144853 15838 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:25.160089 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 184437us
I20260709 12:25:25.154117 15835 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:25.124503 19746 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.123616 19443 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:25.134373 19716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.006s	sys 0.016s
I20260709 12:25:25.124666 19692 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.117651 19786 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:25.156447 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 121578us
W20260709 12:25:25.156781 19757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.020s
I20260709 12:25:25.159091 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:25.146023 19561 consensus_meta.cc:287] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.000s
I20260709 12:25:25.188050 15984 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:25.213196 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.213773 15983 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:25.200393 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.216285 15907 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:25.210285 15980 raft_consensus.cc:2410] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:25.157421 19749 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.220587 15981 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:25.128343 19768 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:25.220129 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 92245us
I20260709 12:25:25.233872 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:25.232583 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.237550 16460 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.244581 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:25.247364 15907 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.258167 19781 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:25.362111 15979 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.371958 19781 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.221634 19561 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:25.380968 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 143492us
I20260709 12:25:25.267804 19748 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:25.257484 16493 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:25.214510 19513 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:25:25.261785 19786 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.350543 15982 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:25.387616 15833 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:25.388862 19513 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.389400 19513 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:25.390359 19513 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.391660 19513 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:25.393229 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 150912us
I20260709 12:25:25.395709 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.396428 19594 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.376415 18866 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:25.360319 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 117687us
I20260709 12:25:25.362278 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.212829 19737 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:25.369666 19699 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.240051 19411 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.377010 15907 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:25.380716 19258 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.397132 19709 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:25.403882 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 216338us
I20260709 12:25:25.243849 19443 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.410943 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:25.414000 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.358176 15983 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:25.376610 19757 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:25.438266 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 327171us
I20260709 12:25:25.420591 15909 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:25.419288 16488 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:25.381143 19781 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.416298 15879 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.432646 15907 pending_rounds.cc:85] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 6
I20260709 12:25:25.452488 15907 pending_rounds.cc:107] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:25.452850 15907 raft_consensus.cc:2889] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.415666 19820 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:25.415675 19787 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:25:25.440596 15982 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:25.435253 19718 consensus_meta.cc:287] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.008s
W20260709 12:25:25.421258 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 62662.3us
I20260709 12:25:25.447986 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.419348 19814 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.436002 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:25.457939 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:25.460978 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 109195us
I20260709 12:25:25.392554 19711 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.435252 19748 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:25.432284 19594 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:25.463621 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.456418 19648 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.454504 19709 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:25.454196 19820 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.482664 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.483309 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:25.459877 19757 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:25.489766 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:25.490510 15910 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.491055 15983 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:25.471575 19258 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.501487 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.503603 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.472316 19802 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.504166 15833 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.505110 19548 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:25.505452 19709 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.508659 19411 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.510424 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:25.510454 19711 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:25.514214 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:25.514605 19822 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:25.515766 19822 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.516193 19822 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.516606 19822 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.463749 19718 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.517632 19757 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.518460 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.519549 19718 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.521447 19775 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:25.522943 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.525243 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:25.525818 16492 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.514788 19827 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:25.527069 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.521858 19775 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:25.528966 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:25.529556 19776 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.004s
I20260709 12:25:25.529600 19775 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.479489 19221 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:25.482789 19748 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:25.532169 15983 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:25.547456 16489 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:25.482973 19820 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.548645 16493 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:25.548787 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 132584us
I20260709 12:25:25.532254 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.553583 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.483242 19434 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.502969 19741 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:25.526935 19768 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:25.517673 19609 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.001s
I20260709 12:25:25.552413 19595 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:25:25.563437 19741 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:25.563828 19741 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:25.563616 19609 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.565474 15911 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:25.565457 19800 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.566104 19609 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:25.564640 19741 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:25.562950 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.567844 16492 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:25.570906 15910 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:25.572067 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:25.572808 15910 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.574484 15833 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:25.541476 19699 raft_consensus.cc:3055] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:25.577025 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:25.577818 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 55816.2us
I20260709 12:25:25.578601 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:25.578996 19734 consensus_meta.cc:287] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.556s	user 0.000s	sys 0.016s
I20260709 12:25:25.579639 19779 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.579432 19734 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.579805 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.566591 19786 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.468339 19814 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.580826 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:25.581619 19713 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.581955 15912 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.583088 19814 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.575546 19425 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:25:25.585367 19425 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.585737 19425 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:25.586629 19425 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.587842 19425 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.545969 19802 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.589928 19802 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:25.566329 19818 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.592123 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.592520 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:25.584947 15988 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:25.593703 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 43726.8us
I20260709 12:25:25.594923 15831 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:25.595144 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:25.595892 15908 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.596179 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:25.530149 19776 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.599773 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.591120 19561 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:25.601186 19780 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:25.601337 16489 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:25.601696 19780 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:25.608068 15910 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:25.592397 19699 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:25.617678 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.556032 19794 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:25:25.621657 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.620406 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:25.594235 19818 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.623291 15910 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:25.624195 19826 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:25:25.624445 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.625128 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:25.602546 19780 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.606536 18866 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:25.708966 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 226362us
I20260709 12:25:25.710994 15912 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:25.708918 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.661135 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.604538 19609 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:25.663785 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 82795.3us
I20260709 12:25:25.664067 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:25.670198 19801 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:25:25.615967 19787 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.597869 19692 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.714433 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.716123 15983 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:25.719321 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:25.720204 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:25.720708 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.722152 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.708128 18866 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:25.673022 19748 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.723554 19779 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.727083 19808 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.727761 15910 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:25:25.732370 19311 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.000s
W20260709 12:25:25.735186 19829 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:25:25.616215 19221 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.740217 15905 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:25:25.743347 19799 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.565s	user 0.002s	sys 0.000s
I20260709 12:25:25.743903 19781 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:25.746122 19746 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 12:25:25.747205 19734 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:25.748433 19776 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.723820 19736 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.750521 15988 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.619656 19739 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:25:25.707728 19818 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.755108 16493 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.725540 19594 consensus_queue.cc:1059] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:25.755378 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.904657 15835 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.755893 15838 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.756250 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.905812 15837 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:25.756925 19752 consensus_meta.cc:287] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.000s
I20260709 12:25:25.709254 19786 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:25:25.759600 19732 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.762585 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2724) took 1364 ms. Trace:
I20260709 12:25:25.770586 19692 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:25.716562 19827 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:25.771585 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:25.773144 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.915961 15831 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.773882 15984 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.774665 15832 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.778827 19450 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:25.781229 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 60576.8us
I20260709 12:25:25.781931 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:25.782322 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.920674 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.783097 19434 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.867436 19629 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:25:25.789920 19807 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.538s	user 0.003s	sys 0.000s
I20260709 12:25:25.715443 19609 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.794323 19713 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:25.941576 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 170136us
I20260709 12:25:25.941521 19713 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.943907 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.795811 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 679) took 1563 ms. Trace:
I20260709 12:25:25.944775 16488 rpcz_store.cc:276] 0709 12:25:24.232634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.251761 (+ 19127us) service_pool.cc:224] Handling call
0709 12:25:24.252054 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.454087 (+1202033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.795524 (+341437us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540039ce54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:25.795739 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677938432}
W20260709 12:25:25.808194 19809 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.451s	user 0.000s	sys 0.001s
I20260709 12:25:25.819254 19822 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.821481 19699 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:25.824046 19797 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.645s	user 0.000s	sys 0.002s
W20260709 12:25:25.826841 19811 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:25:25.832149 19787 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.835703 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:25.844756 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.851004 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:25.969738 15836 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
W20260709 12:25:25.852785 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.867209 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.868935 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:25.973528 15981 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.879077 19311 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.879144 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:25.974598 15833 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:25:25.975131 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 139553us
I20260709 12:25:25.975858 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:25.849349 18866 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.895188 19746 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:25.896008 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1805) took 1733 ms. Trace:
W20260709 12:25:25.897392 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 360494us
I20260709 12:25:25.988173 15830 rpcz_store.cc:276] 0709 12:25:24.163035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.283761 (+120726us) service_pool.cc:224] Handling call
0709 12:25:24.302611 (+ 18850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.731124 (+428513us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:24.772159 (+ 41035us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.840526 (+ 68367us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.042465 (+201939us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:25.042504 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.042579 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.742781 (+700202us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:25.895662 (+152881us) raft_consensus.cc:1685] finished
0709 12:25:25.895694 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.895951 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171085,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":20447488,"thread_start_us":579775,"threads_started":2,"wal-append.queue_time_us":264593}
W20260709 12:25:25.868788 19749 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:25:25.902191 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 697) took 1294 ms. Trace:
I20260709 12:25:25.910225 15979 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:25.913081 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 321969us
I20260709 12:25:25.917666 15913 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:25.782931 19800 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.786325 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2745) took 1078 ms. Trace:
I20260709 12:25:25.923898 15879 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:25.911708 15904 rpcz_store.cc:276] 0709 12:25:24.399970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.408014 (+  8044us) service_pool.cc:224] Handling call
0709 12:25:24.483807 (+ 75793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.813777 (+329970us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:24.843458 (+ 29681us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.064319 (+220861us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.088004 (+ 23685us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.088147 (+   143us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:25.088437 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 12:25:25.241861 (+153424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.241981 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.398529 (+156548us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b1800234f40. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:25.564220 (+165691us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b1800234f40. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03d017758f 00007f03c91b6571 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd
0709 12:25:25.762397 (+198177us) raft_consensus.cc:1685] finished
0709 12:25:25.762416 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.762535 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62852,"prepare.queue_time_us":28827,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3477,"raft.queue_time_us":86714,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":13541,"spinlock_wait_cycles":24158848,"thread_start_us":612313,"threads_started":3,"wal-append.queue_time_us":622217}
I20260709 12:25:25.937458 15835 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:25.944288 19713 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:25.927798 19819 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:25:25.925071 19312 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.947846 19609 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:25.978839 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 111736us
I20260709 12:25:26.029616 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:26.032406 16488 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:26.033527 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 89700.9us
I20260709 12:25:25.978137 19802 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:25.980926 15982 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:25.934562 19450 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:25.954864 19776 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:25.955554 19425 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.917443 19752 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:25.985714 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:25.991884 15908 rpcz_store.cc:276] 0709 12:25:24.708170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.112938 (+404768us) service_pool.cc:224] Handling call
0709 12:25:25.130015 (+ 17077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.598585 (+468570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.786024 (+187439us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540010bb54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:25.786250 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071016320}
I20260709 12:25:25.989849 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:26.040247 16493 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:26.012020 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.041450 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2743) took 1334 ms. Trace:
W20260709 12:25:26.009895 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 86095.4us
I20260709 12:25:26.048538 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.016598 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:26.025195 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:26.028728 15831 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:26.047780 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:26.049623 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:26.005780 19443 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:25.993161 19754 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:26.038111 19839 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:25:26.045264 15985 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:25.990450 15911 rpcz_store.cc:276] 0709 12:25:24.607955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.660668 (+ 52713us) service_pool.cc:224] Handling call
0709 12:25:25.901028 (+1240360us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400073354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:25.902124 (+  1096us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078193536}
I20260709 12:25:26.023694 15987 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:25.993904 19699 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.050376 16490 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:26.063776 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51878.9us
W20260709 12:25:26.064661 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.036780 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:26.050668 15982 raft_consensus.cc:606] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:26.065487 15982 raft_consensus.cc:614] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:25.959853 19827 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.053628 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:26.039325 19811 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:26.056291 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 66517.2us
W20260709 12:25:26.057202 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 71554.8us
I20260709 12:25:26.038692 19748 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:26.073870 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:26.033926 19807 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:26.048200 15906 rpcz_store.cc:276] 0709 12:25:24.707514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.010108 (+302594us) service_pool.cc:224] Handling call
0709 12:25:25.010420 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.010757 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:25.010787 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.011243 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.144910 (+133667us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:25.144963 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.145116 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.807440 (+662324us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:26.038258 (+230818us) raft_consensus.cc:1685] finished
0709 12:25:26.038277 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.041384 (+  3107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4803,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":13660,"spinlock_wait_cycles":5487360,"thread_start_us":133258,"threads_started":1,"wal-append.queue_time_us":274255}
I20260709 12:25:26.015981 19717 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.015347 19434 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.044711 19752 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:26.077761 15831 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.972378 19820 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.006129 19841 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:25:26.037559 19749 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:25:26.090174 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.059209 19425 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.046897 19808 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:26.038647 19837 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:25:26.063203 19798 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:26.069917 19812 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:26.148645 19838 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:26.149241 19838 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.150262 19838 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.153108 19716 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.076957 19450 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.138361 19798 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.105065 19709 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:26.137472 19781 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:26.163308 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 89829us
I20260709 12:25:26.063357 19787 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.078572 19748 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.059316 19692 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:25:26.116941 19826 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:25:26.163586 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73510.5us
I20260709 12:25:26.090122 19443 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.170974 19746 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.105310 19836 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 12:25:26.159467 19775 consensus_meta.cc:287] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.004s
I20260709 12:25:26.154686 19812 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:26.141477 19734 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:26.177562 15802 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:26.167600 19808 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:25:26.180421 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 122972us
I20260709 12:25:26.161510 19798 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.190064 15981 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:26.109608 16490 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:26.195168 19775 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.208017 19775 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.173015 19748 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.191269 19561 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.213721 19561 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.216697 19561 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.195470 19692 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:26.217433 19692 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.218223 19692 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.219393 19692 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:26.233225 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 168954us
W20260709 12:25:26.237663 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60208.3us
W20260709 12:25:26.247207 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.247560 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.250674 15830 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
W20260709 12:25:26.250612 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 181874us
I20260709 12:25:26.194445 19611 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:25:26.252234 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.252811 15831 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.253461 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:26.246585 19311 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:26.245260 19754 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:26.264369 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.258002 19561 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:26.248208 19716 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:26.255638 19848 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:25:26.263371 19737 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:26.270407 19842 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:25:26.271176 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1338) took 1236 ms. Trace:
I20260709 12:25:26.248582 19854 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:26.283902 19819 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:26.297544 19819 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.298239 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 692) took 1259 ms. Trace:
I20260709 12:25:26.298980 19730 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:26.299367 19730 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:26.299554 19819 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:26.300437 19840 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:25:26.300251 19730 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.304457 15836 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:25:26.304733 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.305325 15838 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.305434 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.306036 15836 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.306649 15832 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:26.289335 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:26.289592 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:26.310029 15908 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.310823 15906 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:26.293828 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:26.277184 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:26.312829 15836 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
W20260709 12:25:26.296456 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.294983 15985 rpcz_store.cc:276] 0709 12:25:25.034742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.034853 (+   111us) service_pool.cc:224] Handling call
0709 12:25:25.063929 (+ 29076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.060150 (+996221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.270899 (+210749us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54000c7e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:26.271106 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256207232}
W20260709 12:25:26.315850 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.295253 15837 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:26.318126 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:26.318907 15911 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.320803 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:26.298614 15984 rpcz_store.cc:276] 0709 12:25:25.038665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.225718 (+187053us) service_pool.cc:224] Handling call
0709 12:25:25.226070 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.916689 (+690619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.298024 (+381335us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54002f62d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:26.298184 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259226496}
I20260709 12:25:26.322227 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:26.322438 15831 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:26.322777 16490 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:26.325919 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 50799us
W20260709 12:25:26.326473 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74911.4us
I20260709 12:25:26.327526 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:26.328749 15837 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.333916 16490 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
W20260709 12:25:26.381803 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 54384.9us
I20260709 12:25:26.339903 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:26.383220 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.383213 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:26.383841 15830 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:26.383823 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 48739.7us
I20260709 12:25:26.257242 19837 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:26.294355 19737 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:26.273576 19845 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:25:26.399776 15909 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:26.400373 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 106666us
W20260709 12:25:26.400597 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.296419 19844 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:25:26.289878 19853 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:26.293597 19716 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:26.296936 19846 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:25:26.295594 19843 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:25:26.406852 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:26.398599 19837 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.295147 19854 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.335608 19819 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.389367 19814 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:26.447870 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.446923 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.464047 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.464428 15836 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.464529 15837 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.406311 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.293668 19822 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.336141 19611 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.450436 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.475834 15831 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:26.389832 19794 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.293048 19561 consensus_queue.cc:1243] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:26.485788 19851 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:26.485893 19837 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.486871 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.487082 19837 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.487552 15829 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:26.487999 19814 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:26.488313 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.401754 19838 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.489210 19814 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.457828 15911 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:26.401592 19595 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:26.493472 19595 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.493798 19611 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.495767 19595 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:26.496310 19595 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:26.496644 19595 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.290405 19818 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.285494 19827 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:26.391410 19718 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:26.474445 15836 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:26.285266 19812 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.447482 19808 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:25:26.516582 15836 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:26.481230 19856 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.519863 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.481416 19737 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.482295 19850 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.483501 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.483832 19854 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.489535 19838 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.285698 19820 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:26.407014 19853 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.491104 15838 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:26.499564 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.500303 15837 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:26.525949 15829 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:26.501261 19595 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.502069 15908 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:26.527493 15836 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 11. Ops: []
W20260709 12:25:26.502518 19732 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:25:26.404592 19311 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 12:25:26.477252 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 71033.4us
I20260709 12:25:26.529120 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.477810 19787 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:26.496673 19611 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.518183 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:26.522042 15833 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.524469 15904 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:26.534933 15832 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:26.475239 19819 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.537004 15831 raft_consensus.cc:2368] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12.
I20260709 12:25:26.537163 15829 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:26.520150 19848 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:26.541461 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 137172us
W20260709 12:25:26.542402 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 77284.7us
I20260709 12:25:26.527138 19853 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.543478 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:26.549014 15876 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:26.550369 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:26.551849 15909 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:25:26.527025 19718 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:26.530040 19854 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.547215 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:26.529942 19312 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.555413 15876 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:26.553220 15909 pending_rounds.cc:85] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 7
I20260709 12:25:26.557498 15831 pending_rounds.cc:85] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 7
I20260709 12:25:26.595885 15909 pending_rounds.cc:107] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:25:26.596238 15831 pending_rounds.cc:107] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:26.596360 15909 raft_consensus.cc:2889] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:26.596511 15831 raft_consensus.cc:2889] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:26.596853 15831 pending_rounds.cc:107] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:26.514074 19754 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.544898 19737 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.546391 19595 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.555521 19311 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.545264 19848 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.617985 19848 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:26.618719 19611 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:26.619457 19611 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:26.621618 19804 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:26.544898 19732 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:26.625311 19732 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:26.626411 19741 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.631361 19841 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:26.631801 19841 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.631922 19312 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.538172 19749 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:26.632697 19841 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.633201 19749 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.633805 19841 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.634574 19749 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.636515 19749 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.545682 19820 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:25:26.637800 19736 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:26.638167 19736 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:26.599717 19609 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.003s
I20260709 12:25:26.638969 19609 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.639027 19736 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.558811 19827 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.641206 15912 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:26.597101 15831 raft_consensus.cc:2889] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:26.642491 15952 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:26.642752 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.643354 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:26.643355 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.643944 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 709) took 1264 ms. Trace:
I20260709 12:25:26.596863 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:26.601039 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45711.2us
I20260709 12:25:26.661772 15829 raft_consensus.cc:2376] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11. Re-sending same reply.
I20260709 12:25:26.668758 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:26.669546 15910 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:26.525521 19856 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.641134 19827 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:26.556186 19858 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:25:26.542971 19787 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:26.644953 19825 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:26.645524 19692 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.626655 19732 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.650136 19734 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:26.650679 15912 rpcz_store.cc:276] 0709 12:25:25.379848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.724534 (+344686us) service_pool.cc:224] Handling call
0709 12:25:25.728619 (+  4085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.641754 (+913135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.643728 (+  1974us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540010b154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:26.643892 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098349440}
I20260709 12:25:26.651762 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2754) took 1158 ms. Trace:
I20260709 12:25:26.943218 15913 rpcz_store.cc:276] 0709 12:25:25.493443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.510173 (+ 16730us) service_pool.cc:224] Handling call
0709 12:25:26.651588 (+1141415us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400073d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:26.651707 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925695744}
I20260709 12:25:26.652539 19838 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:26.654735 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:26.945178 16490 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:26.655967 19736 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.658808 19808 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:26.660229 19739 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:26.604279 19718 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.695253 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:26.904688 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:26.955817 16490 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:26.751551 19609 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:26.916502 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:26.940798 19748 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.004s
I20260709 12:25:26.620594 19611 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.907987 19749 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.909739 19819 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.939155 19825 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:26.840605 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.695966 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 171496us
I20260709 12:25:26.923975 16493 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.970021 15953 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:26.925427 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.919759 15904 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:25:26.913988 19818 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:26.925436 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:26.972478 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47146.9us
W20260709 12:25:26.918551 15830 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.003s
I20260709 12:25:26.974020 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:26.974699 15837 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:26.837723 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.940379 15829 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:26.942648 19734 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:26.949681 19798 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.701s	user 0.001s	sys 0.012s
I20260709 12:25:26.948354 19787 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:26.957237 15833 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:26.915027 19827 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:26.941604 18866 consensus_meta.cc:287] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.918s	user 0.013s	sys 0.001s
W20260709 12:25:26.701686 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.970856 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.981021 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.981346 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.981526 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.982303 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.976845 15829 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:26.977428 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.985620 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.986876 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:26.989240 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:26.994408 15981 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:26.994709 15833 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:26.982087 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:27.003616 15832 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:26.964278 19739 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.968595 19808 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:26.982451 19709 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:27.020166 15980 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:27.012115 15985 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:27.005419 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:27.022233 15988 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.980366 19865 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.987768 19837 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:27.006318 15979 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.008644 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:27.023159 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49095.9us
I20260709 12:25:27.023522 15833 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.025830 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:26.996940 19814 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.963750 19748 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:26.968783 19749 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.036820 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:27.016317 19871 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.045908 19879 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:27.011543 19854 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:26.982642 19798 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.052632 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:27.057835 15832 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:26.993269 18866 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.035332 19837 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.004917 19768 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:25:27.005558 19548 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:27.042647 19865 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.048086 19822 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:27.073449 15833 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:27.074826 19837 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.060156 19871 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:27.093520 15906 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:27.076826 19411 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:27.122249 19411 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:27.097999 19808 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.034878 19825 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.124261 19825 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.094252 19798 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:27.097189 19739 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.058601 19820 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:27.050868 19856 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:27.059731 19311 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:27.125785 19820 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:27.126005 19311 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.126780 19820 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.056386 19866 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:27.099392 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:27.132336 15980 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:27.103863 15982 raft_consensus.cc:2410] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:25:27.096575 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 87784.7us
I20260709 12:25:27.052109 19814 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.066496 19854 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.123234 19411 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.094758 15834 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.096783 19852 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:25:27.067322 15988 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:27.098577 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:27.140345 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.101338 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:27.078665 19779 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:27.132279 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:27.136315 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.141490 15979 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:27.141731 15836 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
W20260709 12:25:27.130180 19874 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:25:27.130368 19875 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:25:27.141129 15833 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:27.061959 19734 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.151846 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:27.142581 19841 consensus_meta.cc:287] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.004s
I20260709 12:25:27.110731 19876 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.131086 19865 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:27.097741 18866 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:27.151563 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 99034.9us
I20260709 12:25:27.173178 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:27.109623 19822 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:27.158943 19709 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:27.140218 19716 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.006s
I20260709 12:25:27.162081 16492 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:27.162806 15836 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:27.074664 19861 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:25:27.163074 15834 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:27.163462 19852 consensus_queue.cc:1243] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:27.128981 19871 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.164906 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:27.166776 19749 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:27.211190 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.148216 19699 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:27.191490 19798 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:27.191335 15836 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:27.148871 19779 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:27.193264 15911 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:27.140040 19853 consensus_meta.cc:287] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:25:27.155376 19311 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:27.202203 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 164257us
W20260709 12:25:27.203497 19741 consensus_meta.cc:287] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 12:25:27.252959 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.205571 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.205868 19883 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:27.193661 19822 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.165721 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:27.137694 19866 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.213665 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:27.177628 19876 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.200590 19734 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.212003 19611 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:25:27.224880 19748 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:27.226300 19854 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:27.227734 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:27.132788 19746 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:27.199293 19716 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.247684 15836 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.247232 19800 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:27.269707 15987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1339) took 2221 ms (client timeout 2288 ms). Trace:
I20260709 12:25:27.245671 19798 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.245391 19648 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.263177 15837 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:27.447104 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:27.447834 15837 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.250651 19749 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:27.256539 19883 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:27.404943 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:27.411188 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.412042 16457 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:27.412261 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.457374 15838 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:27.407204 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.469712 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.470310 15950 leader_election.cc:336] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.184s (SENT)
W20260709 12:25:27.417297 15987 rpcz_store.cc:269] 0709 12:25:25.035034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.035142 (+   108us) service_pool.cc:224] Handling call
0709 12:25:27.256140 (+2220998us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54001874d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:27.256276 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197396224}
W20260709 12:25:27.420804 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 149220us
W20260709 12:25:27.433983 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.476344 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.486757 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74828.4us
I20260709 12:25:27.250521 19699 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.489012 16492 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:27.445866 19741 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:27.577502 16460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.040s	sys 0.076s
I20260709 12:25:27.498553 16493 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:27.577850 16460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.040s	sys 0.076s
W20260709 12:25:27.578130 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 543209us
I20260709 12:25:27.288892 19504 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.231s
I20260709 12:25:27.459997 19854 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.520545 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.489151 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:27.485349 19841 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.470734 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:27.523762 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:27.449805 18866 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.446133 19648 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:27.258442 19853 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.555546 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:27.521659 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:27.525887 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:27.420338 19870 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:25:27.450362 19798 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.577154 19741 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:27.498342 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.585412 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:27.586015 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.286826 19839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.018s	sys 0.018s
I20260709 12:25:27.502442 19749 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.586814 15837 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:27.561735 19709 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.719381 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.720580 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:27.718356 19839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.581s	user 0.023s	sys 0.029s
I20260709 12:25:27.452523 19800 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:27.722011 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.730180 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.730649 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.731120 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.733367 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.608739 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:27.737103 15830 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:27.704792 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 181337us
W20260709 12:25:27.723378 15980 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.000s
I20260709 12:25:27.519381 19877 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.240s
I20260709 12:25:27.724614 15913 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.725940 15988 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:27.663013 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:27.740052 15980 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:27.533664 19312 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:27.694443 19880 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:27.752961 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:27.753780 15980 raft_consensus.cc:606] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:27.754241 15980 raft_consensus.cc:614] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:27.461114 19779 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.588789 19629 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:27.759441 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:27.749846 15831 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:27.751565 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.592234 19737 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:27.758080 15984 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:27.757515 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 287225us
I20260709 12:25:27.763998 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:27.764104 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.764607 15829 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:27.765635 15950 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.527s (SENT)
W20260709 12:25:27.766279 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.779538 15913 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:27.748678 15987 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
W20260709 12:25:27.786471 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.824582 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:27.782935 15987 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:27.829494 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:27.835968 15831 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:27.841470 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:27.843943 15980 raft_consensus.cc:2368] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:25:27.745920 19854 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:27.859896 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73927.4us
I20260709 12:25:27.828271 19513 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:27.785989 19312 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.768349 19839 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.735440 19841 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.845618 19748 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:27.844525 19870 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:27.824349 19877 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:27.911065 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:27.735325 18866 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.839342 15830 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:27.830283 19818 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:27.916798 15984 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
W20260709 12:25:27.921676 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.921270 15983 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
W20260709 12:25:27.825888 19827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.005s	sys 0.010s
I20260709 12:25:27.953572 15831 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:27.788933 19737 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:27.969053 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 229123us
W20260709 12:25:27.924129 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 200355us
W20260709 12:25:27.987448 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 148468us
W20260709 12:25:27.920253 19889 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 12:25:27.998056 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:27.974663 19880 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:27.953224 19902 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:27.986730 19827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.006s	sys 0.011s
I20260709 12:25:27.837426 19648 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.010303 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.009872 15837 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:28.017647 19897 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:25:27.993618 19504 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.020655 19504 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.028293 19825 consensus_meta.cc:287] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.904s	user 0.008s	sys 0.001s
I20260709 12:25:28.028779 19737 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:27.724087 19883 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.032701 19741 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.033329 19709 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:27.990938 19818 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.035136 19866 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.036419 19818 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.037331 19841 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.038578 19749 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:27.989274 19877 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.041932 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 715) took 1492 ms. Trace:
I20260709 12:25:28.042438 15908 rpcz_store.cc:276] 0709 12:25:26.549406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.549540 (+   134us) service_pool.cc:224] Handling call
0709 12:25:26.594674 (+ 45134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:26.595052 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:26.981198 (+386146us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.552346 (+571148us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b18003b0da0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe4323a
0709 12:25:27.552566 (+   220us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.553153 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.553324 (+   171us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:27.553562 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.784437 (+230875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.784546 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.041673 (+257127us) raft_consensus.cc:1685] finished
0709 12:25:28.041702 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.041862 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3185,"prepare.queue_time_us":470662,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":5386,"raft.queue_time_us":210847,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":22877,"spinlock_wait_cycles":7631744,"thread_start_us":620502,"threads_started":3,"wal-append.queue_time_us":119348}
I20260709 12:25:28.045332 19904 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:28.047686 19854 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.051117 19905 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.051771 19905 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:27.971660 19748 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.054742 19905 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:27.997080 19896 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.056049 19896 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:27.921586 19312 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.059151 19312 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:27.970974 19839 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.062808 19839 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:28.062975 19871 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.004s
I20260709 12:25:28.063445 19902 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.063568 19871 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:28.065755 19891 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 12:25:28.066545 15907 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:28.068233 19800 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.073987 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.009418 19906 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.074888 19906 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.075453 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.076443 15830 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:28.077742 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.078429 15830 raft_consensus.cc:2410] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:28.084992 15830 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:28.056901 19748 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.105561 19548 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.109920 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:28.110519 19798 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.049958 19853 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.202759 15829 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:28.309753 15979 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:28.250154 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 260304us
W20260709 12:25:28.216068 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 227875us
W20260709 12:25:28.198419 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.223278 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 251853us
I20260709 12:25:28.271988 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.316128 19921 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.315023 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:28.318531 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.118906 19822 consensus_meta.cc:287] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.007s
I20260709 12:25:28.233363 15723 maintenance_manager.cc:419] P 7d3391ee630646ccabf92830e1028bc1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033342
W20260709 12:25:28.359965 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 46096.5us
W20260709 12:25:28.269426 19837 consensus_meta.cc:287] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.137s	user 0.009s	sys 0.003s
I20260709 12:25:28.324549 15913 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:28.324159 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.118531 19877 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.254102 19906 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.313196 19311 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.332118 19864 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:28.269621 19736 consensus_meta.cc:287] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.312s	user 0.013s	sys 0.000s
I20260709 12:25:28.361696 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.398594 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.319532 19548 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.322472 19768 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:28.371780 19919 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:28.379096 15986 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 699) took 3160 ms (client timeout 1767 ms). Trace:
I20260709 12:25:28.383251 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:28.411829 19548 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.408623 19906 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:25:28.412051 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.412693 15980 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:28.411850 19915 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:28.413627 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.413754 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:28.414322 15980 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:28.414909 19902 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.370755 19896 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.393213 19837 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.395787 15830 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:28.417764 15835 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.418426 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:28.397753 15803 leader_election.cc:400] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:25:28.398813 15908 raft_consensus.cc:2410] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:25:28.317066 19921 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.335434 19924 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:28.419988 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.406841 15905 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:28.406569 19839 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.388120 15836 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.329282 19822 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.416157 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.414870 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.410145 19877 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:28.415783 15986 rpcz_store.cc:269] 0709 12:25:25.218330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.421695 (+203365us) service_pool.cc:224] Handling call
0709 12:25:28.378867 (+2957172us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54001b8354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:28.378996 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262408576}
I20260709 12:25:28.425662 15988 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:28.414997 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.396174 15979 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:28.418883 15803 leader_election.cc:403] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:28.420352 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:28.423744 15830 raft_consensus.cc:2410] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:28.424307 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.427033 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.427870 15879 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:28.427985 15979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:28.428988 15985 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:28.429829 15979 raft_consensus.cc:606] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:28.417138 19915 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.424530 19924 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:28.430455 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 69355.7us
I20260709 12:25:28.432214 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.434150 19736 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:28.436554 19862 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:28.430330 19730 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.437610 19903 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.454289 15912 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.419391 19864 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.442636 19871 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.411621 19922 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:25:28.446295 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.450168 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.543097 15988 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:28.424194 19852 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:28.546314 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.439823 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1882) took 1450 ms. Trace:
W20260709 12:25:28.470705 15950 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.605s (SENT)
I20260709 12:25:28.502297 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.404734 19311 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.541956 15879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 1.812s (SENT) [suppressed 16 similar messages]
I20260709 12:25:28.541739 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.547710 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.443831 19787 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.545456 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.548218 15980 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:28.547290 15982 rpcz_store.cc:276] 0709 12:25:26.988906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.989012 (+   106us) service_pool.cc:224] Handling call
0709 12:25:28.439646 (+1450634us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003156d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:28.439768 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261438336}
I20260709 12:25:28.549712 15982 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:28.444571 19906 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.551235 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.449584 19736 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.554798 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:28.555595 15833 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:28.449662 19862 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:28.558298 15837 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:28.559566 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:28.449764 19924 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.553690 19906 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:28.547464 19732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.468s	user 0.044s	sys 0.070s
W20260709 12:25:28.567677 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 97026.4us
I20260709 12:25:28.564378 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.571990 15836 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:28.565330 19906 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:28.577323 15836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2859) took 1421 ms (client timeout 1841 ms). Trace:
W20260709 12:25:28.577859 15836 rpcz_store.cc:269] 0709 12:25:27.151295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.151575 (+   280us) service_pool.cc:224] Handling call
0709 12:25:28.387525 (+1235950us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b58009707d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc1ff0aa 00007f03cc281447 00007f03cc299fe7 00007f03cc29b7de 00007f03cc2a727c 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c
0709 12:25:28.572407 (+184882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38319488}
I20260709 12:25:28.429353 19839 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.583364 15835 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:28.449921 19718 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:25:28.584764 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.585901 15833 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:28.552500 19609 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:28.576711 19732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.502s	user 0.044s	sys 0.070s
I20260709 12:25:28.557668 19736 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.552441 19312 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:28.557976 19852 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:28.418322 19919 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.552371 19836 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:28.586828 19734 consensus_meta.cc:287] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.299s	user 0.012s	sys 0.000s
I20260709 12:25:28.573483 19794 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:28.592708 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 164621us
I20260709 12:25:28.596575 15908 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:28.577214 19595 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.554224 19787 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.590400 19871 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:28.612386 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.614473 15909 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:28.611255 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 165874us
I20260709 12:25:28.616788 16490 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:28.616717 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.617262 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.618351 15908 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:28.619445 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.604851 19921 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.620224 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.625469 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.596482 19609 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.611845 19903 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.627938 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.634347 15836 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:28.635528 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.630579 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.454631 19915 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.640144 16495 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:28.628752 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.626080 16489 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:25:28.626186 15950 leader_election.cc:336] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.792s (SENT)
I20260709 12:25:28.644241 15830 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:25:28.644591 15950 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.904s (SENT)
I20260709 12:25:28.644747 19838 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:28.645123 19838 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:28.645792 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.646173 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.645887 19838 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:28.646482 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.646857 19838 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.629809 15837 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:28.651563 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.651418 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.643035 15908 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:28.653942 15837 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:28.607847 19312 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.610958 19836 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.655609 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.663381 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.547712 19864 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.658072 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.666922 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:28.669423 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:28.669952 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.621197 19871 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.680817 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.613591 19794 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.687950 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.662127 19732 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:28.664863 19826 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:28.691556 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:28.692732 19826 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.694492 19826 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.695379 19609 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.622941 19862 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.697589 19862 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.698314 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1890) took 1600 ms. Trace:
I20260709 12:25:28.698675 15985 rpcz_store.cc:276] 0709 12:25:27.098360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.098650 (+   290us) service_pool.cc:224] Handling call
0709 12:25:27.098966 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.429826 (+1330860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.698053 (+268227us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400139554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:28.698259 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3058260352}
I20260709 12:25:28.699819 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.700356 15985 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:28.701090 19914 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:28.702142 19915 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.701848 19914 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.702359 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.702932 15982 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:28.703725 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:28.704226 19779 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.704406 15982 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:28.705672 19928 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:25:28.706279 19864 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.708148 19312 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.708426 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:28.693379 19919 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.709579 19595 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:28.710423 19699 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.652012 19903 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.703794 19836 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.712651 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:28.734283 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.734359 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.734579 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.735163 16495 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:28.735648 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:28.736115 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.735970 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.737058 16494 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:28.737439 15980 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:28.737892 15980 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:28.738801 15980 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.739634 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.684444 19822 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.741358 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.684157 19837 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.672864 19929 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:25:28.675738 19734 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:25:28.747463 19937 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:28.658850 19852 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.752102 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 75722us
I20260709 12:25:28.754168 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.711475 19932 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:28.744561 19944 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.745306 19836 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:28.757965 16492 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:28.728749 19595 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.729750 19919 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.761791 15985 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:28.757218 19932 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.762699 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.704507 19914 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.763294 15985 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:28.767001 19311 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.767215 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.767933 15985 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:28.766108 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.777730 19871 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.763054 19595 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.780323 19595 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.783466 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.784104 15904 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.786499 15985 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:25:28.787084 15985 pending_rounds.cc:85] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 6
I20260709 12:25:28.787313 15985 pending_rounds.cc:107] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:28.787637 15985 raft_consensus.cc:2889] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.790930 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.794463 19903 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.794939 19932 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.794939 19594 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.767951 19937 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.768229 19794 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.795735 19594 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.808725 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2765) took 2141 ms. Trace:
W20260709 12:25:28.809260 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2766) took 2141 ms (client timeout 1591 ms). Trace:
W20260709 12:25:28.809808 15905 rpcz_store.cc:269] 0709 12:25:26.667919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.694929 (+ 27010us) service_pool.cc:224] Handling call
0709 12:25:28.809062 (+2114133us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540010c054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:28.809178 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3336727424}
I20260709 12:25:28.761483 19836 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.813542 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.809262 15911 rpcz_store.cc:276] 0709 12:25:26.667615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.667824 (+   209us) service_pool.cc:224] Handling call
0709 12:25:26.668046 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.248591 (+580545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.808412 (+1559821us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54001c3754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:28.808648 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207526144}
I20260709 12:25:28.796626 19734 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.790282 19787 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.817049 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.823328 19736 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.766052 19919 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:28.831967 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 147694us
I20260709 12:25:28.831967 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.829694 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.836351 19629 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:28.836813 19629 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.837873 19311 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:28.838246 19311 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:28.840716 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.841281 15911 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:28.841879 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.842435 15911 raft_consensus.cc:2410] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:28.839183 19311 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.843076 19946 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.845021 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.845573 15911 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:28.846160 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.846912 15905 raft_consensus.cc:2368] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
I20260709 12:25:28.848189 19311 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.849138 19836 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.853122 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.853802 15911 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:28.854628 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.855516 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.856156 15911 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:28.859591 15832 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:28.856853 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.863821 15911 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:28.882134 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.883391 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.884373 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.885192 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2764) took 2218 ms. Trace:
I20260709 12:25:28.864303 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.869236 19924 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.870446 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:28.870695 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.871475 15837 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:28.891513 16494 raft_consensus.cc:2410] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:28.873672 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.889132 15909 rpcz_store.cc:276] 0709 12:25:26.667290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.667413 (+   123us) service_pool.cc:224] Handling call
0709 12:25:26.667663 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.616480 (+1948817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.884953 (+268473us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400217854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:28.885132 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4476882304}
I20260709 12:25:28.892459 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.893816 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.894755 15909 raft_consensus.cc:2410] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:28.873920 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:28.895314 15830 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.874506 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.875221 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.874958 19826 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.875989 19876 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.876451 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.902930 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:28.903604 16490 raft_consensus.cc:2410] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:28.876893 19836 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:28.877388 16487 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:28.877704 19919 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.879616 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:28.907860 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.872797 15836 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:28.910542 15830 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:28.910748 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.911945 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.884452 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.898723 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.899004 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:28.885376 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.914952 15911 raft_consensus.cc:2368] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
W20260709 12:25:28.915223 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 85648.4us
I20260709 12:25:28.915928 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.912863 15836 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:28.899916 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.901196 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.901499 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.903620 15835 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.919750 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.920337 15830 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:28.905369 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.880535 19629 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.921022 15833 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:28.923422 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.890729 19944 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.918916 16496 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:28.931038 15904 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:28.888140 19827 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:28.935559 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.936719 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.938282 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:28.938675 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.939463 15904 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:28.940138 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:28.941224 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:28.941985 15911 raft_consensus.cc:2410] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:28.942312 15909 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:25:28.943533 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.914781 19934 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.914535 19709 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.951581 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.925370 19937 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.946952 15802 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.956553 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.920557 19766 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:28.949536 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49684.7us
I20260709 12:25:28.949700 15835 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:28.886595 19906 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.925441 19946 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.956823 19934 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:28.973312 19946 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.952728 19595 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.953426 19779 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:28.953608 19794 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.974663 19906 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:28.975124 19934 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.974665 19779 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.975494 19924 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.975769 19779 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.977728 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 2846) took 2492 ms. Trace:
I20260709 12:25:28.978008 19766 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:28.978089 15838 rpcz_store.cc:276] 0709 12:25:26.500223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.525074 (+ 24851us) service_pool.cc:224] Handling call
0709 12:25:26.525345 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.457885 (+932540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.977507 (+1519622us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400250654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:28.977670 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143089024}
I20260709 12:25:28.979142 19766 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.979837 15908 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:25:28.979938 19629 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:28.980273 15908 pending_rounds.cc:85] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:25:28.980525 15908 pending_rounds.cc:107] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:25:28.980741 15908 raft_consensus.cc:2889] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.981666 15909 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:28.981719 19946 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:28.955237 15837 raft_consensus.cc:2410] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:28.932197 19513 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.983179 19629 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.960170 15911 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:28.920756 19836 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:28.931980 19865 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:28.950131 19876 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.950984 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:28.936707 19311 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.953512 19919 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.987669 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.971163 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.959576 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:28.997779 19311 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.998322 16496 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
W20260709 12:25:28.999169 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 48280.9us
I20260709 12:25:28.998369 15836 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:28.999542 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.959097 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.946321 19947 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:29.004106 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.004690 16495 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:29.004954 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:28.969818 19826 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.011607 19903 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:29.012924 19903 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:29.013392 19903 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:29.013928 18866 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.014415 19903 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.015890 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.016213 19903 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.016486 15985 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
W20260709 12:25:28.959390 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.018705 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.020514 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:29.021251 15836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42230
I20260709 12:25:29.021871 15836 raft_consensus.cc:606] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 12:25:29.022289 15836 raft_consensus.cc:614] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:29.023159 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.023742 15830 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:29.024885 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:29.026227 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:28.960623 19932 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:29.028014 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.029822 15838 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:29.030215 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.031250 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.030840 15985 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:29.034222 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.035408 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:29.037250 15833 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:29.038384 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.034929 19609 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.045207 15833 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.035179 15837 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:29.002686 19736 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.046466 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.048435 15838 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:28.951435 19827 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.049723 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:28.993270 19914 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:25:29.033236 19919 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:29.030298 19947 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:29.054771 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.055485 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.001802 19865 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.042995 19932 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:29.048034 19609 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.034909 19699 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:25:29.053679 19311 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.086575 19732 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:29.053491 19819 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.091907 19609 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.053426 19826 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:29.053622 19730 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:25:29.113063 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2771) took 2068 ms. Trace:
I20260709 12:25:29.110282 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2761) took 2788 ms. Trace:
I20260709 12:25:29.096329 19595 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.112022 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:29.114647 15906 rpcz_store.cc:276] 0709 12:25:26.322034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.322570 (+   536us) service_pool.cc:224] Handling call
0709 12:25:26.390369 (+ 67799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:27.115328 (+724959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.110033 (+1994705us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400072e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:29.110225 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604406528}
I20260709 12:25:29.114342 15912 rpcz_store.cc:276] 0709 12:25:27.044526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.044678 (+   152us) service_pool.cc:224] Handling call
0709 12:25:27.045061 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.454837 (+1409776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.111735 (+656898us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400340654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:29.112967 (+  1232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3240368512}
I20260709 12:25:29.096714 19924 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:25:29.118772 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.126698 19947 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.118408 19595 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.129869 19595 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.130224 19827 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.123297 19932 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.133317 19865 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.133458 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.111635 19732 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:25:29.137395 19836 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.130306 15987 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:29.147558 15980 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.148968 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.149250 19914 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:29.153537 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:29.163509 15986 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:29.122152 19919 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:29.166602 15876 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.163221 19827 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:29.195459 15980 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:29.198194 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:29.199292 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:29.222944 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:29.241122 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.221005 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.165815 19914 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:29.272408 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.273013 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:29.275207 15833 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:29.276067 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.276599 15833 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:29.168530 19826 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.275207 15837 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.274133 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.281422 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.283318 15904 raft_consensus.cc:2410] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:29.283363 15906 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
W20260709 12:25:29.282042 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 59185.9us
I20260709 12:25:29.284870 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.286381 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.288030 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:29.288756 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:29.273581 19752 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 12:25:29.277391 19956 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:25:29.290892 19786 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:29.287290 19836 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:29.282719 19826 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:29.297456 19919 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.298712 15837 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:29.301187 19921 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.304255 19609 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.288417 19906 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.306723 19594 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:29.308557 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 1824) took 3555 ms (client timeout 2040 ms). Trace:
W20260709 12:25:29.326937 15834 rpcz_store.cc:269] 0709 12:25:25.753427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.753547 (+   120us) service_pool.cc:224] Handling call
0709 12:25:29.308343 (+3554796us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400081e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:29.308453 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686922496}
W20260709 12:25:29.309568 15832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2865) took 1753 ms (client timeout 1656 ms). Trace:
W20260709 12:25:29.328279 15832 rpcz_store.cc:269] 0709 12:25:27.556017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.592751 (+ 36734us) service_pool.cc:224] Handling call
0709 12:25:29.309375 (+1716624us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540033ccd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:29.309498 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497709824}
I20260709 12:25:29.286688 19961 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.277822 19947 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:29.318120 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.316066 19826 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.313725 15908 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:29.313155 19883 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.329814 19906 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:29.343489 19609 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.333427 18866 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.328907 19836 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:29.361538 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73614.4us
I20260709 12:25:29.363677 15802 leader_election.cc:400] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:25:29.364789 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.349494 19906 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.346504 19914 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.373303 19836 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:29.373871 15913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2772) took 2144 ms (client timeout 2532 ms). Trace:
W20260709 12:25:29.408021 15913 rpcz_store.cc:269] 0709 12:25:27.229865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.824278 (+594413us) service_pool.cc:224] Handling call
0709 12:25:29.373595 (+1549317us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b5400299d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:29.373800 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147499904}
I20260709 12:25:29.409162 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:29.409909 19839 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.376536 19779 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.412515 19779 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:29.384243 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.389477 19814 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.390205 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.390439 19504 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.392184 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.392041 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.392988 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:29.353013 19855 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:25:29.337641 19947 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.417256 15910 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:29.417532 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.420027 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.423600 15912 raft_consensus.cc:2410] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:29.416712 15905 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:29.444285 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:29.449307 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.462275 16495 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:29.449236 19839 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:29.449546 19561 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:29.452122 19713 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:29.455924 19504 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:29.459633 19961 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.462937 19861 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.474627 19713 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:29.478361 19713 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.470736 19839 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.483872 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:29.484687 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.485286 19839 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.467362 19561 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.486794 15911 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:29.487324 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.487586 16457 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.487941 15832 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:29.488828 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.488986 16457 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:29.489938 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.501722 19947 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.490800 19561 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.515730 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.516338 16489 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:29.517313 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:29.518327 19513 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.518689 19513 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:29.519022 19513 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.519598 18866 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.472008 19902 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:25:29.520515 15832 raft_consensus.cc:2410] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:29.472970 19504 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:29.524456 19504 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.490836 19883 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:29.496758 19903 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.535056 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42230 (request call id 1) took 1202 ms. Trace:
W20260709 12:25:29.535535 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 131215us
I20260709 12:25:29.535532 15829 rpcz_store.cc:276] 0709 12:25:28.334695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.339031 (+  4336us) service_pool.cc:224] Handling call
0709 12:25:29.528031 (+1189000us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400082854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a9735 00007f03cc2a19fa 00007f03d12694c9 00007f03ca7e5c54 00007f03ca7e5be2 00007f03ca7e5b11 00007f03ca7e5a8c 00007f03ca7e4d42 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:29.531265 (+  3234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535783296}
I20260709 12:25:29.486405 19861 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.534749 19903 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.573069 19947 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:25:29.540304 19826 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.579680 19903 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.614823 15913 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:29.661818 19974 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:29.670444 15835 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.672199 15835 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:29.673756 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 134148us
I20260709 12:25:29.675937 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.677060 15980 raft_consensus.cc:2410] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:29.688863 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.689579 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:29.698316 16493 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:29.690186 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.683911 19865 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:25:29.706686 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.710170 15987 raft_consensus.cc:2410] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:29.713340 15986 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.717273 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:29.680610 19900 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:25:29.721990 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:29.722790 15987 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:29.715543 19766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.016s	sys 0.008s
W20260709 12:25:29.724509 19766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.016s	sys 0.008s
I20260709 12:25:29.688021 19906 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.738144 15986 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:29.740051 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:29.740060 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:29.767701 15987 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:25:29.771308 19981 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:29.774749 15908 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.775252 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.776295 15986 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:29.780689 19932 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.781329 19826 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.782655 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.786976 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:29.787873 19979 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:25:29.789628 19983 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:25:29.794780 19972 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:25:29.797637 19982 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:25:29.799198 19984 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:29.800742 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 613) took 1182 ms. Trace:
I20260709 12:25:29.801152 16486 rpcz_store.cc:276] 0709 12:25:28.618754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.618966 (+   212us) service_pool.cc:224] Handling call
0709 12:25:28.626649 (+  7683us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:28.631063 (+  4414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.631112 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:29.521825 (+890713us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b2c0009bf18. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:25:29.522393 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 12:25:29.687480 (+165087us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:29.687517 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.687576 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.800426 (+112850us) raft_consensus.cc:1685] finished
0709 12:25:29.800450 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.800676 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2738,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6870,"spinlock_wait_cycles":3627008,"thread_start_us":162581,"threads_started":1,"wal-append.queue_time_us":140893}
I20260709 12:25:29.802678 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 701) took 1186 ms. Trace:
I20260709 12:25:29.803071 16492 rpcz_store.cc:276] 0709 12:25:28.615930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.616489 (+   559us) service_pool.cc:224] Handling call
0709 12:25:29.802482 (+1185993us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54007044d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:29.802622 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313110784}
I20260709 12:25:29.803872 19561 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.805652 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:29.806428 15986 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.806915 15953 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:29.826479 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 139578us
I20260709 12:25:29.822573 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.827781 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:29.828320 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.810678 19839 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.829540 15986 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:29.835655 15987 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:29.836273 15986 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.821815 19851 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.838788 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2769) took 2926 ms. Trace:
I20260709 12:25:29.840950 15907 rpcz_store.cc:276] 0709 12:25:26.912774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.912919 (+   145us) service_pool.cc:224] Handling call
0709 12:25:26.913279 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.067067 (+1153788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.838542 (+1771475us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001c4154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:29.838728 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651537152}
I20260709 12:25:29.850653 15953 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.850885 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.841395 19648 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.851926 16488 raft_consensus.cc:2410] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:29.851126 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.852593 16490 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:29.843942 19851 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.857347 19836 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.882033 19561 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.885911 19836 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.870999 19513 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.889853 19513 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.890543 15980 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:29.891597 15982 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:29.891959 15982 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:29.892273 19504 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:29.892881 19504 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.894826 15836 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:29.895831 19504 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:29.896299 19994 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:29.897346 19994 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.897676 19994 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:29.898694 19994 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.900175 19994 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.909075 19826 consensus_queue.cc:1059] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:29.909999 19826 raft_consensus.cc:3055] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:29.910360 19826 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:29.911208 19826 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.911692 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:29.912426 15836 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:29.912443 19826 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:29.911785 19851 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:29.917493 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:29.918658 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.920231 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:29.922636 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:29.926476 15952 connection.cc:256] RPC call timeout handler was delayed by -1.8249812280000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 12:25:29.926975 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.940662 15803 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:29.941962 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.941987 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:29.943154 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.944257 15836 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:29.892643 15982 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.946201 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.947496 19919 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:29.947887 19781 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.948563 19781 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:29.949014 19781 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:29.949798 19781 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:29.948602 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.951018 19781 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.951561 19594 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.952903 19594 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:29.956058 15879 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:29.958261 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.962541 16487 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:29.963541 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:29.964906 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:29.965677 15986 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.965867 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:29.967447 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.969719 15829 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:29.969992 15982 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.973980 19594 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:29.974715 19594 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.974555 19311 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:29.974931 19734 raft_consensus.cc:2764] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:29.975320 19594 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.975845 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:29.976224 19311 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:29.977626 19311 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.978015 19311 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:29.978967 19311 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:29.980403 19311 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.981137 19504 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.981884 19994 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:29.968891 19709 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:29.932224 19906 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:30.009351 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74638.4us
I20260709 12:25:30.005501 15909 raft_consensus.cc:2410] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:25:30.001302 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.957662 19921 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:29.939070 19894 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:30.005932 19851 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.937283 19884 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:30.022881 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.024537 15986 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:29.962082 19900 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:30.030957 16460 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:29.982883 19947 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:30.036139 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.036448 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:30.007203 19946 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.010476 19915 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.983480 19922 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.959316 19914 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 12:25:30.076383 19837 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:25:30.078367 19838 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:30.081200 15987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:30.090448 15987 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:30.090775 15987 raft_consensus.cc:614] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:30.090724 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.010035 19709 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:30.081856 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45855.5us
I20260709 12:25:30.040062 15988 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:30.095746 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:30.096679 19798 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:30.038479 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.015156 19921 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:30.039762 15984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1892) took 2940 ms (client timeout 1812 ms). Trace:
I20260709 12:25:30.099414 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:30.104410 15984 rpcz_store.cc:269] 0709 12:25:27.098992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.404664 (+305672us) service_pool.cc:224] Handling call
0709 12:25:30.039544 (+2634880us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54003147d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:30.039683 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701824256}
I20260709 12:25:30.059409 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1905) took 1690 ms. Trace:
I20260709 12:25:30.028990 19894 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:30.082782 19947 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.112437 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:30.091467 16492 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:30.038069 19900 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:30.081270 19946 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:30.105931 15982 rpcz_store.cc:276] 0709 12:25:28.369229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.709346 (+340117us) service_pool.cc:224] Handling call
0709 12:25:28.709624 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.891504 (+1181880us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54000ea4a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc21adc0 00007f03cc2a51c0 00007f03cc2a6231 00007f03cc2a2d8f 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c
0709 12:25:30.057277 (+165773us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:30.057321 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.057376 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:30.057426 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.059187 (+  1761us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.059340 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20937,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":86,"spinlock_wait_cycles":84467968}
I20260709 12:25:30.086014 19716 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:30.108534 16490 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:30.037532 19906 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:25:30.087430 19961 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.004485 19594 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.133415 19594 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:30.133666 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:30.134307 15982 raft_consensus.cc:606] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:30.134647 15982 raft_consensus.cc:614] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:30.035847 19877 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 12:25:30.134816 15983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1894) took 2727 ms (client timeout 1590 ms). Trace:
I20260709 12:25:30.107822 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.081127 19787 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:25:30.093333 19709 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.039129 19884 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.138504 19884 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:30.106969 19921 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:30.141446 19989 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.371s	user 0.000s	sys 0.003s
I20260709 12:25:30.153530 19718 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:30.135244 15983 rpcz_store.cc:269] 0709 12:25:27.407074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.451191 (+ 44117us) service_pool.cc:224] Handling call
0709 12:25:30.134658 (+2683467us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400093dd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:30.134750 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449748352}
W20260709 12:25:30.158674 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 50954.3us
I20260709 12:25:30.154249 19718 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.161643 19787 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:30.163060 19718 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:30.109862 19993 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.113153 19894 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.113373 19944 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:30.167466 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.118381 19900 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.159569 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:30.178732 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 146396us
I20260709 12:25:30.115376 19947 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.091123 19915 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.199834 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:30.093757 19838 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.181581 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:30.148682 19561 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:30.204296 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:30.184374 19921 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.036006 19851 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.114861 19861 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:30.191241 15982 pending_rounds.cc:85] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 6
I20260709 12:25:30.200460 15979 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.201731 19504 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:30.176280 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.205202 15983 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:30.238673 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:30.239208 20005 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:30.239290 15983 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.187434 19922 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.239917 20005 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.241655 15982 pending_rounds.cc:107] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:30.200222 19787 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:30.213826 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 182935us
I20260709 12:25:30.245263 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:30.213537 19903 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.001s
I20260709 12:25:30.250167 15982 raft_consensus.cc:2889] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.278175 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.272181 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:30.209882 19884 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:30.272873 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.241415 19944 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:30.202204 19716 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:30.276748 15979 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:30.273238 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:30.289373 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 177663us
I20260709 12:25:30.290970 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:30.294756 15979 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
W20260709 12:25:30.295176 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.295642 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:30.295845 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.296471 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.217067 19902 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:25:30.300681 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:30.302647 15832 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:30.302772 15983 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:30.278347 19800 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:30.303562 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:30.306118 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.279608 19513 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:30.282713 19787 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:30.290730 19766 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:30.310011 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:30.289984 19961 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:30.217576 19946 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.305160 19594 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:30.286530 19718 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:30.314139 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:30.314611 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.310986 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:30.318159 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:30.306775 19800 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.308967 19884 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:30.332712 19800 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.332820 19884 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:30.334414 19884 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.335971 19884 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.342051 19800 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.345342 19838 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:30.346211 19787 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.316601 19865 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.287174 20006 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:25:30.349421 19944 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.349460 19865 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.282590 19903 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.354286 20005 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:30.354986 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:30.355721 15829 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:30.312708 19906 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.310696 19902 consensus_queue.cc:1243] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:25:30.360546 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:30.366331 15836 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:30.382452 19921 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:30.384114 19915 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:30.385222 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:30.386814 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:30.387573 15836 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.389473 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:30.391546 15832 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:30.393350 15831 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:30.400414 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 94375.2us
W20260709 12:25:30.405759 15718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9fd62f0fa06a4561a0a7101b85942f86 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:30.407681 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 901) took 1275 ms. Trace:
I20260709 12:25:30.408218 16495 rpcz_store.cc:276] 0709 12:25:29.132678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.133219 (+   541us) service_pool.cc:224] Handling call
0709 12:25:30.407458 (+1274239us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400522954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:30.407603 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754785152}
I20260709 12:25:30.409752 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:30.412957 19802 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:30.413524 19802 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:30.414772 19802 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.416528 19802 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.418020 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:30.418867 19311 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.419715 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 721) took 2126 ms. Trace:
I20260709 12:25:30.420584 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:30.424108 15904 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:30.420238 15988 rpcz_store.cc:276] 0709 12:25:28.293130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.549637 (+256507us) service_pool.cc:224] Handling call
0709 12:25:30.039715 (+1490078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.094434 (+ 54719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.419439 (+325005us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54003147d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:30.419636 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3426114944}
I20260709 12:25:30.447059 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.460397 15910 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:30.401300 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.425711 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1404) took 1204 ms. Trace:
I20260709 12:25:30.461673 15911 rpcz_store.cc:276] 0709 12:25:29.220959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.221120 (+   161us) service_pool.cc:224] Handling call
0709 12:25:30.425485 (+1204365us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001162d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:30.425631 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459467136}
I20260709 12:25:30.439666 15906 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:30.441628 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:30.473014 15988 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:30.470197 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:30.418010 19855 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:30.477356 15829 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:30.477174 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56643.1us
I20260709 12:25:30.479595 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:30.475301 19855 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:30.482229 19855 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.485153 19837 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:30.485574 19837 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.485916 19837 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.449731 19718 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.489574 19734 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:30.490070 19734 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.491070 19718 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:30.450486 19752 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:30.491814 19752 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:30.493803 19851 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:30.450121 19946 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.471148 19850 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:30.497325 19850 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.497670 19850 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.502619 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:30.507504 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:30.509995 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:30.312304 19513 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:30.513422 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 112221us
I20260709 12:25:30.514521 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:30.379201 19766 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:30.428619 19836 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:30.527082 15906 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:30.527336 15879 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:30.528489 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:30.532459 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.533397 15908 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:30.534236 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:30.535581 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.538208 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.544211 15910 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:30.545179 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:30.545904 15910 raft_consensus.cc:2410] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:30.547160 19504 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:30.549255 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:30.553226 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.554936 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.599090 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.600114 15910 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:30.557768 15911 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:30.553983 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.601121 15908 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:30.601743 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 734) took 1214 ms. Trace:
I20260709 12:25:30.552306 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.602830 15906 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:30.525532 20001 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.602344 15913 rpcz_store.cc:276] 0709 12:25:29.387319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.410503 (+ 23184us) service_pool.cc:224] Handling call
0709 12:25:29.410761 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.615263 (+204502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.601385 (+986122us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400431054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:30.601655 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468896640}
I20260709 12:25:30.525508 19944 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.555325 15836 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:30.610474 15987 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:30.544060 19820 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.545590 19561 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:30.617786 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 89384us
W20260709 12:25:30.614143 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 85945.5us
I20260709 12:25:30.619499 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:30.598619 19836 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:30.704764 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.705597 16495 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:30.551429 20016 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:30.525277 19883 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 12:25:30.676923 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54873.7us
W20260709 12:25:30.710621 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 161492us
I20260709 12:25:30.711571 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:30.616991 19999 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 12:25:30.712790 15879 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:30.713064 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.715565 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:30.732919 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.771863 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.768114 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.774523 16489 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:25:30.623044 19826 consensus_meta.cc:287] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.004s
I20260709 12:25:30.621807 19699 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:30.806205 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 93472.5us
I20260709 12:25:30.807785 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:25:30.831055 15979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.006s
W20260709 12:25:30.843109 15979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.006s
I20260709 12:25:30.707319 19836 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.715962 19851 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.900930 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.702152 19996 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:30.719040 20014 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:30.928077 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.893882 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:30.716503 19311 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:30.794130 19865 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:30.853782 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 142265us
I20260709 12:25:30.923890 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:30.925103 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:30.926522 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 223669us
I20260709 12:25:30.950102 16495 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:30.950752 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:30.926923 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.845271 19919 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:30.952147 16486 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:30.706701 19561 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:30.954923 15904 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 10. Ops: []
W20260709 12:25:30.957917 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.707518 20018 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.311s
I20260709 12:25:30.962839 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:30.990170 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:30.995507 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 376005us
W20260709 12:25:31.000385 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.000901 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.905524 19836 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.000087 16494 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:31.003448 16495 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:31.007627 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:30.933650 19927 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.013942 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1883) took 1743 ms. Trace:
I20260709 12:25:31.020255 15833 rpcz_store.cc:276] 0709 12:25:29.270921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.277106 (+  6185us) service_pool.cc:224] Handling call
0709 12:25:29.277390 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.285380 (+  7990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.285409 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.285844 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.888872 (+603028us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b18001887a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:25:30.082752 (+193880us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:30.082793 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.082862 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.002018 (+919156us) raft_consensus.cc:1685] finished
0709 12:25:31.002047 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.013878 (+ 11831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8491,"raft.queue_time_us":9580,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":18463,"spinlock_wait_cycles":61094784,"thread_start_us":193699,"threads_started":1,"wal-append.queue_time_us":829211}
I20260709 12:25:30.927291 19699 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:31.025008 16489 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.935322 19902 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:31.001718 19865 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.039708 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:31.042081 15987 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:31.010273 19919 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:31.008502 19787 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.964778 20029 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:31.021804 19851 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.833278 19766 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:31.030795 20010 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.555s	user 0.000s	sys 0.001s
I20260709 12:25:30.957644 19861 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 12:25:31.058161 15909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 732) took 1671 ms (client timeout 2226 ms). Trace:
W20260709 12:25:31.121693 15909 rpcz_store.cc:269] 0709 12:25:29.386705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.392702 (+  5997us) service_pool.cc:224] Handling call
0709 12:25:31.039359 (+1646657us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400116554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:31.058101 (+ 18742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354591616}
I20260709 12:25:30.960996 19311 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.065193 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:31.124631 15987 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:31.065136 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 114452us
I20260709 12:25:31.036875 19902 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:31.077747 20020 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:25:31.078176 19900 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.876s	user 0.008s	sys 0.003s
W20260709 12:25:31.079077 20023 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:25:31.081491 20019 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:31.053997 19865 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.082576 20032 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:31.053273 20029 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.084288 19851 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.085217 19919 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.086820 20018 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:30.954063 20014 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.062244 19787 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.094018 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1362) took 2250 ms. Trace:
I20260709 12:25:31.097301 20003 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:31.100540 19884 consensus_meta.cc:287] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.005s
W20260709 12:25:31.111047 19837 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.001s
I20260709 12:25:31.111292 19699 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.113454 19561 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:31.078397 20015 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:25:31.113840 19800 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:31.115876 15980 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 1927) took 1394 ms (client timeout 1538 ms). Trace:
W20260709 12:25:31.395961 15980 rpcz_store.cc:269] 0709 12:25:29.721359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.721587 (+   228us) service_pool.cc:224] Handling call
0709 12:25:31.115668 (+1394081us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001d5954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:31.115815 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344036480}
W20260709 12:25:31.117501 19946 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 12:25:31.118255 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:31.129462 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:31.068758 19513 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.124392 19798 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:31.338074 15987 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:31.029842 19927 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:31.265852 19802 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.004s
I20260709 12:25:31.380437 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:31.452860 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.453455 15909 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:31.454258 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.454783 15909 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:31.382670 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1934) took 1192 ms. Trace:
I20260709 12:25:31.384035 15981 rpcz_store.cc:276] 0709 12:25:28.843723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.088630 (+244907us) service_pool.cc:224] Handling call
0709 12:25:29.089053 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.089466 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.089508 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.090070 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.391705 (+1301635us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800327280. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:25:30.681417 (+289712us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:30.681469 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.681564 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.093693 (+412129us) raft_consensus.cc:1685] finished
0709 12:25:31.093714 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.093955 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1980,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7423,"spinlock_wait_cycles":2857344,"thread_start_us":229999,"threads_started":1,"wal-append.queue_time_us":1968808}
W20260709 12:25:31.317195 19850 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.000s
I20260709 12:25:31.265852 20032 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:31.343967 20010 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 12:25:31.457304 19865 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.426097 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1936) took 1227 ms. Trace:
I20260709 12:25:31.457463 19850 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.457876 15986 rpcz_store.cc:276] 0709 12:25:30.198294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.198429 (+   135us) service_pool.cc:224] Handling call
0709 12:25:30.210569 (+ 12140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.211047 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.211093 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.211680 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.469669 (+257989us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:30.469724 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.471953 (+  2229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.425806 (+953853us) raft_consensus.cc:1685] finished
0709 12:25:31.425833 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.426010 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":903,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":26361,"thread_start_us":182119,"threads_started":1,"wal-append.queue_time_us":613042}
I20260709 12:25:31.459616 19850 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.460105 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:31.431172 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 302213us
I20260709 12:25:31.455391 15982 rpcz_store.cc:276] 0709 12:25:30.190342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.190502 (+   160us) service_pool.cc:224] Handling call
0709 12:25:30.190974 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.278072 (+ 87098us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:30.278108 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.278564 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.399847 (+121283us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:30.399891 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.399976 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.382399 (+982423us) raft_consensus.cc:1685] finished
0709 12:25:31.382426 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.382596 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":120995,"threads_started":1,"wal-append.queue_time_us":430569}
I20260709 12:25:31.461475 15904 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:31.315426 20027 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.462675 15904 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:31.462709 20027 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.464001 15904 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:31.269901 20029 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.464458 19836 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.457502 20032 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.138761 19900 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.431205 20033 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:25:31.468880 20033 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.451293 19927 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.469460 16490 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.470760 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:31.478719 15952 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:31.386785 20037 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:31.349272 20018 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.482501 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1939) took 1281 ms. Trace:
I20260709 12:25:31.483002 15983 rpcz_store.cc:276] 0709 12:25:30.201066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.303480 (+102414us) service_pool.cc:224] Handling call
0709 12:25:30.306919 (+  3439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.307225 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.307254 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.310642 (+  3388us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.532817 (+222175us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:30.532887 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.532983 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.482226 (+949243us) raft_consensus.cc:1685] finished
0709 12:25:31.482254 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.482436 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38769,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":165614,"threads_started":1,"wal-append.queue_time_us":455154}
I20260709 12:25:31.438223 19851 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:31.481058 19594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.035s	sys 0.038s
W20260709 12:25:31.490257 15984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.021s	sys 0.055s
W20260709 12:25:31.498250 15984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.023s	sys 0.057s
I20260709 12:25:31.498113 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:31.395397 19837 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:31.485468 20015 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:25:31.489583 20017 log.cc:927] Time spent T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.544s	user 0.001s	sys 0.000s
W20260709 12:25:31.497609 19594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.035s	sys 0.038s
I20260709 12:25:31.431625 20036 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:31.504869 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:31.514989 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:31.510960 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:31.498404 19838 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:31.488338 19513 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:31.519361 15983 raft_consensus.cc:2393] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:31.519346 19513 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:31.520289 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:31.520259 19513 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.520980 15983 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:31.521498 19513 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.522239 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:31.522825 15983 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.524704 16489 raft_consensus.cc:2410] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:31.510378 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:31.525115 20036 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.526068 19311 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.528566 19513 raft_consensus.cc:476] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:25:31.486770 20037 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.550961 20037 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.551525 20037 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:31.551895 20037 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.552232 20037 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:31.503608 19709 consensus_meta.cc:287] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.323s	user 0.011s	sys 0.000s
I20260709 12:25:31.553282 19709 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.555415 19709 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.508173 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:31.556147 15836 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 6.
I20260709 12:25:31.557188 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:31.557858 15836 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.560192 15838 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.536989 15832 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:31.510365 19851 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:31.512315 19855 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.030s	user 0.011s	sys 0.000s
I20260709 12:25:31.539443 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:31.565378 15910 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.487032 20033 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.540339 19450 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.538321 19826 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.512014 19800 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.545307 19513 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:31.547137 20036 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.589376 15836 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:31.564237 15832 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:31.567492 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:31.474104 19798 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.529668 19838 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.588410 19800 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.602837 19838 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:31.586746 19947 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.383s	user 0.010s	sys 0.001s
I20260709 12:25:31.603773 19947 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.604372 19513 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.585915 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.606653 15909 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
W20260709 12:25:31.607667 20030 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:25:31.607635 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:31.608793 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.586223 15983 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:31.610217 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.612283 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:31.614445 15983 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.590445 15836 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.592682 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:31.599337 15910 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:31.586544 19450 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.586727 19826 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.602165 19906 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.616360 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:31.618953 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.564905 19851 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:31.629428 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2796) took 1081 ms. Trace:
I20260709 12:25:31.631031 15913 rpcz_store.cc:276] 0709 12:25:30.548358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.957873 (+409515us) service_pool.cc:224] Handling call
0709 12:25:31.629351 (+671478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:31.632601 19902 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.635429 19904 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.638394 19734 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.641310 15911 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:31.642427 15911 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:31.638424 19450 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.645473 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.613237 19311 raft_consensus.cc:2764] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:31.630156 15910 raft_consensus.cc:2368] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
I20260709 12:25:31.665158 15983 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:31.668154 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:31.644398 19851 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.576473 19855 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.680388 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1941) took 1478 ms. Trace:
I20260709 12:25:31.680872 15984 rpcz_store.cc:276] 0709 12:25:30.202483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.343296 (+140813us) service_pool.cc:224] Handling call
0709 12:25:30.343689 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:30.415911 (+ 72222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.416297 (+   386us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.420439 (+  4142us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.498713 (+1078274us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:31.498748 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.498806 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.680151 (+181345us) raft_consensus.cc:1685] finished
0709 12:25:31.680176 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.680320 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5652,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":1051014,"threads_started":2,"wal-append.queue_time_us":1190256}
I20260709 12:25:31.683530 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1943) took 1062 ms. Trace:
I20260709 12:25:31.683940 15984 rpcz_store.cc:276] 0709 12:25:30.620782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.682629 (+1061847us) service_pool.cc:224] Handling call
0709 12:25:31.682940 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.683163 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.683199 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:31.683251 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:31.683300 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.683364 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.683473 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:31.686133 20037 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.706080 20018 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.707598 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 724) took 2787 ms. Trace:
W20260709 12:25:31.715062 19820 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.011s	user 0.010s	sys 0.002s
I20260709 12:25:31.715615 19820 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.716374 15912 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:31.718451 19826 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.726078 19855 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.727106 15979 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:25:31.737725 15984 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.738659 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1945) took 1114 ms. Trace:
I20260709 12:25:31.739104 15984 rpcz_store.cc:276] 0709 12:25:30.624479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.684967 (+1060488us) service_pool.cc:224] Handling call
0709 12:25:31.737493 (+ 52526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.738282 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.738520 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:31.708110 15985 rpcz_store.cc:276] 0709 12:25:28.920388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.121921 (+201533us) service_pool.cc:224] Handling call
0709 12:25:29.159824 (+ 37903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.160255 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.160295 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.164980 (+  4685us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.332566 (+1167586us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b18002b7e00. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:25:30.433767 (+101201us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:30.439025 (+  5258us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.444200 (+  5175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.446612 (+  2412us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.707240 (+1260628us) raft_consensus.cc:1685] finished
0709 12:25:31.707343 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.707496 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83257,"prepare.queue_time_us":3185,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":35353,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":49112,"spinlock_wait_cycles":4558464,"thread_start_us":98716,"threads_started":1,"wal-append.queue_time_us":1544328}
I20260709 12:25:31.677453 20014 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.754859 15984 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:25:31.756835 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 278178us
I20260709 12:25:31.757848 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:31.753914 19961 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.019s	sys 0.016s
I20260709 12:25:31.746347 19838 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.784825 15952 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:31.808337 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 293408us
I20260709 12:25:31.764891 19946 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:31.767486 19961 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.020s	sys 0.016s
I20260709 12:25:31.813774 15953 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:31.783243 20014 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.808872 19855 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.830207 19838 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.808653 20018 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:25:31.850126 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:31.847718 15953 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:31.854946 15953 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:31.812007 19946 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:31.858186 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.827338 19826 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.861532 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.862382 15913 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:31.866611 15904 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:31.869640 15953 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:31.876658 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.879501 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:31.877468 15913 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:31.855108 20050 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.859033 20014 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.885960 20039 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.887586 19996 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:31.888135 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.888106 19996 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.889305 15913 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:31.888259 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 295641us
I20260709 12:25:31.890724 19996 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.890898 15913 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:31.892714 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.892822 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.892980 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.893751 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:31.893896 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.894042 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.894295 15910 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.895054 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.897512 19996 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:31.904048 15910 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:31.905902 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:31.907541 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:31.907938 16486 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:25:31.908762 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:31.910024 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:31.910729 16488 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.914077 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:31.917833 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.876597 19734 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.876798 19855 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.876942 19919 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.876394 19838 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.918754 15913 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:31.868201 20053 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.882383 20040 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:31.920477 19894 consensus_meta.cc:287] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.721s	user 0.002s	sys 0.010s
I20260709 12:25:31.865535 19826 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.932634 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 737) took 1570 ms. Trace:
I20260709 12:25:31.933944 19826 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.927873 19734 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.935815 19734 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.929170 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:31.929839 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:31.917837 20029 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.918061 19820 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.916747 19996 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:31.931211 20049 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:31.933056 15987 rpcz_store.cc:276] 0709 12:25:30.362495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.437522 (+1075027us) service_pool.cc:224] Handling call
0709 12:25:31.437967 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.438394 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.438435 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.449583 (+ 11148us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.754213 (+304630us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:31.754269 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.754357 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.932415 (+178058us) raft_consensus.cc:1685] finished
0709 12:25:31.932439 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.932575 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":424,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":34281,"thread_start_us":304258,"threads_started":1,"wal-append.queue_time_us":407538}
W20260709 12:25:31.931002 20044 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:25:31.928417 20042 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:25:31.948478 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:31.948910 19947 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.950253 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1382) took 1392 ms. Trace:
I20260709 12:25:31.951427 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 734) took 1659 ms. Trace:
I20260709 12:25:31.950747 15982 rpcz_store.cc:276] 0709 12:25:30.557329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.462921 (+905592us) service_pool.cc:224] Handling call
0709 12:25:31.463188 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.463469 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.463496 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.463928 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.764069 (+300141us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:31.764129 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.764215 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.949849 (+185634us) raft_consensus.cc:1685] finished
0709 12:25:31.949879 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.950164 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12021,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":5388,"thread_start_us":299153,"threads_started":1,"wal-append.queue_time_us":390497}
I20260709 12:25:31.952044 15979 rpcz_store.cc:276] 0709 12:25:30.292022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.082913 (+790891us) service_pool.cc:224] Handling call
0709 12:25:31.083490 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.727584 (+644094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.951194 (+223610us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54002c5954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:31.951371 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479456000}
I20260709 12:25:31.928962 19906 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:25:31.928615 19855 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.955495 19855 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.940572 20029 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.946156 15909 raft_consensus.cc:2368] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8.
I20260709 12:25:31.886535 20039 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.976868 16488 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:31.915242 19699 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:25:31.980854 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1379) took 1596 ms. Trace:
I20260709 12:25:31.981315 15986 rpcz_store.cc:276] 0709 12:25:30.384792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.459351 (+1074559us) service_pool.cc:224] Handling call
0709 12:25:31.459658 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.460012 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.460040 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.460531 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.756770 (+296239us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:31.756806 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.756866 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.980639 (+223773us) raft_consensus.cc:1685] finished
0709 12:25:31.980664 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.980795 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4466,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":295919,"threads_started":1,"wal-append.queue_time_us":409845}
I20260709 12:25:31.927299 19919 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.942901 19894 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.985756 19851 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.987223 19894 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:31.987490 19861 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:31.990844 20032 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.002s
I20260709 12:25:31.957367 19996 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:31.991139 20016 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:31.991331 20039 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.991659 20016 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.994621 19919 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.989315 19861 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:31.995141 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 736) took 1700 ms. Trace:
I20260709 12:25:31.995836 19861 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:31.995954 15980 rpcz_store.cc:276] 0709 12:25:30.294937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.433069 (+1138132us) service_pool.cc:224] Handling call
0709 12:25:31.478997 (+ 45928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.514225 (+ 35228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.514270 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.514781 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.814508 (+299727us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:31.892185 (+ 77677us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.892372 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.994761 (+102389us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400206554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:31.994809 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.994857 (+    48us) raft_consensus.cc:1685] finished
0709 12:25:31.994957 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.995084 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028,"prepare.queue_time_us":169089,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":44268,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":182,"spinlock_wait_cycles":50223360,"thread_start_us":376777,"threads_started":2,"wal-append.queue_time_us":391856}
I20260709 12:25:32.002864 20036 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:32.003515 20036 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.003261 20016 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.005300 19800 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.007745 20016 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.993547 19996 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.991370 20032 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.020574 19900 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:31.997157 19861 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.010003 19946 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.031867 20032 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:31.926124 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:32.071498 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 145295us
I20260709 12:25:32.076740 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:32.092006 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.093853 15829 raft_consensus.cc:2410] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:32.106290 15907 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:32.116822 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 117245us
I20260709 12:25:32.120318 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:31.540599 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.129570 19450 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.129786 19851 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.130247 19450 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:32.131768 19450 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.116885 15983 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:32.120854 15986 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:32.153635 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 44588.1us
I20260709 12:25:32.153834 19820 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:32.154682 15953 leader_election.cc:336] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Timed out: RequestConsensusVote RPC to 127.14.78.68:43743 timed out after 1.668s (SENT)
I20260709 12:25:32.155586 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.155870 15953 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:32.157860 19648 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:32.164000 19800 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:32.166911 15980 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:32.168835 20032 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:32.170907 19851 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:32.170370 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:32.178530 15802 connection.cc:256] RPC call timeout handler was delayed by -1.4868771759997799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 12:25:32.181268 19800 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:32.168948 19906 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.182860 19906 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.183064 19800 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.218559 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.220026 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.221057 19947 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:32.221836 19947 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.224380 19947 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.225386 19885 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.226275 19885 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.229636 19794 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.230077 19932 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.230350 19794 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.230813 19932 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.238807 19794 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.224911 19947 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:32.246832 19851 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:32.246923 19947 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.247756 19851 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.248368 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.251322 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.251580 19851 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.252128 15909 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
W20260709 12:25:32.228896 15912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2789) took 1698 ms (client timeout 1974 ms). Trace:
I20260709 12:25:32.253648 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:32.253939 15912 rpcz_store.cc:269] 0709 12:25:30.530078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.832746 (+302668us) service_pool.cc:224] Handling call
0709 12:25:32.228537 (+1395791us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400431554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:32.228709 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810043264}
I20260709 12:25:32.255209 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.255393 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1378) took 1871 ms. Trace:
I20260709 12:25:32.255908 15912 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:32.255824 15981 rpcz_store.cc:276] 0709 12:25:30.384109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.456577 (+1072468us) service_pool.cc:224] Handling call
0709 12:25:31.456838 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.549945 (+ 93107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.549990 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:31.550045 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:31.550092 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.254848 (+704756us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5400205b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:32.254923 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.255194 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213571456}
I20260709 12:25:32.220935 15913 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:32.265733 19902 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.266641 19902 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.270056 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.274782 19877 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.275224 15836 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:32.275697 19877 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.265749 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.228871 19885 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.280486 19902 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.280797 15907 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:32.283033 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.283975 19877 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.284085 19851 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:32.285991 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 910) took 1571 ms (client timeout 1668 ms). Trace:
I20260709 12:25:32.286319 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.287562 19947 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.288983 19794 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.289518 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.290938 19932 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.295970 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 630) took 1295 ms. Trace:
W20260709 12:25:32.298974 16489 rpcz_store.cc:269] 0709 12:25:30.922762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.936926 (+ 14164us) service_pool.cc:224] Handling call
0709 12:25:32.285547 (+1348621us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54006bf8d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:32.285768 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26851200}
I20260709 12:25:32.302923 15829 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 5.
I20260709 12:25:32.315515 19513 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.316589 19794 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.319378 19794 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.321496 19802 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:32.322479 19802 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.326063 19752 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.328397 19787 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.330284 19798 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.331750 19836 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.301502 19851 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:32.332942 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50068.7us
W20260709 12:25:32.341655 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.304996 16492 rpcz_store.cc:276] 0709 12:25:31.000692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.000923 (+   231us) service_pool.cc:224] Handling call
0709 12:25:31.001268 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.001465 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:31.130834 (+129369us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.617148 (+486314us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.288367 (+671219us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b1800392980. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:32.288744 (+   377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:32.288839 (+    95us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:32.288982 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.295457 (+  6475us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.295695 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2050,"prepare.queue_time_us":499941,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":568,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2308,"spinlock_wait_cycles":34385024,"thread_start_us":588353,"threads_started":2,"wal-append.queue_time_us":652262}
I20260709 12:25:32.345715 19798 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.348337 19798 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.335733 19906 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.350828 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.343818 19851 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:32.355537 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 200967us
I20260709 12:25:32.366564 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.352619 19798 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.398612 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.399519 15829 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:32.385885 19794 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.402755 19794 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.405550 19794 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.380800 19802 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.415503 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.419221 19794 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.419327 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:32.419981 19947 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:32.382503 19513 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.421197 20091 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.421792 19885 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.423354 19877 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.436228 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.436452 19877 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.437120 19885 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.438797 19877 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.424759 15835 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.427536 19794 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.443361 20033 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.443691 15953 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.444006 20033 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:32.444424 19794 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.445443 19311 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:32.445822 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.445996 19311 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:32.426766 19513 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.449927 19513 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.428629 19932 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.451922 19932 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.453299 20036 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.453857 15831 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:25:32.454219 15831 pending_rounds.cc:85] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 7
I20260709 12:25:32.454447 15831 pending_rounds.cc:107] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:25:32.454746 15831 raft_consensus.cc:2889] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.455283 20033 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:32.455722 20033 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:32.456146 20033 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.455950 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.447551 19311 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.458087 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.458520 19947 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.435177 15909 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:32.461540 19794 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:32.462009 19794 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.462441 19794 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.439745 20027 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.433337 20091 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.466395 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 748) took 2028 ms. Trace:
I20260709 12:25:32.467504 20091 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.441311 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.442339 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:32.469120 19865 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.469449 19885 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.469697 19865 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.472133 19865 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:32.472620 19865 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.473641 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:32.473819 19877 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:32.475183 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:32.475477 19877 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:32.476079 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 356831us
I20260709 12:25:32.477440 16459 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:32.478613 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:32.479176 19766 raft_consensus.cc:2764] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:32.479764 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.480443 15908 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:32.480118 19766 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:32.483126 19766 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.483588 19766 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.483664 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.426015 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.456924 15831 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:32.497879 15835 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:32.501336 19947 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.501754 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 858) took 2586 ms. Trace:
I20260709 12:25:32.502170 15834 rpcz_store.cc:276] 0709 12:25:29.915371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.915622 (+   251us) service_pool.cc:224] Handling call
0709 12:25:29.957821 (+ 42199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.137585 (+179764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.137620 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.137666 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:30.137701 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.501294 (+2363593us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400083254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:32.501368 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.501581 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412941184}
I20260709 12:25:32.503063 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:32.503991 20064 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:32.504684 20064 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.507169 20064 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.507480 19932 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.509256 15829 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.510219 20094 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.510771 20094 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.511654 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.512316 16495 raft_consensus.cc:2376] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13. Re-sending same reply.
I20260709 12:25:32.466832 15905 rpcz_store.cc:276] 0709 12:25:30.438181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.441814 (+  3633us) service_pool.cc:224] Handling call
0709 12:25:30.442152 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.554163 (+1112011us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:32.211121 (+656958us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b18002f76a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cfc9b3c7 00007f03cc2ad9a7 00007f03cc2bd0bf
0709 12:25:32.211343 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.373987 (+162644us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.374178 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:32.374243 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:32.374279 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.407546 (+ 33267us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b18002f76a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240
0709 12:25:32.465976 (+ 58430us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540029a254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:32.466022 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.466192 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7607,"prepare.queue_time_us":307305,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2252,"raft.queue_time_us":17655,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":5292,"spinlock_wait_cycles":2597960832,"thread_start_us":427656,"threads_started":2,"wal-append.queue_time_us":137018}
I20260709 12:25:32.513629 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.514516 15981 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:32.515843 20094 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.516605 19311 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.517154 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 747) took 2079 ms. Trace:
I20260709 12:25:32.517619 15907 rpcz_store.cc:276] 0709 12:25:30.437775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.441256 (+  3481us) service_pool.cc:224] Handling call
0709 12:25:32.516869 (+2075613us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54001c3c54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:32.517084 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3758849280}
I20260709 12:25:32.518039 15834 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:32.518440 15834 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:32.519150 20094 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:32.519922 19837 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.520738 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.521561 16492 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 6: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:32.521126 19865 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.522056 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.522819 16493 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:32.523706 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.524051 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.524313 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:32.524673 15913 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.524981 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.525153 16494 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:32.525928 15906 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:32.519724 20094 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:32.528049 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53071.8us
I20260709 12:25:32.529114 20094 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.488485 19977 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.530099 19977 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:32.529174 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1897) took 2211 ms. Trace:
I20260709 12:25:32.531297 19977 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.532090 15838 rpcz_store.cc:276] 0709 12:25:30.317260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.317432 (+   172us) service_pool.cc:224] Handling call
0709 12:25:30.359009 (+ 41577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.564752 (+1205743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.528641 (+963889us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540024efd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:32.528932 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762014592}
I20260709 12:25:32.535113 15802 leader_election.cc:400] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
I20260709 12:25:32.535456 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1942) took 1915 ms. Trace:
I20260709 12:25:32.536245 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:32.537134 20091 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.537503 19839 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:32.538009 15953 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.538955 19996 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:32.539477 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.540285 15911 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:32.541559 15834 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.542016 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.542482 19903 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.542737 15834 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:32.538194 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.542613 16495 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:32.535950 15983 rpcz_store.cc:276] 0709 12:25:30.620453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.670438 (+1049985us) service_pool.cc:224] Handling call
0709 12:25:31.677159 (+  6721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.158183 (+481024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.535167 (+376984us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54002788d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:32.535398 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009312640}
I20260709 12:25:32.524401 15905 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 6.
I20260709 12:25:32.558313 15908 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:32.563840 20037 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.564741 20091 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:32.565202 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.565989 15907 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:32.566048 19932 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:32.566296 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:32.566521 19932 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:32.567620 19932 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.568954 15953 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.569917 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:32.569972 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:32.571058 19837 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.571462 19837 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:32.571863 19837 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.572358 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.572536 15913 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:32.573154 15980 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:32.573433 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.575292 19713 raft_consensus.cc:3055] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:32.575461 15984 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:32.575714 19713 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:32.575814 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.576388 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 721) took 2396 ms. Trace:
I20260709 12:25:32.576901 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.577652 15979 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:32.576766 16496 rpcz_store.cc:276] 0709 12:25:30.092338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.092471 (+   133us) service_pool.cc:224] Handling call
0709 12:25:30.092771 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.092979 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:30.241806 (+148827us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.242437 (+   631us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.381060 (+138623us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b1800321760. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:31.497158 (+1116098us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b1800321760. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:31.985228 (+488070us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b1800321760. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03cbe59d70 00007f03cbe4d293 00007f03cbe42cea 00007f03cbe4323a 00007f03cc2ada2a 00007f03cc2bd0bf 00007f03cc2bd038
0709 12:25:32.379131 (+393903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:32.379359 (+   228us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:32.407261 (+ 27902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.427247 (+ 19986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.488945 (+ 61698us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377655,"prepare.queue_time_us":17434,"prepare.run_cpu_time_us":8601,"prepare.run_wall_time_us":18513,"raft.queue_time_us":494621,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":21800,"spinlock_wait_cycles":35383808,"thread_start_us":214445,"threads_started":2}
I20260709 12:25:32.578716 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.580621 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.523659 19865 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:32.575493 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.539495 19996 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:32.568898 19932 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.589586 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:32.591408 15952 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.535351 19947 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:25:32.595592 15829 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:32.543435 19794 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.594707 15985 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:32.601287 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:32.604933 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68786.7us
I20260709 12:25:32.588769 20037 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:32.615440 16494 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:32.621476 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.623796 15913 raft_consensus.cc:2393] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:32.626096 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.626849 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.628615 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:32.613168 19839 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:32.635231 20060 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:32.635447 19839 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:32.635830 20060 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.636303 20060 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.640446 19996 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.633332 15834 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:25:32.627933 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.645229 15834 pending_rounds.cc:85] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 5
I20260709 12:25:32.645745 15834 pending_rounds.cc:107] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:25:32.646055 15834 raft_consensus.cc:2889] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.649333 15835 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:32.651225 15802 leader_election.cc:400] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8.
I20260709 12:25:32.651672 15802 leader_election.cc:403] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:32.592470 20031 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:32.659333 15907 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:32.660144 20061 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:32.660576 20061 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.660991 20061 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:32.664878 19798 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:32.666164 19798 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:32.666530 19798 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:32.667423 19798 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.668730 19798 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.669200 19594 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:32.659369 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:32.674105 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49722.1us
W20260709 12:25:32.676218 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.636718 19839 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.676786 19902 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8.
I20260709 12:25:32.693789 16457 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:32.682206 19865 raft_consensus.cc:2764] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:32.692333 20027 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.704640 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.705623 15829 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 5.
I20260709 12:25:32.709386 15834 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:32.654784 19713 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:32.714004 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 80170.9us
I20260709 12:25:32.716430 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:32.716516 19922 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.687896 19513 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.714259 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:32.727631 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68336us
I20260709 12:25:32.728577 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:32.729990 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:32.717760 19903 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:32.737910 16459 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:32.740284 15986 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:32.748688 19903 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:32.733956 19865 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:32.750977 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.749169 19903 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.752020 19903 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.753643 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.754774 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.726060 19504 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:32.737979 19794 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.740455 19648 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:32.744553 19932 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:32.757680 19865 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.732023 20033 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:32.773857 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95384.2us
I20260709 12:25:32.774935 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:32.777184 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.766039 19504 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:32.776507 20060 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.781162 19718 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:32.781404 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1408) took 1222 ms. Trace:
I20260709 12:25:32.781932 19718 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:32.781860 15904 rpcz_store.cc:276] 0709 12:25:31.558421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.559217 (+   796us) service_pool.cc:224] Handling call
0709 12:25:31.559499 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.867116 (+307617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.776778 (+909662us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400420ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:32.781252 (+  4474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705482624}
I20260709 12:25:32.770488 19865 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:32.772184 19648 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:32.759896 19922 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.783704 20060 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:32.800285 19713 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.783347 19718 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.803258 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.808842 19851 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.810441 19648 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:32.813586 20098 log.cc:927] Time spent T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:25:32.815903 19922 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:32.816720 15730 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 276) took 41374 ms (client timeout 15000 ms). Trace:
I20260709 12:25:32.817430 15729 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.820855 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:32.824070 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.832273 15836 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:32.826781 15988 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:25:32.827539 15783 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9fd62f0fa06a4561a0a7101b85942f86 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:32.828190 19513 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.832422 15910 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:32.824838 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44588.8us
W20260709 12:25:32.835208 15783 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:25:32.836751 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.836983 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.839175 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:32.839586 15905 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.821328 19851 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:32.841745 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:32.835609 15783 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:25:32.854033 19836 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:32.854468 15803 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:32.854738 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:32.855140 19836 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:32.855741 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:32.855960 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.856527 16494 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:32.856565 19504 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:32.857283 19504 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:32.857427 19977 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:32.858510 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.859246 15835 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:32.856885 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:32.865792 15729 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 4 to 5, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 5 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.868489 15905 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:32.869567 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:32.885203 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.849751 20027 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.888092 15803 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:32.890210 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.887642 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:32.889909 19977 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:32.899425 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.882619 19851 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.893831 19877 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:32.909196 19883 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:32.909711 19883 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.910125 19883 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:32.876232 20061 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.900267 19977 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.919231 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.907850 19851 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:32.918681 19977 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:32.931912 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.901825 19837 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:32.830252 15730 rpcz_store.cc:269] 0709 12:24:51.477835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.504631 (+ 26796us) service_pool.cc:224] Handling call
0709 12:25:32.816467 (+41311836us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:24.164842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:24.165594 (+   752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:24.165649 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:25:24.165665 (+    16us) tablet.cc:662] Decoding operations
0709 12:25:24.166632 (+   967us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:24.166701 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:24.166729 (+    28us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:25:24.167456 (+   727us) tablet.cc:701] Row locks acquired
0709 12:25:24.167519 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:25:24.167683 (+   164us) write_op.cc:270] Start()
0709 12:25:24.167834 (+   151us) write_op.cc:276] Timestamp: P: 1783599924167623 usec, L: 0
0709 12:25:24.167857 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:24.230689 (+ 62832us) log.cc:844] Serialized 2835 byte log entry
0709 12:25:25.136819 (+906130us) op_driver.cc:464] REPLICATION: finished
0709 12:25:25.438410 (+301591us) write_op.cc:301] APPLY: starting
0709 12:25:25.438531 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:25.438727 (+   196us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:25.438855 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:25.584639 (+145784us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:25.584939 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:25:25.584989 (+    50us) write_op.cc:312] APPLY: finished
0709 12:25:25.585322 (+   333us) log.cc:844] Serialized 59 byte log entry
0709 12:25:25.585492 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:25.585610 (+   118us) write_op.cc:454] Released schema lock
0709 12:25:25.585670 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:25.586071 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:25.586099 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7001,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":249838,"apply.run_cpu_time_us":3626,"apply.run_wall_time_us":170037,"num_ops":7,"prepare.queue_time_us":116558,"prepare.run_cpu_time_us":26467,"prepare.run_wall_time_us":518629,"raft.queue_time_us":201668,"raft.run_cpu_time_us":8809,"raft.run_wall_time_us":322735,"replication_time_us":939136,"thread_start_us":543457,"threads_started":4,"wal-append.queue_time_us":435902,"wal-append.run_cpu_time_us":19269,"wal-append.run_wall_time_us":1871767}]]}
I20260709 12:25:32.936239 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:32.924316 19877 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:32.941761 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.930038 20033 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:32.952184 20102 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:25:32.963510 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.917433 19504 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:32.970197 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.970667 15987 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:32.955713 19996 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.962525 19914 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:32.982144 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.966533 19839 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.982780 15837 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:32.972106 20033 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:32.986943 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.988828 15836 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:32.958457 19865 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:32.987638 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:32.989677 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:32.989861 15835 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.893867 15729 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 6 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.977589 19513 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:32.977816 19914 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:33.000698 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:33.003522 15879 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.019s	sys 0.042s
W20260709 12:25:33.003830 15879 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.019s	sys 0.042s
I20260709 12:25:33.003746 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:33.004222 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 630020us
I20260709 12:25:33.004994 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.006199 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.006435 20002 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.006871 15907 raft_consensus.cc:2368] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
I20260709 12:25:33.006973 20002 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.018209 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.022831 16493 raft_consensus.cc:2368] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:33.028573 16494 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.030063 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.032760 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.033818 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.980700 19996 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.036914 15911 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:25:32.979004 19851 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.048070 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:33.053624 20107 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:25:33.054337 19914 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.055277 19996 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:33.058104 19718 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:33.058840 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:33.059123 20101 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:25:33.058990 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:32.993050 20033 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.066891 15906 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:33.068517 15910 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:33.069676 15908 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:33.000387 20027 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:33.075798 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.048063 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:33.074580 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.074828 19718 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:33.075253 15986 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.032196 20061 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:33.067253 19766 consensus_meta.cc:287] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.009s
I20260709 12:25:33.077715 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.080536 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:33.024890 19839 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.085536 16493 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:33.087648 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.096837 15981 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:33.019130 19513 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.009399 20009 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 12:25:33.060757 19311 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:33.087683 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.102237 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.126840 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:33.127724 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.128273 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.127077 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.128898 15831 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:33.067703 20002 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:33.091068 20103 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:25:33.136336 15985 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:33.081561 19718 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:33.134245 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:33.144264 15987 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:33.144461 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.146875 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:33.147524 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 170289us
I20260709 12:25:33.098173 19996 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:33.152704 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.157990 15982 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:33.154090 15983 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
W20260709 12:25:33.161152 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.127892 19837 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:33.136986 19914 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.178200 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.168310 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:33.180927 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.143864 20037 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.181962 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.091982 19766 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:33.159420 20081 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:33.171121 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:33.186363 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.201830 15910 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:33.187209 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.187881 15987 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:33.168910 20106 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:25:33.190704 19865 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:33.190943 19837 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.191874 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.027115 19877 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.194763 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:33.196971 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.180827 15981 pending_rounds.cc:85] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 6
I20260709 12:25:33.212184 15981 pending_rounds.cc:107] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:33.178169 19996 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:33.157294 19794 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:33.138099 19311 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.207634 16489 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:25:33.192878 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:33.207492 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 63538.7us
I20260709 12:25:33.209705 15983 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:25:33.261054 15983 pending_rounds.cc:85] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 6
I20260709 12:25:33.212453 15981 raft_consensus.cc:2889] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.189730 19513 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:33.192901 20108 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:25:33.177215 19800 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:33.234853 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 173099us
I20260709 12:25:33.235720 16494 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:33.268652 19996 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.269138 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.269460 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:33.269806 19865 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:33.270117 15982 raft_consensus.cc:2368] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:33.270246 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.270318 19865 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:33.270946 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.271320 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.271750 15982 raft_consensus.cc:2410] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:33.271275 19865 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.272491 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:33.275920 20099 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.471s	user 0.004s	sys 0.007s
I20260709 12:25:33.277249 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.277400 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:33.278426 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.278607 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:33.279886 15802 leader_election.cc:400] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
I20260709 12:25:33.280156 15802 leader_election.cc:403] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:33.281526 19932 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:33.282040 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 75503.1us
I20260709 12:25:33.284374 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.285204 15912 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:33.237347 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.285992 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.286295 15979 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:33.184661 20002 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.287065 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.287473 15909 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:25:33.287308 20002 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.288169 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.288728 15836 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:33.240245 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:33.236689 15980 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
W20260709 12:25:33.242842 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.237910 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.261350 15983 pending_rounds.cc:107] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:33.293573 15983 raft_consensus.cc:2889] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.293905 15983 pending_rounds.cc:107] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:33.294140 15983 raft_consensus.cc:2889] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:33.263643 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 68993.1us
I20260709 12:25:33.265759 15987 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:33.272861 15982 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:33.314025 15988 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:33.315358 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:33.321880 20002 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:33.322527 15831 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:33.324692 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:33.325420 15832 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:33.327632 15831 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:33.327523 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:33.330236 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:33.330499 16490 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:33.322341 20104 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:25:33.187837 19718 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.387039 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.388439 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:33.393288 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 225776us
I20260709 12:25:33.332010 20033 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:33.323946 19932 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 6. Current term is 7.
I20260709 12:25:33.406914 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.411484 15832 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:33.437099 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:33.437732 15905 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:33.440702 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 145512us
I20260709 12:25:33.438958 15988 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:33.317271 19794 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.329344 19902 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:25:33.446156 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.450570 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:33.436731 20109 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:25:33.458787 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 128635us
I20260709 12:25:33.459661 15982 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:25:33.165372 15729 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 2 to 5, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 5 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.460415 15988 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:33.328806 19800 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.466787 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:33.467285 15910 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:33.468233 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 306399us
W20260709 12:25:33.471033 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 155784us
I20260709 12:25:33.471604 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:33.472299 15983 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:33.473619 15908 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.452099 19766 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:33.473862 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:33.481591 15836 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:33.488938 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.517144 19781 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:33.517814 19781 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.520154 19932 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:33.520548 19932 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:33.520625 19781 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:33.521376 19932 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.470906 20097 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:33.545982 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 57558.8us
I20260709 12:25:33.533519 15988 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:33.535563 15905 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:33.539047 15908 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:33.542438 19883 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.005s
I20260709 12:25:33.507191 19902 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:33.555732 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:33.555979 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.509547 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:33.551136 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.557757 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.558331 15982 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
W20260709 12:25:33.559206 19713 consensus_meta.cc:287] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.758s	user 0.005s	sys 0.005s
I20260709 12:25:33.550825 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:33.586349 15830 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:33.550660 19839 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:33.529507 19718 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.551718 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.566009 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.558956 20097 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:25:33.580241 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.624138 16496 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:33.560715 16488 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:33.623598 15983 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:33.556762 16494 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:33.581974 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:33.627138 16495 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:33.554913 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.627666 15984 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:33.582540 15980 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:33.583120 15834 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:33.585475 15986 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:33.630118 16489 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:33.632145 15879 leader_election.cc:400] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:33.632543 15879 leader_election.cc:403] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:33.559787 19902 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.643380 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.536589 19798 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 12:25:33.626936 19903 consensus_meta.cc:287] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.004s
I20260709 12:25:33.645104 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:33.627348 20121 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 12:25:33.706590 15985 raft_consensus.cc:2410] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:33.710455 15983 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:33.727430 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 171769us
I20260709 12:25:33.780979 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:33.585935 19883 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:33.790446 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 328118us
I20260709 12:25:33.707492 19932 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.644716 19902 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:33.781878 15984 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:33.849354 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:33.852380 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 61068.8us
I20260709 12:25:33.858366 15988 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:25:33.841650 19902 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.846822 20027 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:33.730994 19903 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:33.850766 19839 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:33.904446 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 117124us
I20260709 12:25:33.905645 20125 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.904474 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50821.3us
I20260709 12:25:33.857200 20117 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.951803 16492 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 7: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:33.952549 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:33.902412 19513 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.908700 19794 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:33.959726 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.903083 20027 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:33.987700 15803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.017s
I20260709 12:25:33.946693 20124 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:33.988070 16460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.009s	sys 0.008s
W20260709 12:25:33.992274 16460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.009s	sys 0.009s
I20260709 12:25:33.944443 19839 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:33.945073 20126 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
W20260709 12:25:34.010809 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.010s	sys 0.015s
W20260709 12:25:34.011224 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.010s	sys 0.015s
I20260709 12:25:34.011154 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:33.996888 15803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.001s	sys 0.017s
I20260709 12:25:33.980216 20033 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:33.987385 15835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.011s	sys 0.015s
W20260709 12:25:34.015621 15835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.015s
W20260709 12:25:34.012642 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 538831us
W20260709 12:25:34.008589 20031 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.042s	sys 0.101s
W20260709 12:25:34.027714 15801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.011s	sys 0.007s
W20260709 12:25:34.028028 15801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.011s	sys 0.007s
I20260709 12:25:34.028287 19851 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.029714 20129 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:34.031612 20120 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:25:34.014447 19914 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.830s	user 0.005s	sys 0.006s
I20260709 12:25:34.025826 19648 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:34.009650 19504 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.037694 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.040297 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.009419 16460 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.045187 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:34.027081 20031 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.043s	sys 0.101s
I20260709 12:25:34.026010 20126 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:34.063606 15907 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:34.037353 19922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.006s
I20260709 12:25:34.055212 20033 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.055663 19766 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.084583 16490 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:34.075932 19922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.014s	sys 0.006s
I20260709 12:25:34.030295 20129 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.063829 19851 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.956872 15729 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.063643 19713 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:33.954631 20125 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.107617 15950 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.104457 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.112110 19713 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.114302 19713 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:34.114421 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 69339.3us
I20260709 12:25:34.115113 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.117128 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.119616 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:34.125393 15907 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:25:34.122352 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 500647us
I20260709 12:25:34.127696 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:34.054407 19504 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.129777 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.091020 19883 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:34.093317 19794 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.095693 20122 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.138114 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:34.096403 20060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.038s
I20260709 12:25:34.118446 20094 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.151182 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:34.152566 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.153898 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.155085 15803 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.146255 15983 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:34.130683 19798 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.075842 20027 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.161464 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.137710 19851 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.170435 19851 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.170797 19851 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.171954 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:34.173259 20145 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:34.173688 20145 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.174003 20145 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.157497 19713 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.177287 19883 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:34.177490 19713 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.177870 19883 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:34.177821 19851 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.178414 20116 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:34.178956 19883 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.179410 20133 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:34.180013 19851 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:34.181208 20133 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:34.182804 20133 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:34.182505 20142 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:34.183501 20142 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:34.184068 20142 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.184479 20142 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.184900 20142 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.189465 20140 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:34.190574 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.149768 20060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.009s	sys 0.039s
W20260709 12:25:34.201115 19977 consensus_meta.cc:287] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.256s	user 0.012s	sys 0.000s
I20260709 12:25:34.201588 20144 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:34.202190 20144 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.202646 20144 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.178961 20116 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:34.203486 20116 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.201692 19977 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.206710 15837 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.207653 19713 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.209118 20122 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.210152 15829 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 7.
I20260709 12:25:34.211289 20122 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.212016 20060 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:34.212481 19839 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:34.213068 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 117236us
I20260709 12:25:34.213871 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.215526 15879 leader_election.cc:400] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:34.215930 15879 leader_election.cc:403] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:34.150614 19903 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:34.247048 15837 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:34.160238 20094 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:34.253388 15830 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.623s	user 0.004s	sys 0.005s
I20260709 12:25:34.256186 15830 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:34.160118 20141 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:34.258037 20141 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:34.259140 20141 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.256785 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2924) took 1331 ms. Trace:
I20260709 12:25:34.261777 15830 rpcz_store.cc:276] 0709 12:25:32.925661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.295827 (+370166us) service_pool.cc:224] Handling call
0709 12:25:34.256695 (+960868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:34.263010 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.263834 15830 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:34.264799 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:34.277159 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 129245us
I20260709 12:25:34.283102 20118 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:34.218779 20133 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.220268 19839 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.294546 15830 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:34.220882 19648 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:34.159372 19902 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.158003 19794 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.312492 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:34.314646 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.322487 15907 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:34.315263 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 99907.8us
I20260709 12:25:34.304847 20133 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.292526 20094 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.216408 19798 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.328842 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:34.329813 15910 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:34.324354 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:34.336710 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 207019us
W20260709 12:25:34.338439 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 183435us
I20260709 12:25:34.340202 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.340899 16493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 732) took 1156 ms. Trace:
I20260709 12:25:34.339211 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.337471 16460 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.341212 16493 rpcz_store.cc:276] 0709 12:25:33.184416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.184961 (+   545us) service_pool.cc:224] Handling call
0709 12:25:34.340054 (+1155093us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b5800004898. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917ea22 00007f03d20978d9 00007f03d11f1ee0 00007f03d12bb0ab 00007f03d12bb131 00007f03d12690a0 00007f03d1268984 00007f03ca7e36d4 00007f03ca7e3662
0709 12:25:34.340849 (+   795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15677696}
I20260709 12:25:34.336939 19839 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.324252 19977 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.352694 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.317082 20033 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:25:34.359987 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.365945 20129 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.368750 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1943) took 1471 ms. Trace:
I20260709 12:25:34.369149 15835 rpcz_store.cc:276] 0709 12:25:32.896851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.452070 (+555219us) service_pool.cc:224] Handling call
0709 12:25:33.452345 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.016697 (+564352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.016742 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.027247 (+ 10505us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.318669 (+291422us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:34.318716 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.318791 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.368544 (+ 49753us) raft_consensus.cc:1685] finished
0709 12:25:34.368570 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.368695 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9178,"raft.queue_time_us":104537,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":799515,"threads_started":2,"wal-append.queue_time_us":302036}
I20260709 12:25:34.370316 19794 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.371060 19794 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.372259 15835 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:34.373342 20033 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:25:34.373394 15722 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.545s	user 0.000s	sys 0.021s
I20260709 12:25:34.375486 19311 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.380581 15835 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:34.385193 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.387084 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:34.387096 15907 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:34.348703 19648 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.391947 15803 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:34.380930 19932 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.000s
I20260709 12:25:34.405817 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:34.354622 19903 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.410597 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:34.410950 15803 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:34.384317 20137 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:25:34.411713 15911 pending_rounds.cc:85] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 5
I20260709 12:25:34.416231 15911 pending_rounds.cc:107] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:25:34.416730 15911 raft_consensus.cc:2889] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.412266 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:34.384886 20126 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.432184 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.396642 19839 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.433429 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.430256 20141 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:34.438134 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:34.420156 20122 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:34.406541 20132 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.446913 19922 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:34.431821 20061 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:34.459188 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.433775 19932 raft_consensus.cc:2764] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:34.396992 20129 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 12:25:34.477955 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44764.5us
I20260709 12:25:34.482098 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.482897 16495 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:34.444689 19504 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.454939 19947 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:34.443753 19977 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.454316 20132 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.457870 19922 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:34.443826 20122 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.460457 19513 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:34.535053 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.459414 20061 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.544512 20140 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:34.547899 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 106689us
W20260709 12:25:34.517532 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.509804 20117 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.549921 15906 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:34.507119 19839 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.552469 15879 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.509790 19947 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.506085 20031 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:25:34.454679 20148 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 12:25:34.554930 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 106977us
I20260709 12:25:34.547638 20061 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.545925 20122 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.516263 20132 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:34.563231 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 47887.3us
W20260709 12:25:34.566385 20152 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:25:34.567327 20166 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:34.567958 19513 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:34.569775 19922 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.570394 19798 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.570659 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1940) took 1674 ms. Trace:
I20260709 12:25:34.507405 19648 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:25:34.597332 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45039.3us
I20260709 12:25:34.557807 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:34.557235 20147 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.514564 20116 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.558776 19947 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:34.581938 19718 consensus_meta.cc:287] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.003s
I20260709 12:25:34.567286 20142 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.625557 20142 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.625771 20162 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.596881 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.568011 19977 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.626293 20162 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.626691 19977 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.628598 19977 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.577822 19902 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.629786 16487 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:34.631568 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 738) took 1081 ms. Trace:
I20260709 12:25:34.632059 16489 rpcz_store.cc:276] 0709 12:25:33.550564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.559713 (+  9149us) service_pool.cc:224] Handling call
0709 12:25:33.624641 (+ 64928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.630471 (+  5830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.631282 (+1000811us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b54004da3d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:34.631487 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145085312}
I20260709 12:25:34.628443 20162 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:34.634351 15833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2907) took 1781 ms (client timeout 1554 ms). Trace:
W20260709 12:25:34.634763 15833 rpcz_store.cc:269] 0709 12:25:32.852911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.860257 (+  7346us) service_pool.cc:224] Handling call
0709 12:25:34.634154 (+1773897us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540003a2d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:34.634269 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592180480}
I20260709 12:25:34.636744 20144 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.637606 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.636824 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.639322 20147 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.634641 19718 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.641521 20147 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.641235 19718 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.610967 19922 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.644145 19718 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:34.603849 19766 consensus_meta.cc:287] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 12:25:34.644852 19766 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.604106 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.645668 16490 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:34.645951 19513 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:34.646106 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46312.3us
I20260709 12:25:34.646939 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.647650 19513 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.568713 19839 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.604297 19798 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.556686 20117 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.607154 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 755) took 1010 ms. Trace:
I20260709 12:25:34.594453 15832 rpcz_store.cc:276] 0709 12:25:32.895980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.441965 (+545985us) service_pool.cc:224] Handling call
0709 12:25:33.452134 (+ 10169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.858283 (+406149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.858311 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.858790 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.133014 (+274224us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:34.133079 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.133153 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.570369 (+437216us) raft_consensus.cc:1685] finished
0709 12:25:34.570394 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.570567 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9308,"raft.queue_time_us":85213,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9780,"thread_start_us":578262,"threads_started":2,"wal-append.queue_time_us":529977}
I20260709 12:25:34.603570 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.620437 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1939) took 1731 ms. Trace:
I20260709 12:25:34.606791 20126 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:34.624833 20094 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.617690 20122 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.602267 15722 maintenance_manager.cc:643] P 7d3391ee630646ccabf92830e1028bc1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.185s	user 0.162s	sys 0.094s Metrics: {"bytes_written":29270,"cfile_init":1,"dirs.queue_time_us":82238,"dirs.run_cpu_time_us":537,"dirs.run_wall_time_us":1048,"drs_written":1,"lbm_read_time_us":23705,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":28803,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":63,"thread_start_us":339525,"threads_started":2,"wal-append.queue_time_us":488748}
I20260709 12:25:34.628409 20145 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.591964 19713 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.648988 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.678683 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.651067 16459 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.678961 20033 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:34.679718 15830 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:34.679879 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:34.651384 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:34.681439 15910 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:34.682366 20033 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.682760 20033 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.683095 20033 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.684305 19914 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:34.684793 19914 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:34.559405 19877 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:34.685577 19877 consensus_queue.cc:1243] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:34.686024 19877 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:34.686384 19877 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:34.685801 19914 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.687363 19914 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.687160 19877 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:34.688760 15950 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 2.017s (SENT) [suppressed 21 similar messages]
I20260709 12:25:34.689533 20163 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:34.693109 19713 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.688333 19877 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:34.693994 20115 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.148s	user 0.019s	sys 0.000s
I20260709 12:25:34.694146 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:34.694605 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 91082.1us
I20260709 12:25:34.695060 19798 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:34.695209 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.651775 19839 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.656342 16493 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:34.638962 20144 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.656949 15982 rpcz_store.cc:276] 0709 12:25:33.596513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.596941 (+   428us) service_pool.cc:224] Handling call
0709 12:25:33.597356 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.638633 (+ 41277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.638681 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.733981 (+ 95300us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.107050 (+373069us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:34.108346 (+  1296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.108823 (+   477us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.606940 (+498117us) raft_consensus.cc:1685] finished
0709 12:25:34.606962 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.607098 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76680,"raft.queue_time_us":39804,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":62907,"thread_start_us":201758,"threads_started":1,"wal-append.queue_time_us":584743}
I20260709 12:25:34.731294 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.732017 15982 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.659343 20126 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.659715 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:34.745694 20126 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.745771 20033 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.747128 20027 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.664060 15983 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:34.748519 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.748672 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:34.666189 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1970) took 1038 ms. Trace:
I20260709 12:25:34.749446 15904 raft_consensus.cc:2393] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:34.750077 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.666636 15907 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:34.750411 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.751546 20128 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:34.751955 20128 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:34.752379 20125 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.752722 20128 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.753367 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:34.753739 20128 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.755545 19648 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:34.756044 19648 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:34.737504 20176 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:25:34.700101 15834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2898) took 1928 ms (client timeout 2017 ms). Trace:
I20260709 12:25:34.666829 15832 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:34.757786 15834 rpcz_store.cc:269] 0709 12:25:32.771350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.771493 (+   143us) service_pool.cc:224] Handling call
0709 12:25:34.699951 (+1928458us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54001f04d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:34.700047 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799935744}
I20260709 12:25:34.758862 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.759272 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.730212 20148 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:34.759975 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:34.760272 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.671654 15905 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:34.652809 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:34.672757 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.664410 19311 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.666507 15979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:34.705142 15980 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:34.667330 20094 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.667467 15723 maintenance_manager.cc:419] P 7d3391ee630646ccabf92830e1028bc1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9375 bytes on disk
I20260709 12:25:34.705603 15910 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:34.658396 20117 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:34.705979 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.713917 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:34.658913 15831 rpcz_store.cc:276] 0709 12:25:32.895595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.335051 (+439456us) service_pool.cc:224] Handling call
0709 12:25:33.393574 (+ 58523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.340778 (+947204us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b180047af40. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cc29b060 00007f03cc29bbfb 00007f03cc2a664b
0709 12:25:34.340886 (+   108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.340906 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.359258 (+ 18352us) log.cc:844] Serialized 26 byte log entry
0709 12:25:34.541227 (+181969us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:34.541290 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.541422 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.620159 (+ 78737us) raft_consensus.cc:1685] finished
0709 12:25:34.620180 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.620378 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110598,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":18571,"spinlock_wait_cycles":9296768,"thread_start_us":263291,"threads_started":2,"wal-append.queue_time_us":208307}
I20260709 12:25:34.749054 15983 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.761003 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.762208 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.772298 15981 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.708134 20133 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.721027 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:34.728873 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:34.668936 20122 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.721622 20061 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.736311 20151 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:34.736932 20123 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:34.737386 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:34.781220 15983 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:34.738994 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 874) took 2026 ms. Trace:
I20260709 12:25:34.719880 20129 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.741426 16487 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:34.677018 20178 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:25:34.721900 19932 consensus_queue.cc:1059] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:34.744678 20116 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.756910 19648 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.695922 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 879) took 1496 ms. Trace:
I20260709 12:25:34.761416 15912 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:34.762328 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.766770 16494 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:34.767639 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:34.767966 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:34.751583 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:34.775323 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 55509us
I20260709 12:25:34.763125 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.801154 15987 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:34.801236 15980 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:34.766463 15722 maintenance_manager.cc:643] P 7d3391ee630646ccabf92830e1028bc1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":307,"lbm_reads_lt_1ms":4}
I20260709 12:25:34.774730 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.802238 15834 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:34.714998 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.800630 20129 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.781937 15838 rpcz_store.cc:276] 0709 12:25:32.712474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.833911 (+121437us) service_pool.cc:224] Handling call
0709 12:25:32.845322 (+ 11411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.849230 (+  3908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.849273 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.993639 (+144366us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800167680. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a
0709 12:25:33.002511 (+  8872us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b2c00057528. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:25:33.041536 (+ 39025us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.210156 (+168620us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:33.210213 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.210302 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.693248 (+1482946us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:34.738764 (+ 45516us) raft_consensus.cc:1685] finished
0709 12:25:34.738790 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.738938 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1248,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5305,"spinlock_wait_cycles":52007936,"thread_start_us":83198,"threads_started":1,"wal-append.queue_time_us":379547}
I20260709 12:25:34.804015 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.804540 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.804637 15985 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.781062 19922 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.769337 19800 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.780756 15829 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:34.675128 20145 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.782608 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:34.809612 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 94686.1us
I20260709 12:25:34.810390 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.810534 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:34.810750 16492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 727) took 1786 ms (client timeout 2136 ms). Trace:
I20260709 12:25:34.783272 15979 raft_consensus.cc:606] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:34.808434 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:34.811097 16492 rpcz_store.cc:269] 0709 12:25:33.024840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.025019 (+   179us) service_pool.cc:224] Handling call
0709 12:25:34.810584 (+1785565us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540066a3d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:34.810698 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107189504}
I20260709 12:25:34.795125 15837 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:34.766940 20094 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:34.763007 20002 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.797487 15836 rpcz_store.cc:276] 0709 12:25:33.199246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.491644 (+292398us) service_pool.cc:224] Handling call
0709 12:25:33.491872 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.586257 (+ 94385us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:33.990014 (+403757us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.307569 (+317555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.307617 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:34.307658 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.695050 (+387392us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b1800330d00. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419
0709 12:25:34.695656 (+   606us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b540003b1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:34.695710 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.695856 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3222,"prepare.queue_time_us":430136,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2760,"raft.queue_time_us":330,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4892,"spinlock_wait_cycles":207711360,"thread_start_us":630476,"threads_started":2,"wal-append.queue_time_us":350952}
I20260709 12:25:34.760267 20033 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:34.809805 15831 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:34.749243 15988 rpcz_store.cc:276] 0709 12:25:33.627914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.868983 (+241069us) service_pool.cc:224] Handling call
0709 12:25:33.905594 (+ 36611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.027599 (+122005us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:34.308125 (+280526us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.405944 (+ 97819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.405989 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:34.406041 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.658697 (+252656us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b48000cded8. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d11ccaa1 00007f03d11c3b37 00007f03d11c39ca 00007f03d12bb26f 00007f03d12baf37 00007f03d12cf55c 00007f03d12cf508 00007f03d12cf488 00007f03d12cf443 00007f03d12ce6ec 00007f03d01f8a96
0709 12:25:34.665929 (+  7232us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000136d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:34.665989 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.666140 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21037,"prepare.queue_time_us":8806,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":27967,"raft.run_cpu_time_us":2543,"raft.run_wall_time_us":242658,"spinlock_wait_cycles":310595200,"thread_start_us":265832,"threads_started":2,"wal-append.queue_time_us":302956}
I20260709 12:25:34.811236 15979 raft_consensus.cc:614] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:34.812753 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.818351 16487 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:34.797254 20060 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:34.813829 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.814111 19718 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:34.766351 19839 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:25:34.818846 15983 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
W20260709 12:25:34.788777 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 51456.4us
I20260709 12:25:34.816263 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:34.766489 20117 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:34.836972 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.792764 20031 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:25:34.809234 19922 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:34.762184 19311 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.797545 20123 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:34.797164 19851 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.813890 20001 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.844156 15980 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.838719 15987 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 15: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:34.843629 15803 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:34.809208 19513 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.814284 20125 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:34.852253 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.811110 20122 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:34.866626 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:34.872078 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.876098 16488 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.876535 15983 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:34.857542 20033 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.813832 19561 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.077s
W20260709 12:25:34.870528 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 181775us
I20260709 12:25:34.875389 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:34.858467 19922 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.872942 16489 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
W20260709 12:25:34.870545 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 103826us
I20260709 12:25:34.870671 15803 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:34.867300 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.852862 19932 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:34.860435 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.838068 20002 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.853914 19718 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:34.818908 20094 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.882295 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.855355 20060 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:34.871358 20148 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:34.888788 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 78469.1us
I20260709 12:25:34.855196 20129 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.894800 15987 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:34.899938 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:34.900506 15987 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.876127 19713 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:34.896554 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.890781 19561 consensus_queue.cc:1243] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:34.874758 20125 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.867954 20180 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.839936 20179 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:25:34.926456 19718 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.905848 19713 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.927856 19713 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.924742 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:34.910531 20033 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:34.929754 20033 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.905368 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.932603 15979 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:34.934536 15906 pending_rounds.cc:85] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 10
I20260709 12:25:34.934820 15906 pending_rounds.cc:107] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:25:34.935035 15906 raft_consensus.cc:2889] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.935966 19311 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.900337 19800 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.938321 15979 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:34.876986 19513 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.876868 19851 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.866925 20132 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.901546 20171 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:34.945402 20171 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.945860 20171 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.951543 15835 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:34.951565 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:34.903558 19798 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:25:34.890983 20177 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:34.955202 20177 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.903831 20148 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.960198 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:34.961233 15979 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:34.887450 15982 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:34.909938 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.911777 20123 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.965240 20122 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:34.911929 20060 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:34.965653 20122 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.966048 20122 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.913177 20125 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.914322 20133 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.915645 20061 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:34.917220 20094 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:34.917671 19504 raft_consensus.cc:3055] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:34.968590 19504 raft_consensus.cc:740] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:34.969529 19504 consensus_queue.cc:260] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.970645 19504 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.918254 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:34.918910 20139 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.585s	user 0.001s	sys 0.001s
I20260709 12:25:34.918819 20126 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:34.893703 19932 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:34.974711 19932 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:34.962936 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 60635.9us
W20260709 12:25:34.978199 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 79604.8us
I20260709 12:25:34.978261 15803 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:34.978143 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:34.985702 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:34.986342 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:34.986847 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:34.989279 15876 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:34.987413 15905 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:34.992820 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:34.982190 15981 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:34.998597 15979 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:35.003206 16488 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:35.005950 15984 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:35.007087 15984 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:35.007745 15950 connection.cc:256] RPC call timeout handler was delayed by -1.4655521350000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 12:25:35.010257 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.011178 15981 raft_consensus.cc:2393] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:35.013379 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.008728 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.014168 15837 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:35.015353 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.016016 15837 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:35.018952 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:35.008714 15952 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:35.019641 15803 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:34.991753 20179 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.989653 20177 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.027940 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:35.029057 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:34.999558 19800 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.999143 20061 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:35.002256 19794 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.005656 19977 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.043962 16496 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:35.035087 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.008327 20132 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.049597 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.017004 19902 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.024755 19836 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:35.029939 20179 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.054381 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.063750 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.068079 15905 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:35.065622 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:35.069103 16488 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.069816 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:35.070433 19947 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.072628 19947 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.072399 19902 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.031883 20126 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.086328 15833 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:35.087132 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.017421 20094 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:35.044174 20177 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:35.017463 20147 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:35.025326 19798 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:35.098991 15985 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:35.033643 20191 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:35.043273 19513 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:35.100133 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:35.148430 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 141597us
I20260709 12:25:35.180434 15981 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.097997 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.168233 16493 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:35.177320 15985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:35.184504 15985 raft_consensus.cc:606] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.184937 15985 raft_consensus.cc:614] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:35.032985 20118 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:25:35.185575 16488 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:35.076643 20179 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.076853 20061 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:35.066318 19836 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:35.193666 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95772.9us
I20260709 12:25:35.194720 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.196128 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:35.180389 20115 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:25:35.186434 19947 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.197175 20177 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:35.047392 19794 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.197837 19836 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:35.063251 19977 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.283073 19977 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.285645 19798 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:35.286164 19798 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:35.287175 19798 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.288539 19798 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.187219 20148 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.179559 20129 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.290721 20129 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.170665 20191 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.203578 15985 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:35.203903 15981 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
W20260709 12:25:35.318825 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 124233us
I20260709 12:25:35.319880 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:35.308463 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 288886us
I20260709 12:25:35.308167 15987 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:35.311386 15988 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:35.372517 15981 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:35.170342 20033 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:35.385581 15980 consensus_meta.cc:287] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.003s
I20260709 12:25:35.386662 15980 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:35.388175 15985 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:25:35.203806 19914 consensus_meta.cc:287] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.005s
W20260709 12:25:35.203938 20201 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:25:35.394225 15981 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:35.198051 20061 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.251766 20180 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.250231 19902 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.210289 20192 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.370505 19839 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.318390 19513 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.237391 20193 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.318866 20191 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.381366 20142 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.275127 19794 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.413053 15981 raft_consensus.cc:1240] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:35.390591 20126 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:35.260085 19922 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.401734 20033 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.212014 20125 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.400681 20132 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.249641 19947 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.430182 15988 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:25:35.415773 20129 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.408954 20061 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.395509 20176 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:35.424081 15980 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:25:35.391302 20097 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:35.213166 20189 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.384s
W20260709 12:25:35.437979 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:35.428766 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 409857us
I20260709 12:25:35.455832 15830 raft_consensus.cc:2368] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10.
I20260709 12:25:35.405469 20128 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 12:25:35.444155 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 124392us
I20260709 12:25:35.433836 20002 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.460304 15950 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.251380 20177 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.448057 16487 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:35.435377 20180 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.466351 15950 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:35.472236 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:35.432013 19513 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.468586 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:35.435575 20142 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.437055 20126 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.513634 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.566711 15980 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:35.459070 19713 consensus_meta.cc:287] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.002s
I20260709 12:25:35.555722 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.556860 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:35.473479 19839 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.559749 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:35.560583 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 92057.1us
W20260709 12:25:35.568284 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 387226us
I20260709 12:25:35.515249 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:35.442416 20033 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.583129 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:35.586203 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.470427 20147 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:35.583994 15905 raft_consensus.cc:1217] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 12:25:35.476341 19648 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:35.514688 20193 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.549656 20117 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:35.585960 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:35.563371 19932 consensus_meta.cc:287] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.001s
I20260709 12:25:35.677549 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.677929 15905 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:35.447798 20132 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:35.580225 20152 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:35.678870 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.542424 19794 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.677207 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:35.688844 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.513005 20002 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 12:25:35.687103 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.690304 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:35.692157 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 177173us
I20260709 12:25:35.580427 20180 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 12:25:35.754161 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:35.755013 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:35.755188 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.692276 15908 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:35.714911 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 129023us
I20260709 12:25:35.726008 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.759335 15980 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:35.676615 20147 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:35.760280 15905 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:35.769543 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:35.677842 20128 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:35.685647 20148 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:35.825536 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.678058 19648 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:35.826210 15980 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:35.828809 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.827157 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:35.683779 20117 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.832813 15905 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:35.691524 19504 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.833616 20126 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.857146 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:35.834592 20132 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.765376 19794 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:35.828554 19836 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 12:25:35.824374 20193 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:25:35.837145 20215 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.837275 19947 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:35.838274 20171 consensus_meta.cc:287] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.001s
W20260709 12:25:35.839015 20206 log.cc:927] Time spent T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:25:35.840130 20033 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:35.857897 20140 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:35.850033 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:35.833280 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 764) took 1105 ms. Trace:
I20260709 12:25:35.941152 15986 rpcz_store.cc:276] 0709 12:25:34.723877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.749861 (+ 25984us) service_pool.cc:224] Handling call
0709 12:25:35.829111 (+1079250us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001b8354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:35.829408 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286826240}
I20260709 12:25:35.942685 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.943373 15986 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:35.944343 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.850927 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:35.674135 19713 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.945574 15980 raft_consensus.cc:2393] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 15: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:35.946702 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:35.947105 19713 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.851327 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.947916 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:35.913290 20147 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:35.916858 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 161875us
I20260709 12:25:35.894479 19504 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.915460 20162 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:35.861636 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.838284 19513 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.955967 20162 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:35.960206 20162 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.961277 20162 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:35.962839 19504 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.894919 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.964636 15838 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:35.894919 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:35.966331 15835 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:35.852643 19800 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.817s	user 0.001s	sys 0.009s
I20260709 12:25:35.739555 19932 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.969348 19800 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.970717 19932 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.865460 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.913125 20209 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:35.910049 20217 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.232s
W20260709 12:25:35.914214 20199 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:25:35.974093 20194 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.531s	user 0.001s	sys 0.001s
I20260709 12:25:35.975044 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 796) took 1044 ms. Trace:
I20260709 12:25:35.865242 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.949765 20142 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.976042 15836 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:35.977133 15836 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:35.978114 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1979) took 1094 ms. Trace:
I20260709 12:25:35.978955 15982 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:35.979848 20147 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.954082 20033 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:35.981500 20033 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:35.981973 20033 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:35.761734 20180 consensus_queue.cc:1243] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:35.934775 20061 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:35.989210 20061 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.989850 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:35.990432 15837 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:35.978615 15987 rpcz_store.cc:276] 0709 12:25:34.883258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.389590 (+506332us) service_pool.cc:224] Handling call
0709 12:25:35.389940 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.581628 (+191688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.581675 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.589397 (+  7722us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.827267 (+237870us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:35.827332 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.827426 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.977864 (+150438us) raft_consensus.cc:1685] finished
0709 12:25:35.977891 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.978046 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41884,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4867,"thread_start_us":276996,"threads_started":2,"wal-append.queue_time_us":263710}
W20260709 12:25:35.999473 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.000114 15835 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:35.950855 20140 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:35.948904 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.851670 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:35.865069 19922 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:35.949986 15831 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:35.894497 20125 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:35.832027 20128 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:35.952332 15986 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:36.020459 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:35.864874 20211 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:35.953742 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:35.938472 20171 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:35.851778 20117 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.975430 15906 rpcz_store.cc:276] 0709 12:25:34.930399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.932807 (+  2408us) service_pool.cc:224] Handling call
0709 12:25:34.934350 (+  1543us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:34.959267 (+ 24917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.959303 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:34.987971 (+ 28668us) log.cc:844] Serialized 52 byte log entry
0709 12:25:35.445981 (+458010us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:35.446036 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.446126 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.974798 (+528672us) raft_consensus.cc:1685] finished
0709 12:25:35.974822 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.974974 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23550,"raft.queue_time_us":23701,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":421770,"threads_started":1,"wal-append.queue_time_us":732622}
W20260709 12:25:36.008371 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.009413 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:36.028391 16496 raft_consensus.cc:2368] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:36.011147 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:36.029102 15988 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.013458 15904 raft_consensus.cc:2368] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
W20260709 12:25:36.016399 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 157859us
I20260709 12:25:36.018280 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:36.023540 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:36.024524 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 70900.5us
I20260709 12:25:36.030791 16488 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:36.031543 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:36.031544 15906 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:25:36.011968 20179 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.795s	user 0.005s	sys 0.006s
I20260709 12:25:36.033857 15904 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:36.036361 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:36.037334 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:36.027190 20148 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:36.035483 19513 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.043881 20128 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.044055 19513 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.046531 19513 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.047425 19851 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:36.048434 20171 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.049130 15832 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:36.049727 16488 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:36.050130 20189 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:36.050549 20189 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:36.050604 16492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 740) took 1199 ms. Trace:
I20260709 12:25:36.051419 20189 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:36.054563 20224 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:25:36.055038 20117 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.035796 20211 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:36.057123 20117 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:36.058498 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2833) took 1671 ms. Trace:
I20260709 12:25:36.059985 20129 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.060187 20223 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:36.058943 15911 rpcz_store.cc:276] 0709 12:25:34.386986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.387139 (+   153us) service_pool.cc:224] Handling call
0709 12:25:34.411506 (+ 24367us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:34.435786 (+ 24280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.435822 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:34.445846 (+ 10024us) log.cc:844] Serialized 78 byte log entry
0709 12:25:34.838835 (+392989us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:34.863505 (+ 24670us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.870424 (+  6919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.870500 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.971186 (+1100686us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b18001017a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:36.052249 (+ 81063us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18001017a0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:36.058203 (+  5954us) raft_consensus.cc:1685] finished
0709 12:25:36.058231 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.058426 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21648,"prepare.queue_time_us":18008,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":7083,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":24783,"spinlock_wait_cycles":25856000,"thread_start_us":326895,"threads_started":1,"wal-append.queue_time_us":411207}
I20260709 12:25:36.061453 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2842) took 1079 ms. Trace:
I20260709 12:25:36.035961 20180 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:36.060037 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:36.069968 20180 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.070398 20180 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.072089 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:36.072677 16486 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:36.073691 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:36.074678 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:36.074975 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:36.065508 15908 raft_consensus.cc:1217] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[10.6-12.7]   Dedup: 10.6->[12.7-12.7]
I20260709 12:25:36.075788 16486 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.076073 15908 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:25:36.077692 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:36.069561 15913 rpcz_store.cc:276] 0709 12:25:34.981697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.989858 (+  8161us) service_pool.cc:224] Handling call
0709 12:25:35.011063 (+ 21205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.318242 (+307179us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:35.318273 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.379531 (+ 61258us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.719403 (+339872us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:35.719445 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.719526 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.053884 (+334358us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:36.061094 (+  7210us) raft_consensus.cc:1685] finished
0709 12:25:36.061125 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.061382 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14371,"raft.queue_time_us":43059,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":25603,"spinlock_wait_cycles":22542592,"thread_start_us":592302,"threads_started":2,"wal-append.queue_time_us":560798}
I20260709 12:25:36.078866 15803 leader_election.cc:400] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:36.079170 15803 leader_election.cc:403] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:36.070408 16496 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:36.079653 20162 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:36.079769 15803 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:36.080276 20162 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:36.067677 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:36.080906 20162 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:36.081589 16493 raft_consensus.cc:2410] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:25:36.081259 19648 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.068635 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:36.082230 19648 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:36.068889 20221 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:25:36.060456 20129 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:36.086486 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 741) took 1235 ms. Trace:
I20260709 12:25:35.935592 19836 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.098917 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 2941) took 1086 ms. Trace:
I20260709 12:25:36.099305 15830 rpcz_store.cc:276] 0709 12:25:35.012254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.020023 (+  7769us) service_pool.cc:224] Handling call
0709 12:25:36.098749 (+1078726us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540027f6d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:36.098862 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941739904}
I20260709 12:25:36.088645 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:36.080794 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:36.081305 20162 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.113180 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:36.052881 20189 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.094856 20209 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:36.086848 16487 rpcz_store.cc:276] 0709 12:25:34.851187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.851316 (+   129us) service_pool.cc:224] Handling call
0709 12:25:34.851702 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.464852 (+613150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.086253 (+621401us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400660154. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:36.086422 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370806528}
I20260709 12:25:36.101626 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:36.106758 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:35.935923 20215 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.089531 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:36.117926 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:36.126052 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:36.126525 15950 leader_election.cc:400] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 9. Current term is 10.
W20260709 12:25:36.129951 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.133085 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:36.133797 15837 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:36.134920 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:36.142488 15988 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:36.144282 15835 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:36.105945 20142 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:36.116026 20162 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:36.152640 15980 raft_consensus.cc:606] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:36.153072 15980 raft_consensus.cc:614] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:36.152834 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:36.147723 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:36.155995 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:36.150409 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:36.151650 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:36.129774 20122 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 1.163s	user 0.012s	sys 0.000s
I20260709 12:25:36.161326 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:36.148626 19798 consensus_meta.cc:287] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.860s	user 0.015s	sys 0.001s
I20260709 12:25:36.146410 19851 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:36.143903 20171 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.169927 20171 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.151671 20125 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:36.172454 20125 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.172837 20125 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:36.173414 20209 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.177205 20177 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.177340 20142 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:36.178182 20230 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:25:36.178452 20142 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.179185 20151 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:36.179539 20151 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:36.180269 20151 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:36.181905 20219 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
I20260709 12:25:36.182619 19932 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:36.183225 20192 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:36.183130 19932 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.144119 20117 raft_consensus.cc:2764] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:36.184592 15830 raft_consensus.cc:1217] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[8.8-13.10]   Dedup: 8.8->[11.9-13.10]
I20260709 12:25:36.183254 16489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 658) took 1157 ms. Trace:
I20260709 12:25:36.188953 15830 pending_rounds.cc:85] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 8
I20260709 12:25:36.189330 15830 pending_rounds.cc:107] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:36.189730 15830 raft_consensus.cc:2889] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.087742 20179 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.038455 20148 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.120308 20031 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:36.188957 16489 rpcz_store.cc:276] 0709 12:25:35.025458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.025590 (+   132us) service_pool.cc:224] Handling call
0709 12:25:35.047122 (+ 21532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.425772 (+378650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.425810 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.426392 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.594481 (+168089us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:35.594530 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.594615 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.181078 (+586463us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:36.182988 (+  1910us) raft_consensus.cc:1685] finished
0709 12:25:36.183013 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.183197 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28242,"raft.queue_time_us":941169,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":21524352,"thread_start_us":501237,"threads_started":2,"wal-append.queue_time_us":538629}
I20260709 12:25:36.051100 16492 rpcz_store.cc:276] 0709 12:25:34.850823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.857848 (+  7025us) service_pool.cc:224] Handling call
0709 12:25:34.871366 (+ 13518us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:34.876809 (+  5443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.876838 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:34.897390 (+ 20552us) log.cc:844] Serialized 52 byte log entry
0709 12:25:35.058268 (+160878us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:35.063987 (+  5719us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.973379 (+909392us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:35.987538 (+ 14159us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b180030ee00. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:36.043331 (+ 55793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.043407 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.043447 (+    40us) raft_consensus.cc:1685] finished
0709 12:25:36.043460 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.050543 (+  7083us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14967,"prepare.queue_time_us":9281,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":23697,"raft.queue_time_us":934012,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9725,"spinlock_wait_cycles":13397760,"thread_start_us":210593,"threads_started":2,"wal-append.queue_time_us":503710}
W20260709 12:25:36.195250 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.195065 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:36.193955 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:36.160089 19513 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.191550 19504 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:36.197719 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:36.200791 15913 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:36.199697 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:36.214285 15835 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:36.221261 20204 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:36.221813 20204 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:36.222740 20204 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.227483 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:36.196085 19947 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.237718 15910 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:36.056787 20211 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.204167 20132 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:36.246930 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:36.168027 20122 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.204423 20061 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.229656 19902 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:36.184492 20129 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.282927 16489 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:36.241108 20171 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.249228 19794 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.251462 20132 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.288223 15979 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:36.291816 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 64382.3us
I20260709 12:25:36.249827 20126 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:36.212155 19513 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.298763 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:36.261227 19802 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:36.284746 20191 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.002s
I20260709 12:25:36.305327 15986 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:36.262338 20061 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:36.305930 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:36.242719 20031 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:25:36.236467 19504 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.277081 19902 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.279733 20229 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:36.315762 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:36.316742 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45663us
I20260709 12:25:36.317757 15979 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 14: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:36.317847 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 120236us
I20260709 12:25:36.247107 19947 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.307608 20132 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:36.344310 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 45674.5us
I20260709 12:25:36.345119 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:36.304838 20198 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:36.350497 15911 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:36.349445 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:36.315454 19902 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.355371 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:36.353011 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:36.315053 20126 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:36.314661 20229 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:36.418727 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 73713.7us
I20260709 12:25:36.420696 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:36.421835 20165 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:36.422923 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63241us
W20260709 12:25:36.428565 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 113902us
I20260709 12:25:36.314289 19802 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.352078 20142 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.436772 15950 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:36.355010 20163 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:36.359428 20216 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:36.371893 19794 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.441072 15986 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:36.373903 19836 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.366463 20128 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:36.422660 20118 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:36.430601 19839 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:36.422399 20165 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:36.338601 19922 consensus_queue.cc:1175] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2fa3925738bd485e912c7ac0e28b0265" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:36.316808 20191 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.513101 15913 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:36.514168 20242 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.423933 20229 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.524668 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:36.538403 19932 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.502359 20215 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:36.540376 20240 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:25:36.436376 19561 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
W20260709 12:25:36.539498 20246 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:25:36.559130 20255 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:36.560177 20255 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.560817 19802 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.478888 19311 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:36.513283 20128 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.517560 19713 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:36.517259 19794 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.519927 19851 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.550568 15905 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:36.439558 20123 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:25:36.429339 20061 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.520308 19839 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.554814 15983 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:36.556519 20256 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:36.488700 20142 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.605020 20142 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.605983 15835 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:36.608764 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:36.609434 15829 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:36.609965 20123 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:36.610319 20123 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:36.610617 15829 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:36.611147 20123 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.578598 20128 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.570489 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:36.573190 20239 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:25:36.573741 20129 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.574458 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:36.537932 20252 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:36.755843 15986 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:36.575273 20002 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:36.535627 20118 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:36.524606 20165 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:36.567018 20238 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:25:36.579665 20133 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:25:36.766255 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:36.559118 20215 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:36.601056 20237 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:36.624579 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:36.796823 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 172351us
I20260709 12:25:36.577224 19311 consensus_queue.cc:1243] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:36.565560 20255 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.576719 20122 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:36.752019 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.523985 20216 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.612394 20123 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:36.813201 20235 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:25:36.813133 20128 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.816092 20128 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.759130 20171 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.598495 19839 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:36.767068 15904 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:36.762861 20252 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.758773 20002 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:36.810508 20033 consensus_meta.cc:287] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.006s
I20260709 12:25:36.584933 19713 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:36.784521 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.785445 19504 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.786136 19947 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.789716 20118 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.792717 15986 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:25:36.805945 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1432) took 1043 ms. Trace:
W20260709 12:25:36.819216 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.800956 19648 consensus_meta.cc:287] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.002s
I20260709 12:25:36.550206 20126 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.765607 20061 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.774914 19794 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:36.846966 20261 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:25:36.847258 20002 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:36.848095 20244 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 12:25:36.843538 20171 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.857650 20252 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.852803 20229 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:36.864928 20140 consensus_meta.cc:287] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.000s
W20260709 12:25:36.868981 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 513951us
I20260709 12:25:36.592904 19851 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.808056 20256 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.808241 20214 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:36.874583 15982 rpcz_store.cc:276] 0709 12:25:35.762976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.980096 (+217120us) service_pool.cc:224] Handling call
0709 12:25:35.980350 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.024755 (+ 44405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.024786 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.039076 (+ 14290us) log.cc:844] Serialized 26 byte log entry
0709 12:25:36.164303 (+125227us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:36.164341 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.164404 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.805670 (+641266us) raft_consensus.cc:1685] finished
0709 12:25:36.805700 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.805855 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39820,"raft.queue_time_us":40004,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4924,"thread_start_us":110917,"threads_started":1,"wal-append.queue_time_us":197421}
I20260709 12:25:36.817936 20255 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.568012 20242 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.882825 16495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 747) took 1817 ms. Trace:
I20260709 12:25:36.885766 15986 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:36.887132 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.879339 20181 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:36.872120 20033 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.894016 20171 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.894609 20002 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.817394 20163 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:25:36.879096 19513 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.809558 20215 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.887243 19794 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:36.902585 16495 rpcz_store.cc:276] 0709 12:25:35.065876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.066112 (+   236us) service_pool.cc:224] Handling call
0709 12:25:35.074846 (+  8734us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:35.989286 (+914440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.989314 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:35.990008 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 12:25:36.248532 (+258524us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:36.248582 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.248649 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.882622 (+633973us) raft_consensus.cc:1685] finished
0709 12:25:36.882640 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.882773 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":913965,"raft.queue_time_us":914109,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"thread_start_us":258046,"threads_started":1,"wal-append.queue_time_us":351029}
W20260709 12:25:36.902012 20162 consensus_meta.cc:287] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.000s
I20260709 12:25:36.917951 20191 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:36.915128 20189 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.791s	user 0.000s	sys 0.010s
I20260709 12:25:36.905841 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:36.925374 15829 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:36.919245 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1961) took 1065 ms. Trace:
I20260709 12:25:36.901823 20214 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.926134 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:36.926934 15904 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.904209 20256 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.925830 15831 rpcz_store.cc:276] 0709 12:25:35.854004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.854106 (+   102us) service_pool.cc:224] Handling call
0709 12:25:35.854399 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.016574 (+162175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.919004 (+902430us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b5400125cd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:36.919187 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219304192}
I20260709 12:25:36.935034 15904 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:36.932137 20256 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:36.911257 20255 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.923377 19794 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.937641 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:36.938206 15904 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:36.939154 19851 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.939476 19794 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.934435 20214 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.901858 20140 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:36.927261 20125 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.000s
I20260709 12:25:36.948455 20125 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:36.948770 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:36.928597 20229 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.950456 20125 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.951149 20242 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:36.951934 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:36.952616 20033 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:36.952642 15831 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:36.954336 20243 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.451s	user 0.003s	sys 0.000s
W20260709 12:25:36.953379 20254 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.366s	user 0.000s	sys 0.000s
I20260709 12:25:36.957216 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:36.958331 15904 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 7: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:36.958387 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1977) took 2089 ms. Trace:
I20260709 12:25:36.958889 15985 rpcz_store.cc:276] 0709 12:25:34.870247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.373736 (+503489us) service_pool.cc:224] Handling call
0709 12:25:35.387864 (+ 14128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.388597 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.958189 (+1569592us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b540036f1d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:36.958306 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31712000}
I20260709 12:25:36.938223 20255 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:36.976750 15836 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:36.979012 20140 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:36.974320 19902 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.003s
I20260709 12:25:36.980403 19902 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.981528 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 887) took 2862 ms. Trace:
I20260709 12:25:36.981974 20216 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:36.982416 20132 consensus_meta.cc:287] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.000s
I20260709 12:25:36.983573 20215 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:36.983973 20249 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.442s	user 0.002s	sys 0.007s
I20260709 12:25:36.982319 19902 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:36.982910 20132 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.981869 15833 rpcz_store.cc:276] 0709 12:25:34.118822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.635561 (+516739us) service_pool.cc:224] Handling call
0709 12:25:34.635859 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.100401 (+464542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.981311 (+1880910us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400082354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:36.981461 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007428864}
I20260709 12:25:36.985355 19839 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:36.986595 19713 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:36.987335 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1409) took 2314 ms. Trace:
I20260709 12:25:36.987712 15983 rpcz_store.cc:276] 0709 12:25:34.673326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.887945 (+214619us) service_pool.cc:224] Handling call
0709 12:25:35.829231 (+941286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.589551 (+760320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.986288 (+396737us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54001b8354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:36.987123 (+   835us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001b8350. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:36.987257 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3812237440}
I20260709 12:25:36.994967 15834 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:36.925688 20162 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.004125 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:37.012887 20180 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.942s	user 0.000s	sys 0.010s
I20260709 12:25:36.996973 20141 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:36.987365 19839 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:37.024537 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:37.035778 20151 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.045558 15952 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:37.020258 20180 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:37.052687 20180 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:37.079227 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:37.123867 20268 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:25:37.127656 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.053401 20179 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:37.046511 20217 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:37.138252 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1964) took 1283 ms. Trace:
I20260709 12:25:37.403753 15834 rpcz_store.cc:276] 0709 12:25:35.854844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.854932 (+    88us) service_pool.cc:224] Handling call
0709 12:25:35.855122 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.995431 (+1140309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.138002 (+142571us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400083754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:37.138196 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620796672}
W20260709 12:25:37.147755 20270 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:25:37.126912 20256 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:37.270476 20132 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:37.397879 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 1986) took 2379 ms. Trace:
I20260709 12:25:37.437450 15981 rpcz_store.cc:276] 0709 12:25:35.018385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.450043 (+431658us) service_pool.cc:224] Handling call
0709 12:25:35.450331 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.452371 (+  2040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.452402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.470267 (+ 17865us) log.cc:844] Serialized 26 byte log entry
0709 12:25:36.022999 (+552732us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:36.041129 (+ 18130us) log.cc:844] Serialized 14 byte log entry
0709 12:25:36.105705 (+ 64576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.105801 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.145868 (+1040067us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b180017d820. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:37.319825 (+173957us) raft_consensus.cc:1685] finished
0709 12:25:37.397657 (+ 77832us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.397817 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89020,"prepare.queue_time_us":16489,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":79122,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":105928,"spinlock_wait_cycles":59440896,"thread_start_us":464039,"threads_started":1,"wal-append.queue_time_us":484624}
I20260709 12:25:37.264839 20061 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:37.272161 20215 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:37.405406 19851 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:37.456835 19851 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:37.459606 19851 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:37.410216 20256 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.460367 20256 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:37.346737 20255 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.467877 20255 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.390872 19839 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.469869 19839 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:37.472059 20123 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.002s
I20260709 12:25:37.472522 19839 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:37.475124 20255 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:37.480691 20129 consensus_meta.cc:287] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.000s
I20260709 12:25:37.482514 20215 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.482133 20256 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:37.485481 20061 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:37.486104 20256 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:37.488564 20061 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:37.277994 20217 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.492420 20217 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:37.172672 20165 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.435740 20162 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:37.494251 20214 consensus_meta.cc:287] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.503s	user 0.003s	sys 0.004s
I20260709 12:25:37.541079 20217 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.788719 20217 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.791513 20217 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:37.798157 20215 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:37.529827 20123 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:37.775638 20256 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:37.776021 20163 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:37.873153 20123 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:37.894404 20256 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:38.014376 20151 consensus_meta.cc:287] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.978s	user 0.010s	sys 0.001s
I20260709 12:25:37.925431 20163 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:38.203336 19766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.048s	sys 0.066s
I20260709 12:25:38.135607 20193 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:38.250423 20215 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:38.313288 19766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.048s	sys 0.066s
I20260709 12:25:37.980233 20214 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:38.378285 20215 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:38.394399 20214 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:38.394974 20214 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.395403 20214 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:38.395851 20215 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:38.396351 20215 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:38.398921 20214 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:38.396790 20215 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:38.366907 20193 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:38.418232 20165 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:38.449469 20256 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:38.450438 20215 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:38.465237 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35452 (request call id 28) took 2690 ms. Trace:
I20260709 12:25:38.466382 15980 rpcz_store.cc:276] 0709 12:25:35.740395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.947734 (+207339us) service_pool.cc:224] Handling call
0709 12:25:38.430257 (+2482523us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002788d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc29d853 00007f03d126b60a 00007f03ca7f17d4 00007f03ca7f1762 00007f03ca7f1691 00007f03ca7f160c 00007f03ca7f08c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:38.430372 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462000384}
W20260709 12:25:38.614104 16458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.010s	sys 0.029s
W20260709 12:25:38.614679 16458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.011s	sys 0.029s
W20260709 12:25:38.553817 20223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.020s	sys 0.055s
I20260709 12:25:38.626832 20165 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:38.634831 20223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.020s	sys 0.055s
I20260709 12:25:38.627764 20123 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:38.670846 20165 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:38.873481 20193 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:38.815145 20123 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:38.881250 20163 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:39.013202 20123 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:39.042155 20277 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:25:39.051968 20165 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:39.062865 20123 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:39.365629 19766 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.007s	sys 0.004s
W20260709 12:25:39.366282 19766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.007s	sys 0.004s
W20260709 12:25:39.367807 15952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.009s	sys 0.010s
W20260709 12:25:39.368163 15952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.009s	sys 0.010s
I20260709 12:25:39.369808 20223 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.370421 20223 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.373318 20280 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.373925 20280 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:39.374512 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.011s	sys 0.007s
W20260709 12:25:39.374812 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.011s	sys 0.007s
I20260709 12:25:39.376051 20280 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.373404 20193 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.376765 20193 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.377592 20279 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:39.378101 20279 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.378774 20193 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.380180 20279 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.372857 20223 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.494808 20279 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.495486 20279 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.496716 20223 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:39.496873 20193 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.497438 20193 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.497298 20223 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.497825 20279 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.499625 20193 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.500197 20193 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:39.500259 20223 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.501137 20223 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:39.500830 20193 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.501811 20223 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.503129 20193 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:39.504220 15950 connection.cc:256] RPC call timeout handler was delayed by -1.9901639770000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:25:39.504417 20223 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.504952 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:39.506705 20193 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.508358 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:39.510322 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.510263 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:39.511886 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:39.513952 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:39.514765 16495 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:39.514613 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.515338 16490 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 5.
I20260709 12:25:39.516860 20280 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.518688 20280 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:39.520010 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.520323 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.522462 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.522801 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.523350 16495 raft_consensus.cc:2410] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:39.525108 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.531068 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.531993 16495 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:39.532198 15909 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:25:39.532707 15909 pending_rounds.cc:85] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 7
I20260709 12:25:39.532953 15909 pending_rounds.cc:107] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:25:39.533209 15909 raft_consensus.cc:2889] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.535544 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 803) took 3226 ms. Trace:
I20260709 12:25:39.535871 15909 rpcz_store.cc:276] 0709 12:25:36.308828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.311816 (+  2988us) service_pool.cc:224] Handling call
0709 12:25:36.312124 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.533637 (+3221513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.535289 (+  1652us) spinlock_profiling.cc:243] Waited 3.22 s on lock 0x7b54003bf1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:39.535468 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7404510080}
I20260709 12:25:39.536423 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.537310 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.537703 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.538076 20280 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.538429 16489 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:39.538594 20280 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.539645 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.542979 20284 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.543512 20284 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.545322 15834 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:39.545430 20284 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:39.546547 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.548048 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.549237 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.549942 15834 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:39.550081 20279 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:39.550868 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.551618 15834 raft_consensus.cc:2393] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:39.553776 15907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1446) took 3967 ms (client timeout 1646 ms). Trace:
W20260709 12:25:39.554322 15907 rpcz_store.cc:269] 0709 12:25:35.586534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.677292 (+ 90758us) service_pool.cc:224] Handling call
0709 12:25:39.553475 (+3876183us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400431054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:39.553658 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670052736}
I20260709 12:25:39.556829 20283 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.559214 20223 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.559840 20223 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.562389 20280 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.562871 20280 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:39.563295 20280 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.557581 20283 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.566874 20283 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:39.569525 15802 connection.cc:256] RPC call timeout handler was delayed by -2.3199405679997653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2766s for a response
I20260709 12:25:39.569734 20289 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:39.570314 15802 connection.cc:256] RPC call timeout handler was delayed by -2.1183405679998941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29900000000000004s for a response
I20260709 12:25:39.570279 20289 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.569092 20284 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.571827 20284 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.574055 20284 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.578524 20223 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:39.579622 20250 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 3.001s	user 0.019s	sys 0.017s
I20260709 12:25:39.580515 20289 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.598366 20280 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.601866 20284 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.602506 20284 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.604625 20284 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:39.608574 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:39.611130 15802 connection.cc:256] RPC call timeout handler was delayed by -2.0420722199996817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:25:39.611681 15802 connection.cc:256] RPC call timeout handler was delayed by -2.0006722199996148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:25:39.612082 15802 connection.cc:256] RPC call timeout handler was delayed by -1.9097722199994678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 12:25:39.612687 20284 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:39.613696 15802 connection.cc:256] RPC call timeout handler was delayed by -1.839572219999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 12:25:39.613334 20284 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.615971 20284 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:39.616387 15802 connection.cc:256] RPC call timeout handler was delayed by -1.8035722199997508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:25:39.616770 15802 connection.cc:256] RPC call timeout handler was delayed by -1.7621722199996839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:25:39.617053 15802 connection.cc:256] RPC call timeout handler was delayed by -1.5290722199997617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 12:25:39.617468 15802 connection.cc:256] RPC call timeout handler was delayed by -1.5182722199997443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:25:39.618443 15802 connection.cc:256] RPC call timeout handler was delayed by -1.4948005729997931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:25:39.618824 15802 connection.cc:256] RPC call timeout handler was delayed by -1.493972219999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:25:39.619378 15802 connection.cc:256] RPC call timeout handler was delayed by -1.3652722199994969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2316s for a response
W20260709 12:25:39.621433 15802 connection.cc:256] RPC call timeout handler was delayed by -1.2362022060001436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 12:25:39.623998 15802 connection.cc:256] RPC call timeout handler was delayed by -1.1443464139997559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:25:39.624342 15802 connection.cc:256] RPC call timeout handler was delayed by -1.1066022059999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 12:25:39.624650 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0474670119997427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:25:39.624948 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0366739469995991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:25:39.625277 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0309464140000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 12:25:39.625560 15802 connection.cc:256] RPC call timeout handler was delayed by -1.0309464140000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 12:25:39.630944 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.631848 15829 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:39.633209 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.634104 15829 raft_consensus.cc:2410] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:39.635666 15829 pending_rounds.cc:85] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:39.636008 15829 pending_rounds.cc:107] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:39.636317 15829 raft_consensus.cc:2889] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.639376 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.640558 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.649101 15834 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:39.650177 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.651242 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.651854 15834 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:39.651944 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 896) took 3333 ms. Trace:
I20260709 12:25:39.657186 15838 rpcz_store.cc:276] 0709 12:25:36.318592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.319009 (+   417us) service_pool.cc:224] Handling call
0709 12:25:36.319259 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.347607 (+ 28348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.347644 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.347689 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:36.347737 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.651729 (+3303992us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5400083254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:39.651774 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.651892 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64742144}
I20260709 12:25:39.658613 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.659147 15838 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:39.660056 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.656371 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.660957 15829 raft_consensus.cc:2393] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:39.661192 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.661738 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.662308 15829 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:39.652817 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.663070 15834 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:39.663220 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.664058 15829 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:39.664954 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.665560 15829 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:39.663882 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.661762 15838 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:39.668191 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.668928 15838 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:39.669680 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:39.669852 15910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1459) took 3919 ms (client timeout 2049 ms). Trace:
I20260709 12:25:39.670240 15838 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 6.
I20260709 12:25:39.671042 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.671530 15838 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:39.672685 15829 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:39.673136 15834 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.673555 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.674109 15829 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:39.674865 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.675364 15829 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:39.675922 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:39.676152 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.676473 15837 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:39.677265 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.677802 15829 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:39.687333 20280 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:39.687867 20280 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.688213 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.688365 15953 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:39.689191 20218 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:39.689287 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:39.689760 20218 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.690174 20193 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:39.690713 20193 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.691416 15953 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:39.689779 20280 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.691787 20218 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.692442 20218 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.692759 20283 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.693130 20193 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.693189 20287 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:39.670240 15910 rpcz_store.cc:269] 0709 12:25:35.750262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.769315 (+ 19053us) service_pool.cc:224] Handling call
0709 12:25:39.669693 (+3900378us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540010ca54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:39.669792 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848094592}
I20260709 12:25:39.693778 20287 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:39.694193 20287 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.694224 20280 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:39.694804 20280 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.695117 20280 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:39.696415 15834 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:39.688799 16495 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:39.692966 20218 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.699720 15838 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:39.700034 20218 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:39.703123 15953 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:39.703991 20218 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:39.704417 20218 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.704808 20218 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.706081 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 800) took 3488 ms. Trace:
I20260709 12:25:39.706439 15913 rpcz_store.cc:276] 0709 12:25:36.217730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.218091 (+   361us) service_pool.cc:224] Handling call
0709 12:25:36.242441 (+ 24350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.534912 (+292471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.705870 (+3170958us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54001964d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:39.706027 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621943552}
I20260709 12:25:39.711169 20287 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.713562 20287 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.714946 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:39.715704 16495 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.723075 20284 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.723564 20284 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.723899 20218 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.724169 20280 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.725906 20218 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:39.727109 15802 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.502s (SENT)
I20260709 12:25:39.727560 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:39.705077 15837 raft_consensus.cc:2468] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:39.734511 20289 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.735824 20284 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:39.740381 15802 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.564s (SENT) [suppressed 8 similar messages]
I20260709 12:25:39.744292 20280 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:39.750600 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:39.751353 16490 raft_consensus.cc:2393] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:39.754341 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:39.755144 15833 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:39.758626 16495 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:39.759688 15953 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:39.760869 20192 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:39.761359 20192 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:39.762264 20192 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:39.772141 20275 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.223s	user 0.007s	sys 0.010s
I20260709 12:25:39.774200 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 779) took 3481 ms. Trace:
I20260709 12:25:39.774605 15988 rpcz_store.cc:276] 0709 12:25:36.292384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.562597 (+270213us) service_pool.cc:224] Handling call
0709 12:25:36.582874 (+ 20277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.934484 (+351610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.934515 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.934555 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:36.934584 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.773971 (+2839387us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400206554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:39.774018 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.774141 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808168832}
I20260709 12:25:39.780113 16457 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:39.755156 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:39.781016 16490 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.782850 20241 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:39.783390 20241 raft_consensus.cc:697] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:39.784262 20241 consensus_queue.cc:237] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.785683 20118 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:39.786204 20118 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:39.789249 16490 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:39.790432 15953 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:39.791354 20280 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:39.791882 20280 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:39.792723 20280 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.794456 20118 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:39.803009 20118 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:39.831864 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 91503.3us
W20260709 12:25:39.835975 15802 leader_election.cc:336] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.646s (SENT)
W20260709 12:25:39.838687 15802 leader_election.cc:336] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 1.840s (SENT)
W20260709 12:25:39.834843 20294 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:39.857515 20284 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:39.857784 20295 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:39.858938 20284 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:39.859311 20284 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:39.860733 20284 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:39.861964 20284 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:39.865161 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.870157 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.890722 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.972256 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:40.002023 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.133384 20301 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.134641 20301 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:40.137595 20298 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:25:40.169392 20300 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.170148 20300 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.172762 20300 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.173575 20301 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.189714 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.265165 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.265829 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.267295 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.268605 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.244962 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.246693 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.269608 15909 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:40.270318 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.270753 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.271373 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.271978 15911 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:40.272128 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.272791 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.272927 15909 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:40.243841 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.269580 15913 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:40.274150 15907 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:40.265877 15904 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:40.279687 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:40.279973 15876 connection.cc:256] RPC call timeout handler was delayed by -2.5672987969996939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:25:40.280359 15876 connection.cc:256] RPC call timeout handler was delayed by -2.5298972339996908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 12:25:40.280464 20300 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.280681 15876 connection.cc:256] RPC call timeout handler was delayed by -2.5082972339996559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 12:25:40.281054 15876 connection.cc:256] RPC call timeout handler was delayed by -2.4146972339999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:25:40.281452 15876 connection.cc:256] RPC call timeout handler was delayed by -2.2094972339996275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 12:25:40.281081 20300 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:40.281772 15876 connection.cc:256] RPC call timeout handler was delayed by -2.2036987969995607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:25:40.282125 15876 connection.cc:256] RPC call timeout handler was delayed by -2.1757987969995156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 12:25:40.282430 15876 connection.cc:256] RPC call timeout handler was delayed by -2.0992987969998467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:25:40.282716 15876 connection.cc:256] RPC call timeout handler was delayed by -1.9291987969995716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:25:40.283032 15876 connection.cc:256] RPC call timeout handler was delayed by -1.8863972340000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23550000000000001s for a response
I20260709 12:25:40.284063 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.287109 15904 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:40.283625 20300 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:40.290453 20209 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.007s	sys 0.008s
W20260709 12:25:40.291615 20209 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.008s	sys 0.009s
I20260709 12:25:40.285697 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 898) took 3928 ms. Trace:
I20260709 12:25:40.292750 15835 rpcz_store.cc:276] 0709 12:25:36.357064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.560433 (+203369us) service_pool.cc:224] Handling call
0709 12:25:36.560702 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.606348 (+ 45646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.285467 (+3679119us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54001252d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:40.285641 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103196416}
I20260709 12:25:40.301223 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.301435 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.301806 15833 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:40.302608 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:40.302822 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.303076 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.303609 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:40.304100 15833 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.304258 15831 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:40.304591 15831 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:40.305296 15831 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.305341 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.308228 15837 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:40.308388 15831 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.306321 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.306931 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.307559 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.309446 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.309468 15829 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:40.311987 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.312923 15907 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:40.313437 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.314002 15906 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:40.314251 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.315730 15907 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:40.317255 20192 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.317721 20192 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.319738 20192 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:40.320129 15833 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:40.320737 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:40.322016 20280 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.317983 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.323848 15832 raft_consensus.cc:2368] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7.
I20260709 12:25:40.325829 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.326411 15912 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.329668 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.330425 15907 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:40.332195 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.333173 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:40.333487 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.334121 15906 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:40.334443 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:40.335602 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.335636 15950 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:40.337792 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.339108 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.340281 20280 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.340593 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.342163 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.342754 15906 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:40.346092 20009 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.346633 20009 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:40.347756 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 48078.5us
I20260709 12:25:40.348201 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.349550 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.350196 16457 leader_election.cc:400] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7.
W20260709 12:25:40.350262 16460 connection.cc:256] RPC call timeout handler was delayed by -1.445915301000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2537s for a response
I20260709 12:25:40.333174 15907 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:40.350687 16457 leader_election.cc:403] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:40.351884 15912 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:40.357443 20241 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.351897 20124 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:25:40.340953 20280 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.360970 20280 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:40.361491 20280 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:40.362421 20280 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:40.364171 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1461) took 4542 ms (client timeout 2139 ms). Trace:
I20260709 12:25:40.365839 15831 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:40.351172 20118 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.366654 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.366937 15906 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:40.366564 20118 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:40.367558 15878 connection.cc:256] RPC call timeout handler was delayed by -3.0270047349999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:25:40.368321 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.369266 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.369513 20301 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.369879 15912 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:40.370162 20301 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.371177 15904 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:40.372530 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.372717 20303 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.373119 15904 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:40.373394 20303 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.374059 20009 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:40.374771 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.351500 20236 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:40.376888 20236 consensus_queue.cc:1243] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:40.377195 20302 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.369266 20118 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.377796 20302 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.378571 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.380196 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:40.364540 15905 rpcz_store.cc:269] 0709 12:25:35.821667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.849773 (+ 28106us) service_pool.cc:224] Handling call
0709 12:25:40.363987 (+4514214us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400072e54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:40.364086 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980578560}
I20260709 12:25:40.349205 20192 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.381652 15913 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:40.376422 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.381999 15913 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:40.382113 20305 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.382794 15913 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.383814 15913 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.384362 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:40.386101 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.382699 20305 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.380236 20302 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.387514 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.396441 15905 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.380899 15912 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
W20260709 12:25:40.388437 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52878.7us
I20260709 12:25:40.376578 20303 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:40.399768 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:40.401717 15904 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:40.405073 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.405824 15835 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:40.405118 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.409405 15835 pending_rounds.cc:85] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 8
I20260709 12:25:40.409762 15835 pending_rounds.cc:107] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:40.410051 15835 raft_consensus.cc:2889] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:40.412591 15905 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:40.414669 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:40.415040 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:40.418571 15831 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:40.419821 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:40.412803 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:40.372550 20301 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:40.421764 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.394910 20300 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.429711 20303 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.430250 20303 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.433105 20309 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:40.433526 20309 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.435524 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.405944 20302 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.438697 20302 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.439265 20305 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:40.433837 20309 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.440727 20302 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.413443 20192 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:40.448554 20192 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:40.448966 20192 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.441548 20241 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7.
I20260709 12:25:40.436508 20300 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.443311 20308 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:40.451265 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 97798.2us
I20260709 12:25:40.432884 20303 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:40.457108 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:40.457929 15910 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:40.453691 20308 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:40.461330 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:40.461256 20280 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.463624 20308 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.475178 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 1973) took 4517 ms. Trace:
I20260709 12:25:40.475556 15836 rpcz_store.cc:276] 0709 12:25:35.957775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.979307 (+ 21532us) service_pool.cc:224] Handling call
0709 12:25:35.979533 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.977222 (+997689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.474900 (+3497678us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400039dd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:40.475092 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292858240}
I20260709 12:25:40.466055 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.492900 20192 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:40.493510 15952 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.006s	sys 0.015s
I20260709 12:25:40.498420 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:40.629933 16492 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:40.635601 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:40.502795 20223 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:40.638162 20223 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:40.637410 20309 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.638602 20223 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.640789 20309 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:40.543387 20300 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:40.644191 20192 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:40.647418 20269 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 3.596s	user 0.021s	sys 0.023s
I20260709 12:25:40.649662 20223 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.651862 20223 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:40.668845 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.656774 20308 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:40.855000 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.928042 20280 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.944649 20308 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:40.951001 15803 connection.cc:256] RPC call timeout handler was delayed by -2.8917368729999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 12:25:40.951040 20284 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.951615 15803 connection.cc:256] RPC call timeout handler was delayed by -2.6415879830001359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:25:40.952148 15803 connection.cc:256] RPC call timeout handler was delayed by -1.6569879830003629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2999s for a response
I20260709 12:25:40.952019 20284 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.954080 20284 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:40.957963 20284 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:40.958779 20284 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:40.959156 20284 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:40.959971 20284 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:40.961306 20284 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.974596 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:40.975692 20300 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:40.976094 20300 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:40.976475 20300 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.977245 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:40.978024 20230 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:40.978387 20230 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:40.978754 20230 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.987557 20230 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:40.989823 20313 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:40.991950 20230 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.992686 20230 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:40.993129 20230 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:40.994378 20230 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.008020 20300 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.010398 20300 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.012995 20321 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:25:41.017431 20300 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:41.029139 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.029641 20322 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:41.031059 20322 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.031939 20322 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.033532 20322 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:41.045172 20308 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.045735 20308 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.047672 20308 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.097419 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.098302 15833 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:41.098945 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.099308 15833 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.103474 15833 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:41.104200 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.105300 15833 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 14: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.106024 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.107887 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.108829 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.109264 15833 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:41.109916 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.110057 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.110966 20322 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:41.111008 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.111789 20322 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.112287 20322 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.112331 15833 raft_consensus.cc:2368] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:41.113456 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.114434 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.115229 15833 raft_consensus.cc:2368] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
I20260709 12:25:41.116375 15876 leader_election.cc:400] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
I20260709 12:25:41.116498 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.116748 15876 leader_election.cc:403] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:41.117202 15833 raft_consensus.cc:2368] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:41.118063 15876 leader_election.cc:400] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:41.118206 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.118415 15876 leader_election.cc:403] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:41.119134 20300 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:41.119511 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.119625 20322 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.121213 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.119123 20323 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.122594 20322 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.123431 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.123778 15833 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.124366 20230 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:41.128620 20323 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
I20260709 12:25:41.129503 15833 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:25:41.128908 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.130542 15912 raft_consensus.cc:2368] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 15. Current term is 16.
I20260709 12:25:41.130613 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.131354 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.131830 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.132352 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.132531 20323 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:41.132920 15912 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:41.132982 20323 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:40.498710 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.133796 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.134277 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.133852 20323 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.134765 15907 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:41.134816 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.135721 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.132357 15833 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:41.136941 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.136742 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.138692 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.139158 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.139748 15833 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:41.139904 15907 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:41.140749 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.141075 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.141541 20322 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:41.142197 20322 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.142035 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.142616 20322 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.143043 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.143653 15907 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
W20260709 12:25:41.143901 15952 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.620s	user 0.012s	sys 0.025s
I20260709 12:25:41.144039 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:41.144254 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 1.62002e+06us
I20260709 12:25:41.145144 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.145871 15907 raft_consensus.cc:2368] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14.
I20260709 12:25:41.145753 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.146759 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.146963 15833 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:41.147447 15907 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 7.
I20260709 12:25:41.148298 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.148664 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:41.150185 15912 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:41.150753 15833 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:25:41.151257 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.151800 15912 raft_consensus.cc:2376] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10. Re-sending same reply.
I20260709 12:25:41.151991 15833 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:41.152298 20230 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:41.153317 15833 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:41.153612 20300 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:41.154584 20322 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.156077 15907 raft_consensus.cc:2368] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15.
I20260709 12:25:41.156558 20322 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.158380 20322 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:41.159176 20322 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.159518 20322 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.160311 20322 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.161484 20322 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.152595 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.163578 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.164470 15912 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:41.164800 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.165705 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.165838 20308 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.167142 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.167444 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.168433 20308 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.168565 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.169440 15912 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:41.170475 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.171772 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.178560 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.181285 20308 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.185313 20308 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.185788 20308 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.186115 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.187151 15912 raft_consensus.cc:2410] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:41.182776 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:41.188426 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.189131 15912 raft_consensus.cc:2368] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
I20260709 12:25:41.188951 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.189951 20308 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.190864 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.191114 20308 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:41.191310 15831 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 16. Ops: []
I20260709 12:25:41.191870 15912 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:41.191679 20308 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.192391 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:41.193305 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.193768 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.194037 20308 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:41.193305 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.194986 20322 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.191642 15833 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:41.195513 20322 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.195533 20323 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.196525 20323 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.197646 20322 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.198580 20323 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.198688 15912 raft_consensus.cc:2376] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9. Re-sending same reply.
I20260709 12:25:41.188992 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:41.199683 15834 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.200337 15832 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:41.200371 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:41.200860 15879 connection.cc:256] RPC call timeout handler was delayed by -3.491031647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 12:25:41.200990 15838 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:41.192932 15831 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.203321 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:41.204584 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.205091 15912 raft_consensus.cc:2376] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9. Re-sending same reply.
I20260709 12:25:41.205802 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.206440 15912 raft_consensus.cc:2410] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:41.207065 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.207728 15912 raft_consensus.cc:2410] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:41.208521 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.211099 15837 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.210992 15831 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:41.208797 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 903) took 4275 ms. Trace:
I20260709 12:25:41.207650 15829 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:41.214644 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.212208 15830 rpcz_store.cc:276] 0709 12:25:36.933433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.933580 (+   147us) service_pool.cc:224] Handling call
0709 12:25:36.936804 (+  3224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.947354 (+ 10550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.947384 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.947813 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.041200 (+ 93387us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:37.041239 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.041306 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:40.646921 (+3605615us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:41.208508 (+561587us) raft_consensus.cc:1685] finished
0709 12:25:41.208538 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.208744 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4196,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":6479,"spinlock_wait_cycles":3235584,"thread_start_us":92963,"threads_started":1,"wal-append.queue_time_us":103610}
I20260709 12:25:41.217774 15912 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:41.219579 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.219677 15980 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:41.219653 20230 consensus_queue.cc:1059] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:41.221328 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.222014 15980 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.222802 15912 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:41.222465 20313 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:41.223258 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.223453 20323 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:41.223869 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.194547 20308 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.225986 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.226751 15980 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:41.228415 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.230724 20329 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:41.231673 20329 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.232372 20329 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:41.232928 20329 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.235949 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.236721 15986 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:41.241362 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.242272 15988 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.243144 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.243772 15988 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:41.254001 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.227403 20308 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.274194 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.274641 20334 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:41.276367 20333 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:41.277122 20333 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.277465 20333 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:41.278841 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 89969us
I20260709 12:25:41.280016 20329 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:41.280571 20308 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.281072 20323 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.281963 20323 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.280076 15952 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.284207 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.287266 15980 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:41.288416 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.289337 15980 raft_consensus.cc:2393] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 7: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.291607 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.292204 15910 raft_consensus.cc:2376] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10. Re-sending same reply.
I20260709 12:25:41.292284 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.291630 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.293233 20328 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:41.293540 15988 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:41.293699 20328 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.294173 20328 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.294683 20329 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:41.295068 20329 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.295413 20329 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:41.296413 15986 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
W20260709 12:25:41.293740 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 829722us
I20260709 12:25:41.297369 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.297755 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:41.297936 15988 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:41.299741 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.300079 15986 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:41.282483 20330 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:41.300981 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.310599 20329 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.301556 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.311744 15988 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:25:41.278321 20333 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.313129 20333 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.314091 15988 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:41.316331 15988 raft_consensus.cc:1240] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:41.316509 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.317154 20330 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:41.317811 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.319376 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.320108 15913 raft_consensus.cc:2410] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:41.320928 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.321484 15913 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:41.322680 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.323007 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.323535 15910 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:41.323621 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.324313 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.324564 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.325326 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.326355 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.326560 15836 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.327522 15913 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:41.302565 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:41.302801 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 99592.9us
I20260709 12:25:41.329571 15986 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:41.330308 20329 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.331048 20336 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:41.331894 20335 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:41.332141 20329 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:41.337715 20329 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:41.338083 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.338786 20300 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:41.338672 20329 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.339191 20300 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.339633 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.340266 15913 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:41.339972 20300 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.342180 15913 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:41.343225 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.348594 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.349463 15913 raft_consensus.cc:2410] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:41.349587 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.350395 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.351612 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.352218 15912 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:41.352411 15908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1454) took 5669 ms. Trace:
I20260709 12:25:41.353511 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.354048 15912 raft_consensus.cc:2376] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14. Re-sending same reply.
I20260709 12:25:41.290838 20308 raft_consensus.cc:2764] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:41.352816 15908 rpcz_store.cc:276] 0709 12:25:35.687643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.037881 (+350238us) service_pool.cc:224] Handling call
0709 12:25:36.065353 (+ 27472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:36.076421 (+ 11068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.352211 (+5275790us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5400072950. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:41.352336 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62409088}
I20260709 12:25:41.304755 20328 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.355859 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.356235 15987 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:41.356489 15912 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:41.356997 20328 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.358096 20328 raft_consensus.cc:2804] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:41.358446 20328 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.358784 20328 raft_consensus.cc:3060] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.358925 15912 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:41.354000 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.337145 20330 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.360663 16493 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:41.361274 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.361903 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.363116 16488 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:41.359614 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:41.365101 16487 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:41.366153 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.366750 16496 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:41.369004 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.369455 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.369782 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.370065 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.370936 16496 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:41.371095 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.371745 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.375200 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.375789 15910 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:41.376855 20300 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.377327 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.378108 15910 raft_consensus.cc:2393] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:41.379112 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:41.304361 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 79799.3us
I20260709 12:25:41.382720 20323 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:41.383810 20331 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:41.384184 20331 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.304104 15980 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:41.385016 20331 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.386683 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.387387 15986 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.387493 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.388465 15983 raft_consensus.cc:2393] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.389190 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.389835 15986 raft_consensus.cc:2368] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7.
I20260709 12:25:41.390589 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.390825 15905 raft_consensus.cc:2368] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 10.
I20260709 12:25:41.390949 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.391716 15980 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:41.391954 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.392349 16489 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:41.393196 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.393828 15905 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.393456 20328 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.394376 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.395084 15904 raft_consensus.cc:2376] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11. Re-sending same reply.
I20260709 12:25:41.395179 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.399899 15987 raft_consensus.cc:2393] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.398236 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.396853 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:41.406618 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.394382 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.412523 15910 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:41.413133 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.419003 15905 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:41.401548 20328 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.448733 15910 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:41.414220 20165 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:41.456611 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:41.458971 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.465508 20328 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:41.471213 15982 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:25:41.471621 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 170124us
I20260709 12:25:41.472743 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:41.473570 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.473757 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.477415 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.467760 20328 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.478717 15879 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.443130 19766 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.480986 15879 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:41.484827 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 86643.7us
I20260709 12:25:41.486393 15952 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.471596 20329 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:41.480392 20328 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.457633 20236 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:41.479446 20333 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.481268 20335 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:41.482666 20336 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.487650 20329 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.525442 20329 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.525919 20321 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:41.512230 15934 debug-util.cc:398] Leaking SignalData structure 0x7b0800169b00 after lost signal to thread 14652
I20260709 12:25:41.526841 20342 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:41.527293 20342 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.527607 20342 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:41.527760 15934 debug-util.cc:398] Leaking SignalData structure 0x7b08003967e0 after lost signal to thread 15769
I20260709 12:25:41.529588 20337 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:41.530017 20337 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.530354 20337 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:41.534077 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.534332 15986 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:41.534482 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.535867 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.536729 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.537465 15908 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.537528 15835 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:41.537832 20027 consensus_queue.cc:1059] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:41.538283 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.538816 20027 raft_consensus.cc:3055] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:41.539321 20027 raft_consensus.cc:740] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:41.539464 20251 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.539846 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.539955 20251 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.540172 20027 consensus_queue.cc:260] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.503779 20335 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.541222 20330 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:41.542060 20251 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.542758 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.544457 15986 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:41.544837 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:41.545893 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.546904 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.539412 15980 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:41.547926 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.526471 20321 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.538852 15909 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:41.547006 15984 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:41.540835 15912 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:41.480429 20230 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:25:41.480636 20313 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:25:41.482666 20165 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:41.576720 15912 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:41.548296 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.552280 15905 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:41.559095 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.577886 15980 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 14: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:41.559427 15988 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:41.573637 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.574353 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:41.579061 15913 raft_consensus.cc:2410] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:41.577883 15984 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:41.580201 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.580824 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.582151 15981 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:41.582993 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.584080 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:41.584465 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 98100us
I20260709 12:25:41.584677 15980 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.585501 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.585824 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.586180 15984 raft_consensus.cc:2368] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
I20260709 12:25:41.541260 20335 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.484616 19766 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.587152 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.575498 15802 leader_election.cc:400] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 15. Current term is 16.
I20260709 12:25:41.588843 15802 leader_election.cc:403] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:25:41.573539 20251 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:25:41.590279 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.591719 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.596550 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.597426 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.598181 15988 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:41.599186 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.605125 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.606748 15984 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:41.616335 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 135435us
I20260709 12:25:41.617992 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.603273 15988 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
W20260709 12:25:41.621507 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46177.5us
I20260709 12:25:41.589073 20333 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.637301 20321 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.640108 20321 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.641014 20357 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:41.630383 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.639696 15980 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
W20260709 12:25:41.646225 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 101466us
I20260709 12:25:41.636216 20360 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:41.650795 20360 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.651232 20360 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.637650 20330 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 15. Current term is 16.
I20260709 12:25:41.611526 20347 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:41.633085 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.658499 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:41.661160 15984 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:41.662055 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.662968 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.663602 15988 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:41.664386 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.665165 15988 raft_consensus.cc:2410] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:25:41.669109 16460 leader_election.cc:400] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 6. Current term is 7.
I20260709 12:25:41.670295 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:41.671999 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.646922 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.673569 15980 raft_consensus.cc:2376] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15. Re-sending same reply.
I20260709 12:25:41.676146 15980 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.680871 20360 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:41.681805 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73701.3us
I20260709 12:25:41.684976 15988 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.686331 15988 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:41.687151 20330 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:41.687549 15988 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:41.687537 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:41.687556 20330 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.688324 20330 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:41.697161 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:41.683580 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.701504 15980 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:41.657737 20348 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:25:41.703099 15934 debug-util.cc:398] Leaking SignalData structure 0x7b0800393c80 after lost signal to thread 15862
W20260709 12:25:41.703433 15934 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbee0 after lost signal to thread 15863
W20260709 12:25:41.704535 15934 debug-util.cc:398] Leaking SignalData structure 0x7b080027cd80 after lost signal to thread 15937
W20260709 12:25:41.704797 15934 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf340 after lost signal to thread 15938
I20260709 12:25:41.649371 20236 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.645318 20352 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:41.723372 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.724959 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.728319 16459 connection.cc:256] RPC call timeout handler was delayed by -3.7737547540000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 12:25:41.729554 16459 connection.cc:256] RPC call timeout handler was delayed by -3.75665475400001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 12:25:41.709213 20289 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:41.730504 16459 connection.cc:256] RPC call timeout handler was delayed by -3.750354754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:25:41.717456 20352 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.717631 20123 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:41.745970 16459 connection.cc:256] RPC call timeout handler was delayed by -3.7269547539999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:25:41.757536 16459 connection.cc:256] RPC call timeout handler was delayed by -3.6405547540002772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:25:41.757854 16459 connection.cc:256] RPC call timeout handler was delayed by -3.5361547540001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:25:41.758126 16459 connection.cc:256] RPC call timeout handler was delayed by -3.3993547539998872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:25:41.758522 16459 connection.cc:256] RPC call timeout handler was delayed by -3.3048547540001891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 12:25:41.758814 16459 connection.cc:256] RPC call timeout handler was delayed by -2.4642547540001942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30390000000000006s for a response
I20260709 12:25:41.761631 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.726513 20251 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:41.761072 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.746218 20236 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:41.785671 20236 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.786065 20236 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.780838 20329 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:41.789597 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.790934 19718 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.791452 19718 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.792200 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.764577 16488 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:41.764477 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.793598 19718 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.794072 19718 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.768157 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.768703 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.769274 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:41.769985 20349 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:25:41.756335 20352 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.777761 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:41.796331 16486 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:41.796151 20337 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.797300 15988 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:41.799022 20337 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:41.799623 20337 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:41.781850 20161 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:41.800012 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.702644 20165 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.781984 20328 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.804163 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.746055 20358 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:25:41.784873 20330 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.794014 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:41.806582 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 119106us
I20260709 12:25:41.762852 20359 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.748108 20347 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:41.829541 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.830154 16493 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:41.804322 16486 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:41.782559 20360 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.805691 15803 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:41.815214 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.799974 20337 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.857648 20251 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:41.857929 20337 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.858251 20251 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:41.858804 20251 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:41.823400 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.861135 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 55524.8us
W20260709 12:25:41.861522 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.861853 15803 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.827716 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:41.863070 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:41.886111 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.887285 16486 raft_consensus.cc:2410] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:41.806624 20366 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:41.889089 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.890664 20328 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.825181 20336 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:25:41.892333 20336 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:41.892645 20319 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:41.892776 20336 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:41.893322 20319 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:41.894294 20330 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.868857 20337 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.883729 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.897073 15837 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.804930 20329 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.900641 20335 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.910332 15908 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:41.910799 20161 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:41.912875 20335 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.806924 20289 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:25:41.905169 20118 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:41.905920 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:41.826867 20358 consensus_queue.cc:1243] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:25:41.919117 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 445377us
I20260709 12:25:41.920047 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:41.888533 20366 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:41.898814 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:41.804075 19718 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.922945 20363 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:41.923403 20363 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.923743 20363 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.924216 19718 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:40.502112 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:41.925547 15906 raft_consensus.cc:2410] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:41.928237 20347 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.929725 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1501) took 1430 ms. Trace:
I20260709 12:25:41.930091 15906 rpcz_store.cc:276] 0709 12:25:40.499750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.501821 (+  2071us) service_pool.cc:224] Handling call
0709 12:25:41.929657 (+1427836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:41.928673 20289 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:41.930855 20289 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:41.931663 15934 debug-util.cc:398] Leaking SignalData structure 0x7b08003bda40 after lost signal to thread 16012
W20260709 12:25:41.932004 15934 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3060 after lost signal to thread 16013
W20260709 12:25:41.934360 15934 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac0a0 after lost signal to thread 16521
W20260709 12:25:41.934703 15934 debug-util.cc:398] Leaking SignalData structure 0x7b0800399640 after lost signal to thread 16522
I20260709 12:25:41.918370 20328 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:25:41.936157 20328 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:41.936549 20328 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:41.937428 20360 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:41.937980 20360 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:41.938769 20360 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.939421 20337 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:41.937551 20336 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.942489 20336 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:41.942538 20236 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:41.943665 16490 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:41.936043 20289 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:41.945986 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 49568us
I20260709 12:25:41.924947 20366 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.957952 20335 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:41.958750 20124 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:41.958608 20335 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.960796 20335 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.963804 20236 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:41.965806 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:41.967288 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:41.973403 20211 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:41.973922 20211 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:41.975870 20352 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:41.976840 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.977291 15984 raft_consensus.cc:2393] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:41.978292 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52577.8us
I20260709 12:25:41.979220 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:41.941334 20328 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.005100 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.012378 20365 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.015208 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:42.017365 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5fe0 after lost signal to thread 14649
W20260709 12:25:42.017742 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6360 after lost signal to thread 14652
W20260709 12:25:42.018659 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08001a98c0 after lost signal to thread 15769
I20260709 12:25:42.024580 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:42.025254 15830 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:41.975901 20211 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.027673 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.017134 16459 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:41.985299 20284 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:42.032179 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 335104us
I20260709 12:25:42.033792 20251 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.036361 20251 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:42.027874 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 344327us
I20260709 12:25:42.038646 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.041656 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:42.042438 15829 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:42.046295 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:42.054881 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.019721 20329 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:42.055213 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 437243us
I20260709 12:25:42.056067 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.057247 20330 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.052608 20284 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.059418 19718 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:42.077191 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49593.9us
I20260709 12:25:42.082237 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:42.083992 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:42.078001 15952 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.080060 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:42.084968 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.085490 16493 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:42.081267 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.086906 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.088002 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.088536 15906 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.089422 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.090469 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.053689 20337 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:42.095700 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:42.096606 15986 raft_consensus.cc:606] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:42.096771 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.096994 15986 raft_consensus.cc:614] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:42.081640 20236 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:42.098431 20236 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:42.098788 20236 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:42.103006 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 275420us
I20260709 12:25:42.104112 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.060349 20329 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:42.081976 20141 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:42.116676 20352 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:42.117846 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.106588 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:42.216189 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.217597 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.096473 20337 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:42.021064 20342 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.123790 20329 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.081380 20284 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.020241 20319 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.105571 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:42.168538 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:42.184887 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.095472 20280 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:42.203676 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.238389 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08001eb300 after lost signal to thread 15862
W20260709 12:25:42.238715 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec400 after lost signal to thread 15863
I20260709 12:25:42.239058 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.239596 15912 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.107986 20369 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:25:42.107396 20359 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.211009 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:42.107023 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 73960.4us
I20260709 12:25:42.223296 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.226770 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.227034 20337 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.206682 20372 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:42.225283 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:42.246567 15981 raft_consensus.cc:2368] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:42.235113 15905 pending_rounds.cc:85] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 3
I20260709 12:25:42.247237 15905 pending_rounds.cc:107] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:25:42.247517 15905 raft_consensus.cc:2889] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.242349 15906 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:25:42.247790 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 160949us
I20260709 12:25:42.248636 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.224874 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1503) took 1257 ms. Trace:
W20260709 12:25:42.249397 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44054.6us
I20260709 12:25:42.250468 15911 rpcz_store.cc:276] 0709 12:25:40.967895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.106375 (+1138480us) service_pool.cc:224] Handling call
0709 12:25:42.224807 (+118432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:42.252622 15953 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.255482 16486 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:42.223744 20358 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.221163 20379 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:42.261551 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.243510 20333 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:42.264304 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:42.249692 20360 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.230340 20363 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.258490 20241 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.251279 20230 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:25:42.284315 16492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 961) took 2528 ms (client timeout 3345 ms). Trace:
I20260709 12:25:42.248507 20280 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:42.285916 20280 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:42.270264 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.288327 20350 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:42.288717 15986 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:25:42.288720 20350 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:42.290148 15979 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:42.291118 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:42.291256 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:42.291782 15985 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.294936 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:42.250867 20376 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:42.296790 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:42.284798 16492 rpcz_store.cc:269] 0709 12:25:39.755981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.384057 (+628076us) service_pool.cc:224] Handling call
0709 12:25:42.284124 (+1900067us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b540039dad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:42.284246 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161848192}
I20260709 12:25:42.290540 20350 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.298929 20230 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:42.299335 20230 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:42.292107 15986 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:42.300130 20230 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.300693 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:42.301496 15986 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:42.301666 19766 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.302373 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:42.303066 15986 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.306430 20342 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:42.307435 20342 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:42.298976 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:42.308710 15982 raft_consensus.cc:1275] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:42.270108 20368 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:42.254137 20382 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:42.255194 20375 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:25:42.256880 20335 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:25:42.258612 20374 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:25:42.320353 19718 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:42.321333 20363 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.261586 20358 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.316457 20236 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.264801 20373 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:42.314405 20376 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.298941 20350 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:42.316210 20367 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:25:42.277148 20241 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.275430 20333 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.349259 20382 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:42.349436 20284 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.350198 20376 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.350394 20388 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:42.338181 20373 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.352102 20382 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.315258 20366 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.357100 20373 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.345260 20394 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.371369 20366 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.372663 20382 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.374562 20382 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:42.203213 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.203665 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 304932us
W20260709 12:25:42.414911 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 309201us
I20260709 12:25:42.416641 15802 leader_election.cc:400] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14.
I20260709 12:25:42.419143 15802 leader_election.cc:403] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:42.419795 15833 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:42.418112 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.427701 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.432957 20398 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.438009 20398 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.439833 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:42.442099 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.514444 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.516511 15984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
W20260709 12:25:42.518352 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08003af680 after lost signal to thread 15937
W20260709 12:25:42.518790 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6a20 after lost signal to thread 15938
W20260709 12:25:42.519739 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.520506 16009 debug-util.cc:398] Leaking SignalData structure 0x7b0800298300 after lost signal to thread 16012
W20260709 12:25:42.520893 16009 debug-util.cc:398] Leaking SignalData structure 0x7b080019b1e0 after lost signal to thread 16013
W20260709 12:25:42.442808 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 169587us
W20260709 12:25:42.443081 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.522322 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.443660 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 194950us
W20260709 12:25:42.522817 16009 debug-util.cc:398] Leaking SignalData structure 0x7b080038ed40 after lost signal to thread 16521
W20260709 12:25:42.523257 16009 debug-util.cc:398] Leaking SignalData structure 0x7b08000fdca0 after lost signal to thread 16522
I20260709 12:25:42.523808 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.525799 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.527889 15879 leader_election.cc:400] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10.
W20260709 12:25:42.444712 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.449549 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 219122us
I20260709 12:25:42.450838 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:42.451367 15981 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.473215 20400 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.488392 16460 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.500524 15986 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:25:42.506377 19922 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:42.510843 20027 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.559064 15983 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:42.329154 20230 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.531023 19922 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:42.568511 20251 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:42.569932 20397 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:25:42.571153 20333 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.571372 20241 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.571980 20321 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.572815 20321 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:42.573500 20402 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:25:42.575516 20321 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.577718 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:42.579365 20366 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:42.579946 15986 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.581395 20376 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:42.584358 20248 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 6.043s	user 0.020s	sys 0.037s
W20260709 12:25:42.586454 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 98438.3us
W20260709 12:25:42.587343 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.589597 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 150010us
I20260709 12:25:42.588853 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.584504 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.565026 19922 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.597349 20380 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14.
I20260709 12:25:42.598485 20383 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:42.598917 20383 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.599107 20236 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:42.599368 20383 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.600059 20350 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.568789 20400 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.603049 20358 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:42.375109 20379 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:42.604550 20400 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.605362 20379 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.606383 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:42.607712 20284 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.610731 20327 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.611259 20327 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:42.613334 20389 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:42.614921 20328 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.615134 20211 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:42.619599 20241 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.620131 20241 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.620364 15983 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:25:42.620535 20241 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.621798 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.623413 20319 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:42.623548 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:42.624034 20319 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:42.624126 20405 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:42.625382 20319 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.624707 20405 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.626446 20405 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.630761 20396 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.631453 20396 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.631923 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.635295 20375 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.635528 20396 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:42.593644 20398 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.636777 20165 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:25:42.636498 20377 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:25:42.636181 19561 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:42.648313 19561 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.648698 19561 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.641474 20382 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 12:25:42.649978 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 222503us
I20260709 12:25:42.650133 20382 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.650507 20382 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.651091 20361 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:42.651580 20361 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.651767 20382 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.639243 20330 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:42.637554 20333 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.653307 20330 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.653620 20333 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:42.654119 20333 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.654402 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:42.655421 15908 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:42.656702 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:42.657871 15905 raft_consensus.cc:2410] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:25:42.624336 20350 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.652787 20361 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.659078 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2021) took 1060 ms. Trace:
I20260709 12:25:42.659399 20360 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.589810 15912 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:42.660198 20361 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.665200 20322 raft_consensus.cc:3055] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:42.665684 20322 raft_consensus.cc:740] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:42.666546 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.666848 20322 consensus_queue.cc:260] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.668157 20322 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.670719 15985 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:42.671409 20347 raft_consensus.cc:2764] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:42.635799 20375 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.671633 19766 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:42.672147 19766 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.672786 20375 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:42.676970 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 64132us
I20260709 12:25:42.678587 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.680315 16489 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
W20260709 12:25:42.659099 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 81714.3us
I20260709 12:25:42.670742 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 795) took 1188 ms. Trace:
I20260709 12:25:42.640429 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.682122 15982 rpcz_store.cc:276] 0709 12:25:41.481879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.482024 (+   145us) service_pool.cc:224] Handling call
0709 12:25:42.308318 (+826294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.309240 (+   922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.670307 (+361067us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54002c5e50. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:42.670543 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899629824}
I20260709 12:25:42.685679 19766 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.687141 19766 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.690764 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:42.692448 20347 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.693604 15952 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:42.693943 20331 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.659621 15988 rpcz_store.cc:276] 0709 12:25:41.598647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.688449 (+ 89802us) service_pool.cc:224] Handling call
0709 12:25:41.688713 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:41.797679 (+108966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.658548 (+860869us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001865d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:42.658868 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249199872}
I20260709 12:25:42.698092 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:42.698396 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.699113 15908 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.700199 15910 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:42.700359 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:42.701956 15911 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:42.704521 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.704574 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:42.705545 20366 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.705694 15906 raft_consensus.cc:2410] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:42.707000 15912 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:25:42.707356 15912 pending_rounds.cc:85] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 11
I20260709 12:25:42.707597 15912 pending_rounds.cc:107] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:42.707847 15912 raft_consensus.cc:2889] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.705547 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:42.709843 15911 raft_consensus.cc:2410] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:25:42.709736 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.720664 20350 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.722600 15913 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:42.725399 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:42.726262 15905 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:42.726636 20341 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 1.081s	user 0.007s	sys 0.009s
W20260709 12:25:42.731318 20371 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.494s	user 0.001s	sys 0.000s
I20260709 12:25:42.728924 15910 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:42.720353 15907 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:42.734354 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.742376 20364 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:42.743075 20364 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:42.744031 20165 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.744516 20165 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.744899 20165 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.746320 20352 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:42.744174 20364 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.612774 20327 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:42.756547 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 116209us
I20260709 12:25:42.753381 15984 raft_consensus.cc:606] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:42.761932 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:42.751120 19561 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.763600 16459 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.764670 19561 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.765249 20251 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:42.765508 20118 consensus_queue.cc:1048] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:42.765775 20251 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:42.767004 20118 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.766943 20251 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.768878 15979 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:42.763625 20373 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.770143 20310 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.772007 20141 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:42.785990 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:42.786310 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.778214 16495 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:25:42.787847 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 78241.5us
I20260709 12:25:42.772392 20141 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:42.789747 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48570us
I20260709 12:25:42.776170 20161 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:25:42.794785 20141 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:42.772790 20337 consensus_meta.cc:287] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:25:42.801556 19718 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:42.800823 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:42.778687 20373 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:42.806741 15979 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.776731 20369 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:42.806902 20396 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:42.808384 20329 consensus_meta.cc:287] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.002s
I20260709 12:25:42.809000 20382 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.757124 20366 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.777382 20327 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.804672 20347 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:42.825433 15908 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:42.844131 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:42.849519 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48776.3us
I20260709 12:25:42.796772 20141 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.853808 20400 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.814302 20310 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.855316 15983 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.855541 15912 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: [11.11-12.12]
W20260709 12:25:42.860560 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 126293us
I20260709 12:25:42.823065 19718 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.865142 20388 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:42.866389 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.868526 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.857767 20329 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.871212 20329 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.873436 15803 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:42.877429 15905 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
W20260709 12:25:42.882495 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.888074 15907 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.885823 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:42.871870 15728 catalog_manager.cc:5697] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 6, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 6 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.891072 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:42.879549 20361 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:42.874156 20350 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.890722 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:42.890646 15980 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:42.843851 20337 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:42.923714 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.924299 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:42.927320 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 58875.1us
I20260709 12:25:42.929567 20361 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:42.930939 20361 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.933233 20398 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:42.898413 20383 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.935115 15802 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:42.935988 20383 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.936681 20383 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:42.944000 19718 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.945519 19718 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.937143 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:25:42.949486 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 109164us
I20260709 12:25:42.885757 20165 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:42.891393 20400 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:42.942251 15838 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:42.898525 20319 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:42.933279 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 172859us
I20260709 12:25:42.952042 20094 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.952455 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.953235 15728 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 12, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.941077 20280 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 12:25:42.957815 15980 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.958218 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:42.960469 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 98730us
W20260709 12:25:42.961099 20372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.003s
I20260709 12:25:42.961059 20364 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:42.965126 15729 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 176) took 39708 ms (client timeout 15000 ms). Trace:
I20260709 12:25:42.968343 20214 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:42.975471 20337 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:42.976754 15987 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:42.976725 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:42.978709 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:42.983681 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.991261 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 63134us
I20260709 12:25:42.897082 19922 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.015458 16494 raft_consensus.cc:2368] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12.
W20260709 12:25:43.005486 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.019661 15833 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:43.015290 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:43.010849 20372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.004s
I20260709 12:25:43.026274 20214 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:43.026769 20364 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:43.001278 20094 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.030390 16493 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:42.900902 20333 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.022384 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:42.998875 20251 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:43.043435 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.902391 20350 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.048171 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.057490 15907 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:43.009107 20330 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.068843 15983 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:43.110743 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:43.072089 20331 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:43.081465 20165 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.112072 20382 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:43.073320 15829 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:43.112813 20382 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.032549 19561 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:25:43.094396 16488 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:43.114287 19561 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:43.113960 20382 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.114764 19561 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.115096 20373 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:43.115504 20373 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:43.115793 19561 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.116485 20330 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.116338 20373 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.041877 20241 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.080307 20364 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.117707 20373 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.118561 16490 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:43.119405 20241 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.065277 15907 pending_rounds.cc:85] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 8
I20260709 12:25:43.120038 15907 pending_rounds.cc:107] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:25:43.120282 15907 raft_consensus.cc:2889] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:43.030637 20214 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.069882 15838 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:43.122471 20214 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.103060 15904 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:43.124012 20214 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:43.124629 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 809) took 1591 ms (client timeout 1610 ms). Trace:
W20260709 12:25:43.125013 15904 rpcz_store.cc:269] 0709 12:25:41.533109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.535616 (+  2507us) service_pool.cc:224] Handling call
0709 12:25:43.124438 (+1588822us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400196ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:43.124557 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3602393984}
I20260709 12:25:43.125831 20395 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:43.117901 20350 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.126587 20395 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.129021 20027 consensus_meta.cc:287] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 12:25:43.129223 20395 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.129904 16496 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
W20260709 12:25:43.131081 16496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 677) took 1370 ms (client timeout 1684 ms). Trace:
I20260709 12:25:43.131242 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:43.131562 16496 rpcz_store.cc:269] 0709 12:25:41.760532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.766653 (+  6121us) service_pool.cc:224] Handling call
0709 12:25:43.130867 (+1364214us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:43.131006 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3070234496}
I20260709 12:25:43.033702 20372 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:43.134156 20372 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.071071 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49186.5us
I20260709 12:25:43.139377 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.140345 20350 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:43.140739 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 124216us
I20260709 12:25:43.141582 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.142418 20251 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:43.142446 20383 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:43.142835 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.143081 20251 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:43.143544 20347 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:43.144680 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.144286 20251 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.146521 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.144279 20347 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:43.147625 20347 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:43.148089 20375 consensus_queue.cc:1175] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "761f08e40cdf4af396105d67949c0afc" responder_term: 10 status { last_received { term: 9 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:43.145395 20350 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.149950 20350 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:43.151933 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.082541 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:43.153712 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.165160 15987 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.168350 19561 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.170481 20118 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:43.199970 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.204248 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.206579 15907 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:43.215140 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47462.1us
I20260709 12:25:43.217056 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:43.211866 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:43.220326 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.222409 15983 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.216711 20123 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.173277 20319 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:43.211473 20330 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:43.172799 20398 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:25:43.071988 20377 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
W20260709 12:25:43.241411 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 283260us
I20260709 12:25:43.112164 20405 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:43.244155 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 44453.7us
I20260709 12:25:43.220862 20310 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:25:43.221477 20165 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:43.243685 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.234462 20369 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:43.253428 15838 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.244563 20383 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:43.259262 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.260548 15802 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:43.261597 19922 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.253583 20400 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.248148 20333 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.265867 15987 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:43.256771 20383 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.271958 20337 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.291630 15829 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.273321 20330 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:43.278441 20383 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.276115 20319 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.298198 16492 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:25:43.294245 15983 raft_consensus.cc:2468] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:43.300606 15838 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:43.268939 20369 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.305751 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:43.279866 20141 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:25:43.317256 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 56798us
I20260709 12:25:43.320322 16460 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:43.316787 19718 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:43.327661 19718 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.328967 19718 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.333499 20417 log.cc:927] Time spent T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:43.338886 15832 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:25:43.338948 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 76776.7us
I20260709 12:25:43.339394 15832 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:43.340108 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:43.340480 15983 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:43.340301 20400 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:43.341194 15879 leader_election.cc:400] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:43.341544 15879 leader_election.cc:403] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.342052 20400 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:43.343506 20400 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:43.343838 20400 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:43.344177 20400 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:43.344323 20369 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:43.344637 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.345196 20333 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:43.346099 20333 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:43.346771 20333 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:43.347895 20333 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:43.348244 20333 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:43.340124 15953 leader_election.cc:400] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12.
I20260709 12:25:43.349165 15953 leader_election.cc:403] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.349193 20333 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.350541 20414 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12.
I20260709 12:25:43.309988 20350 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.350868 20333 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.242039 15728 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 6, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 6 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:43.351785 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.352408 15907 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:43.352468 15728 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 9, leader changed from <none> to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:43.353222 20414 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:43.354502 15728 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 11, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 11 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:43.355849 20350 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.356387 20350 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.355252 20322 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.358706 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:43.367779 15838 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:43.378280 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:43.402262 15802 leader_election.cc:400] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
I20260709 12:25:43.402681 15802 leader_election.cc:403] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.405655 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:43.364416 20161 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.401326 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.356182 15728 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 10, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 10 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.411401 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.412859 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:43.409628 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:43.368556 20369 raft_consensus.cc:2804] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:43.303736 20337 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.427309 16492 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:43.430917 15829 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:43.431309 16495 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:43.439649 16489 raft_consensus.cc:1240] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:43.407577 20327 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.449329 20373 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.451152 15983 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.458911 15988 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:25:43.406075 20329 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:43.421605 20331 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.394943 20310 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:25:43.414878 20161 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:43.455830 20373 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.456346 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.461515 15829 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.465698 16493 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
W20260709 12:25:43.469493 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 97808.6us
I20260709 12:25:43.470628 15833 raft_consensus.cc:2393] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:43.429906 20319 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
W20260709 12:25:43.478981 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.455073 20369 raft_consensus.cc:697] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.481738 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:43.423552 20322 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.489045 20230 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:43.490041 15838 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.490574 20337 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.491659 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.493916 20405 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.494553 20405 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:43.495381 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:43.499240 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:43.479772 20161 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.504217 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.500336 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.509634 15988 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.512197 15980 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:43.514089 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.518457 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.478173 20331 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.520612 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.520627 16493 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:25:43.523285 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.524528 15909 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:43.482743 20364 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:43.522652 15913 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:43.487582 20329 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.509336 20319 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.517895 20333 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 12:25:43.543133 20426 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:25:43.548125 20383 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.551411 20369 consensus_queue.cc:237] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.552309 15728 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:43.526244 20350 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.575811 15833 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:43.503113 20327 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.565299 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.571597 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:43.574538 15987 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:43.578258 15838 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:25:43.582481 20329 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:43.584501 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.579308 15980 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:43.585268 15913 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:43.594583 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:43.577821 20230 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:43.588871 20333 raft_consensus.cc:3055] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:43.632970 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.632999 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.599431 20251 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:43.661967 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:43.627911 20347 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:43.639964 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68520.3us
W20260709 12:25:43.013052 15729 rpcz_store.cc:269] 0709 12:25:03.240698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.241622 (+   924us) service_pool.cc:224] Handling call
0709 12:25:04.721359 (+1479737us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5400002210. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917f0b2 00007f03d20f8759 00007f03d2090a76 00007f03d2061d58 00007f03d216004e 00007f03d06212a4 00007f03d0621232 00007f03d0621161 00007f03d06210dc
0709 12:25:42.948920 (+38227561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:34.567654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:34.568216 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:34.568264 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:25:34.568283 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:34.569004 (+   721us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:34.589220 (+ 20216us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:34.591754 (+  2534us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:25:34.605676 (+ 13922us) tablet.cc:701] Row locks acquired
0709 12:25:34.605733 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:25:34.605956 (+   223us) write_op.cc:270] Start()
0709 12:25:34.606080 (+   124us) write_op.cc:276] Timestamp: P: 1783599934605871 usec, L: 0
0709 12:25:34.606102 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:25:34.692952 (+ 86850us) log.cc:844] Serialized 2054 byte log entry
0709 12:25:34.913320 (+220368us) op_driver.cc:464] REPLICATION: finished
0709 12:25:35.246178 (+332858us) write_op.cc:301] APPLY: starting
0709 12:25:35.246305 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:35.919560 (+673255us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:35.919693 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:35.973429 (+ 53736us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:35.973770 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:25:35.973812 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:35.974129 (+   317us) log.cc:844] Serialized 57 byte log entry
0709 12:25:36.167665 (+193536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:36.197228 (+ 29563us) write_op.cc:454] Released schema lock
0709 12:25:36.206696 (+  9468us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:36.224876 (+ 18180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:36.224927 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":847857,"reported_tablets":30,"spinlock_wait_cycles":43304704,"child_traces":[["op",{"apply.queue_time_us":283473,"apply.run_cpu_time_us":22646,"apply.run_wall_time_us":978661,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18747,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6210,"cfile_init":1,"lbm_read_time_us":106880,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":6,"num_ops":5,"prepare.queue_time_us":147963,"prepare.run_cpu_time_us":4145,"prepare.run_wall_time_us":125702,"replication_time_us":289365,"thread_start_us":348610,"threads_started":3,"wal-append.queue_time_us":289279,"wal-append.run_cpu_time_us":2924,"wal-append.run_wall_time_us":1558167}]]}
I20260709 12:25:43.584800 20094 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.645246 20350 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:43.651670 15728 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:43.653385 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:43.654393 20214 consensus_meta.cc:287] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.004s
I20260709 12:25:43.631853 20333 raft_consensus.cc:740] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:43.673918 20094 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:43.671932 15829 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:43.657618 15984 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:43.661759 20331 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:43.664045 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.623832 15832 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.664366 15838 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.663997 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:43.670522 20322 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.671226 16493 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:25:43.679987 16493 pending_rounds.cc:85] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 11
I20260709 12:25:43.680223 16493 pending_rounds.cc:107] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:25:43.680441 16493 raft_consensus.cc:2889] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:43.684096 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.687071 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.687934 15830 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:43.689203 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:43.691534 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.692173 15836 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:43.693207 15832 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.693004 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.672014 20435 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:25:43.701700 15833 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:43.703985 20383 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:43.705806 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.706220 20251 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:43.706624 15837 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:43.707501 20365 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.707722 20327 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.683780 20364 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:25:43.708458 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.709288 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.685959 20331 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:43.662694 20347 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:43.710565 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 48675.8us
I20260709 12:25:43.693797 20373 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.715288 15835 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:43.718773 15836 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:43.718068 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.720243 15834 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:43.720468 20400 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.721232 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.721565 20230 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.726902 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.711882 20331 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:43.728543 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48963.5us
W20260709 12:25:43.731034 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.736301 15988 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:43.725426 20400 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.773293 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.774070 15987 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:43.776945 15838 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:25:43.734076 15803 connection.cc:256] RPC call timeout handler was delayed by -1.5313823309998043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 12:25:43.744745 20310 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.693557 15728 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 6, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 6 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:43.756696 20444 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:43.757520 20373 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:43.757754 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:43.758074 20327 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.758435 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.758678 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.796293 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:43.759931 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.761981 15986 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [7.5-10.7]
W20260709 12:25:43.763698 20436 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:25:43.764173 20027 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:43.734957 20331 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.798028 20027 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.799072 20027 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.779786 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.785689 15832 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:25:43.792121 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.793138 15838 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:43.759311 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:43.802089 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 44406us
I20260709 12:25:43.796113 15979 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:43.807267 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:43.803359 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:43.801468 15832 pending_rounds.cc:85] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 13
I20260709 12:25:43.810854 15832 pending_rounds.cc:107] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:25:43.811142 15832 raft_consensus.cc:2889] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:43.807817 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.812299 15983 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:43.813601 15982 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:43.775470 20383 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:43.814072 15833 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.813832 15831 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:43.815203 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.819412 15986 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:43.825435 20350 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.825878 20350 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.826247 20350 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:43.826885 20441 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:25:43.828980 20366 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:25:43.810525 20310 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.830204 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:43.831352 20310 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:43.833283 20448 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:43.833696 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:43.833971 20448 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:43.834347 16488 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:43.835119 20448 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.835844 20435 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:43.836249 20435 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:43.837728 16493 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:43.819020 20319 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.839427 20319 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:43.839854 20319 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.842514 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:43.844135 20427 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.405s	user 0.001s	sys 0.001s
I20260709 12:25:43.845837 15728 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 8, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 8 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:43.849062 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:43.850565 15986 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:25:43.851687 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 62649.4us
I20260709 12:25:43.851538 20333 consensus_queue.cc:260] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.855899 15802 leader_election.cc:400] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15.
I20260709 12:25:43.858845 15802 leader_election.cc:403] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:43.778338 20365 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 12:25:43.864770 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 83995.6us
I20260709 12:25:43.807389 20444 consensus_queue.cc:1243] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:43.808784 20347 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:43.801646 20400 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:25:43.820271 15984 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:43.801184 20161 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.895066 15982 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:43.895744 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.898824 15908 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:43.890206 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.899739 15907 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:43.904781 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:43.904673 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:43.814339 20327 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.906812 15983 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:43.908715 15982 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
I20260709 12:25:43.892693 20094 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.906802 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.895308 20251 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15.
I20260709 12:25:43.917618 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.918790 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:43.906260 20423 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:25:43.901451 20310 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.920518 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:43.922673 15832 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:43.918046 16494 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
W20260709 12:25:43.924054 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68275.2us
I20260709 12:25:43.925266 16493 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:43.925935 15984 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:43.929092 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:43.848524 15728 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 8, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 8 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.932459 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:43.932457 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 129160us
I20260709 12:25:43.944836 15833 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:43.945880 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:43.926249 20094 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.946812 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:43.947314 20118 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:43.947779 20118 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.947854 20405 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:43.948295 20118 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.948390 20405 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:43.948958 20405 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.928906 20310 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.951195 20310 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.948907 20094 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:43.939224 19766 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:25:43.954650 15728 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:43.957237 15802 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:43.958124 20251 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.961093 16490 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
W20260709 12:25:43.961287 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 91390.4us
I20260709 12:25:43.962061 20118 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:43.964274 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:43.964781 20251 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:43.938773 20361 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:25:43.965718 20251 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:43.965909 20361 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:43.966166 20251 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:43.966377 20361 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:43.967280 20251 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:43.967397 20361 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:43.969234 20375 consensus_queue.cc:1175] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "761f08e40cdf4af396105d67949c0afc" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 12:25:43.965075 15832 raft_consensus.cc:2393] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:43.968696 20251 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.970526 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:43.965732 16490 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:43.968644 20361 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.977710 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.982875 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.985287 15908 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:43.989840 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:43.943585 20373 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:43.990455 15912 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:43.990617 20373 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:43.990995 20373 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.987075 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:43.992830 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:43.996295 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.003321 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:43.987942 20444 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:43.938138 19718 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 12:25:44.007758 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 75331.7us
I20260709 12:25:44.008932 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:43.983275 20165 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:25:43.956454 15728 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 9 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.010614 20094 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.010053 20444 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.010313 20400 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.029767 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.032711 15908 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.002338 20383 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:44.031075 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.008509 20450 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:44.022812 20118 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:44.014015 20310 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:44.030333 20094 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.006870 20350 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.014083 20331 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:44.043037 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.033423 20444 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.040933 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.034787 20161 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:44.048409 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:44.050879 20327 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.030969 20319 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.044216 20094 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.041464 20453 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:44.054370 15728 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 11, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 11 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:44.061468 15908 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:44.064319 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.064411 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:44.067546 20453 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.073026 20453 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.074364 20319 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.074962 20319 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.075460 20319 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.060945 20443 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:44.066128 20448 raft_consensus.cc:2764] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:44.070887 20118 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:44.085826 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.088500 15833 raft_consensus.cc:2393] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 15: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:44.089632 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 58645.1us
I20260709 12:25:44.070262 20331 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.092227 20350 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.092818 20458 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.093339 20458 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:44.095162 20452 log.cc:927] Time spent T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:25:44.096510 20449 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:25:44.096719 20369 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.097427 20369 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.100152 20435 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.101573 20435 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.101310 15728 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 9 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:44.102324 20369 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.103345 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.103188 15728 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 7, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 7 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:25:44.107945 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 421023us
I20260709 12:25:44.114621 20319 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.078117 20459 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:44.117700 20459 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:44.118278 20459 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.119220 20459 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.119956 15909 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:44.121411 20118 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:44.125739 20118 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:44.126760 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 270095us
I20260709 12:25:44.080461 20443 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:44.128201 20443 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:44.129218 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 59402.9us
I20260709 12:25:44.131253 15986 raft_consensus.cc:1217] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Deduplicated request from leader. Original: 13.12->[14.13-15.14]   Dedup: 14.13->[15.14-15.14]
I20260709 12:25:44.131752 15986 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 15. Current term is 16. Ops: [14.13-15.14]
I20260709 12:25:44.132557 15982 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:44.133764 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:44.155288 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:44.155534 20432 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.520s	user 0.003s	sys 0.003s
I20260709 12:25:44.155444 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.155441 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.163565 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.163319 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:44.169122 15907 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:44.176923 15909 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:25:44.196861 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 62088.3us
I20260709 12:25:44.196663 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.198328 15904 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:44.135406 20327 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:44.199090 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 204996us
I20260709 12:25:44.198196 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.205264 15983 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:44.203869 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:44.203687 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:44.141727 20450 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:44.168486 20372 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.203538 15981 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:44.225198 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.224320 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.206624 15879 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:44.208173 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.168296 20251 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:44.204452 20365 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.228839 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:44.198585 20361 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:44.233979 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:44.234653 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.241264 16490 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.241333 15985 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:44.241462 15982 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:44.104715 15728 catalog_manager.cc:5697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.136029 20405 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.204160 20435 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.243240 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.203388 20383 consensus_queue.cc:1243] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:44.221993 20373 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.247231 15981 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [11.10-13.11]
W20260709 12:25:44.247560 20454 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:25:44.249166 20446 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:44.227674 20280 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:44.252555 15911 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:44.252897 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.240298 20331 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.269955 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.268986 16490 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:44.274923 15831 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:44.274801 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:44.274964 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.273694 15906 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:44.279448 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:44.280030 15985 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.281203 20464 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.281904 20464 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.273339 20331 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.284718 20331 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.260725 20361 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:44.287184 20361 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.287681 15982 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:44.275851 15981 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:44.272688 20280 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:44.290150 20280 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:44.290364 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.291090 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.291780 15907 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.228566 20461 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:25:44.299847 15908 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:44.303118 15837 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:44.303503 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.300689 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.301117 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.305809 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.306152 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.306691 15833 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:44.308835 15834 raft_consensus.cc:2393] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 9: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:44.311492 15985 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:44.311965 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.260511 20435 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.246330 20365 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.252770 20372 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.317899 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.317987 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.371001 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:44.317515 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:44.377532 16495 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:44.379464 15829 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:44.308915 20251 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:44.379710 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 98115.1us
I20260709 12:25:44.386656 15908 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:44.316215 20118 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.311288 20460 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.390190 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.315652 20464 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.395574 15907 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:44.310190 20094 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.377455 20458 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.403749 20350 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.404415 20463 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:44.405303 15908 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:44.405959 15907 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:44.411556 15913 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:44.416694 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.415917 20474 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:44.420914 20474 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.423390 20331 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.425529 20444 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.428083 20405 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.397212 20118 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.429324 20251 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.415760 20463 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:44.417359 15829 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:44.413092 20350 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:44.454224 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.411866 20165 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.311465 20450 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.460501 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:44.461315 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.467033 15913 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:44.414669 20460 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:44.473208 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.452332 20444 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.477665 20094 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.471309 19561 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:25:44.473053 20469 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.471406 20165 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.430935 20118 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:44.486927 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.458786 20435 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.502533 15982 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:44.502914 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.497510 16459 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:44.504730 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.506433 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.506341 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.476210 20373 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.507427 15830 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.421751 20474 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.508756 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.510218 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:44.512756 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54274.7us
I20260709 12:25:44.510643 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:44.511169 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:44.515661 15985 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:44.508193 20365 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:44.512861 15913 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.462196 20443 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.481595 20463 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.521736 15981 raft_consensus.cc:2393] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:44.514626 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:44.529631 16495 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:44.529892 16490 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:44.532366 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:44.531888 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 89017.2us
I20260709 12:25:44.481662 20453 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.512544 20161 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:44.551277 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.528590 20474 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.538646 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:44.534018 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:44.522581 20461 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.556859 15905 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:44.558288 20453 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.547104 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:44.523660 20331 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.575476 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:44.416360 15728 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 8, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 8 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:44.562107 20161 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.582273 15803 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:44.565963 15836 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.534082 20373 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:44.476164 20460 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.559796 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:44.584627 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 50727.2us
I20260709 12:25:44.604195 15879 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:44.563234 20395 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.578207 20094 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.508842 20469 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.614400 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:44.584717 20161 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.616010 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.619055 15834 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.602419 20459 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.575824 20405 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:44.602903 20383 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.585366 20465 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:25:44.649261 20383 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.649685 20465 consensus_queue.cc:1243] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:44.649864 20383 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.650324 20465 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:44.650767 20465 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.651834 20465 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.654842 20469 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.621132 20322 consensus_queue.cc:1059] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:25:44.656757 20459 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.657001 20319 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:44.657573 20319 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.657995 20459 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.658668 20319 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.660364 20319 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.579077 20462 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:25:44.663684 20350 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.667209 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.668020 15831 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:44.674520 20327 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.675089 20327 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.675204 20280 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.676573 15979 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.677909 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42798 (request call id 768) took 1311 ms. Trace:
I20260709 12:25:44.678421 16494 rpcz_store.cc:276] 0709 12:25:43.366140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.366259 (+   119us) service_pool.cc:224] Handling call
0709 12:25:44.677705 (+1311446us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b540039ce54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:44.677834 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239885056}
I20260709 12:25:44.615463 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:44.681773 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 66383.9us
I20260709 12:25:44.602602 20485 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:44.626281 20478 raft_consensus.cc:2764] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:44.633329 20479 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.634482 15836 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:44.634816 20460 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.635689 20372 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:44.581456 20458 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:44.583141 20361 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:44.620674 20453 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:44.645843 20405 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:44.646437 20487 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:44.647800 20443 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.613718 20094 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.585353 20490 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.604668 20373 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.686463 15979 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:44.688916 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:44.701797 20465 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.699858 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.612277 20395 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.710204 15830 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:44.717353 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:44.699746 20454 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:44.690006 20448 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.735806 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.736421 15835 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.736577 20280 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:44.734172 20478 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.737507 20478 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.700233 15913 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:44.697353 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.737859 20478 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.738268 15831 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:44.713469 20405 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.722890 20490 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.741707 20490 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.744050 15835 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:44.722533 20487 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.751871 20487 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.689379 20479 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:44.731230 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 48709.2us
I20260709 12:25:44.710026 20485 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.763803 15834 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:44.723125 20094 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.720847 20453 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:44.768882 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.768908 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.773165 15834 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:44.778113 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.778213 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.779358 15836 raft_consensus.cc:2368] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12.
W20260709 12:25:44.812695 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95418.6us
I20260709 12:25:44.763473 20479 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.815198 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.815187 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.816197 15834 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.777557 20448 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:44.818063 20448 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.825249 20496 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.836476 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.837496 15836 raft_consensus.cc:2376] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10. Re-sending same reply.
I20260709 12:25:44.846597 20458 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:44.848094 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.849184 20486 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:44.850059 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.851064 20458 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:44.851512 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.852592 20458 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.853108 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:44.853315 20458 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.855109 15834 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:44.856665 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:44.857647 15913 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:44.858321 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.858445 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.859337 15908 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:44.859750 15834 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:44.834748 20230 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:44.865422 20230 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.865842 20230 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.869354 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.870739 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.872005 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.872749 15838 raft_consensus.cc:2368] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
I20260709 12:25:44.873320 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.873505 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.874018 15909 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
W20260709 12:25:44.874413 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.876394 20495 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:44.881573 20485 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.885659 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.887357 20453 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.894225 20373 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.905130 20443 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:44.905296 20487 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:44.905917 20443 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.906056 20487 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.908931 20480 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:44.909485 20480 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.913371 15728 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 9 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:44.918752 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.919519 20395 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:44.920248 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.920338 20165 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:44.923918 20499 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:25:44.925288 20492 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.925954 20492 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:44.930259 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.931313 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:44.933007 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.934182 15829 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:44.916051 15728 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 7, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 7 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:44.936136 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:44.933483 20373 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.938208 15834 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:44.937186 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:44.941439 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:44.825836 20496 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.932410 20486 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:44.943014 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.932313 20462 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.944648 15834 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:44.945514 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:44.962031 15913 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:44.939457 20366 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:44.969714 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:44.932147 20161 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.945888 20461 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.936646 20327 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.980103 15829 raft_consensus.cc:1240] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:44.935784 20094 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.935461 20383 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:44.972532 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.942763 20506 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:44.971168 20165 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.987963 15913 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:44.987947 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1476) took 1227 ms. Trace:
I20260709 12:25:44.940799 20490 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.943104 20373 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:44.989805 15986 rpcz_store.cc:276] 0709 12:25:43.760433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.851217 (+ 90784us) service_pool.cc:224] Handling call
0709 12:25:44.131106 (+279889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:44.132050 (+   944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.987659 (+855609us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002c5950. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:44.987862 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642935040}
I20260709 12:25:44.996675 20027 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.997084 20094 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.001667 20400 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:45.002152 20400 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.002728 20327 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.005263 20458 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.007144 20366 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.007723 20366 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.008575 20161 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:45.009207 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:45.009807 15910 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.012063 20366 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.013183 15803 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:45.014312 20443 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.014890 20446 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.015435 20479 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.016294 15836 raft_consensus.cc:2410] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:45.016585 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.017565 15907 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.015388 20446 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:44.992878 20165 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.018826 20165 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.019573 15836 raft_consensus.cc:1240] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:45.019747 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:45.019917 20446 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.020332 15907 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.964809 20459 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:45.067102 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.075801 15910 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:45.076138 15983 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.070194 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:45.077129 16490 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 14: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:45.038887 15835 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.029721 15831 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 14: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:45.041714 15904 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:45.045900 15952 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:45.020942 15836 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:45.027827 15832 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:45.083086 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:45.028941 20457 log.cc:927] Time spent T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.975s	user 0.000s	sys 0.003s
I20260709 12:25:45.089604 15907 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:45.091653 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.091912 15987 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
W20260709 12:25:45.031618 20501 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 12:25:45.026670 20492 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:44.994586 20506 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:45.096554 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.130496 15913 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:44.943507 20478 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.095239 15907 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:45.113936 15830 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:45.031324 20383 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.031597 20366 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:45.032332 20446 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.025188 20496 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.147208 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:45.145536 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.160408 15913 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:45.160463 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:44.986778 20461 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:44.968256 20462 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.023306 20490 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.090543 20395 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:45.164813 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:45.097275 20475 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:45.134541 20486 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:45.183080 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.162288 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:45.187014 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.189054 15907 raft_consensus.cc:2368] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
I20260709 12:25:45.096717 20373 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.111176 20333 raft_consensus.cc:3060] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.146749 20329 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:45.165551 20455 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.025461 20375 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 12:25:45.156226 20366 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.095640 20414 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:25:45.210039 15834 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:45.210675 15830 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:45.095858 20469 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:25:45.194384 20461 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.165759 20161 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:45.215018 15952 leader_election.cc:400] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
I20260709 12:25:45.237206 15952 leader_election.cc:403] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:45.181460 20094 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:45.191922 20395 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.217939 15983 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:45.230741 15913 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:45.167640 20400 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.209610 20372 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:45.184754 20446 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.215409 20329 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.249523 15830 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:25:45.249953 15830 pending_rounds.cc:85] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 5
I20260709 12:25:45.250202 15830 pending_rounds.cc:107] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:45.250439 15830 raft_consensus.cc:2889] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:45.250808 15912 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.251020 20329 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:45.251498 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.252063 15830 raft_consensus.cc:3060] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:45.249830 20405 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.244174 20161 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.253582 20405 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:45.254962 20319 consensus_meta.cc:287] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.003s
I20260709 12:25:45.255903 20161 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.256649 20400 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.201848 20230 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.247493 20094 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.257875 15838 raft_consensus.cc:2410] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:45.258755 20230 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.259047 20094 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.246538 20372 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.259959 20372 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.271489 20490 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:45.272177 20490 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.229112 20479 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.232786 20366 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.205312 20475 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.280169 16487 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:45.023885 15728 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 7, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 7 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:25:45.241355 20474 consensus_meta.cc:287] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.004s
I20260709 12:25:45.283406 20319 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:45.244539 20395 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.287602 16495 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:45.217381 20165 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.297708 15728 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.301128 20319 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.304008 20319 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.308861 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.309561 15829 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 7.
I20260709 12:25:45.310114 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.311295 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.312494 16457 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:45.210351 20486 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.245596 20482 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.317639 15829 raft_consensus.cc:2393] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:45.317919 15830 raft_consensus.cc:2468] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:45.319422 16457 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:45.321518 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:45.229362 20455 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.245121 20506 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.329269 20027 raft_consensus.cc:2804] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:45.329897 20027 raft_consensus.cc:697] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:45.330922 20027 consensus_queue.cc:237] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.325078 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:45.338426 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.338778 16495 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:45.344543 16492 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:45.358073 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.317404 20310 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:45.363680 16495 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:45.364012 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:45.364692 16493 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.368955 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.367386 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.382269 16493 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:45.384927 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.386116 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.344084 20414 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
I20260709 12:25:45.387495 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.388926 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.394001 15980 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.386907 15829 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:45.394767 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:45.392582 16496 raft_consensus.cc:1240] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:45.393134 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:45.396215 16488 raft_consensus.cc:2368] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:45.397540 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34602 (request call id 693) took 1485 ms. Trace:
I20260709 12:25:45.397933 16487 rpcz_store.cc:276] 0709 12:25:43.912431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.970144 (+ 57713us) service_pool.cc:224] Handling call
0709 12:25:45.397372 (+1427228us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54005a4454. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:45.397486 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973228416}
I20260709 12:25:45.399538 15905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2945) took 1149 ms. Trace:
I20260709 12:25:45.399936 15905 rpcz_store.cc:276] 0709 12:25:44.250294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.251561 (+  1267us) service_pool.cc:224] Handling call
0709 12:25:44.251833 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.571092 (+319259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.399274 (+828182us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54001536d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:45.399448 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700925312}
I20260709 12:25:45.402436 15905 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:45.407877 20502 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.689s	user 0.002s	sys 0.000s
I20260709 12:25:45.415292 15837 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:25:45.415738 15837 pending_rounds.cc:85] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 7
I20260709 12:25:45.416035 15837 pending_rounds.cc:107] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:25:45.416333 15837 raft_consensus.cc:2889] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:45.368069 20310 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:45.417733 20310 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:45.419592 20372 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.300539 15728 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.422082 15728 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:25:45.427338 20490 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.430303 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.430867 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.439460 15985 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:45.440703 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.396345 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.448101 15987 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:45.449879 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.450770 15983 raft_consensus.cc:2368] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:45.451361 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:45.453263 15979 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 2046) took 1010 ms. Trace:
I20260709 12:25:45.456288 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:45.457026 15904 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.453697 15979 rpcz_store.cc:276] 0709 12:25:44.443288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.443444 (+   156us) service_pool.cc:224] Handling call
0709 12:25:45.453107 (+1009663us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540037d554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:45.453209 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482597632}
I20260709 12:25:45.463088 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.463655 15985 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:45.444446 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:45.471827 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.487504 15983 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:45.485925 15911 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.494647 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.487782 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:45.479511 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.490026 15986 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:45.466902 20383 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.496199 15834 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:45.475028 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:45.499466 15905 raft_consensus.cc:1275] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:45.499883 15905 pending_rounds.cc:85] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 10
I20260709 12:25:45.475063 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:45.500126 15905 pending_rounds.cc:107] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:45.500434 15905 raft_consensus.cc:2889] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:45.499339 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:45.472760 15950 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.65:38945 timed out after 1.577s (SENT) [suppressed 44 similar messages]
W20260709 12:25:45.522388 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 307503us
I20260709 12:25:45.525455 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.472882 20333 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:45.527490 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:45.481176 20464 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:45.531865 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 287265us
I20260709 12:25:45.535552 15834 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:45.472182 20280 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:45.537154 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:45.538998 20475 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.497958 20405 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:45.487454 20161 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.497442 20490 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.509338 20400 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:45.565598 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.568411 16490 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:25:45.570042 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.570663 15905 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 8.
I20260709 12:25:45.562731 20372 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.573988 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.558511 20379 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.554234 20333 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.528475 20485 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:25:45.573024 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:45.558825 20464 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:45.512758 20383 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.540339 20443 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:45.567456 20478 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.569367 20400 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:45.601230 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:45.604528 15905 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: [11.11-13.12]
W20260709 12:25:45.605379 20514 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:25:45.605844 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:45.574319 20446 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.572289 20165 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.560611 20161 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.561553 20490 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:45.614205 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 147810us
I20260709 12:25:45.595492 20486 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.618254 15904 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:45.619736 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 168427us
I20260709 12:25:45.623535 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:45.624226 15904 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.618870 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:45.628078 20123 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:45.628654 20123 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:45.629220 20094 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:45.630008 20094 consensus_queue.cc:1048] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:45.630684 20369 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:45.629814 20123 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.631074 20369 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:45.629766 16487 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:45.587090 20414 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:45.673979 16489 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:45.595530 20379 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.621788 20455 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.670994 20310 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.678761 15904 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:45.696941 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:45.702914 20512 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:25:45.704391 20280 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:45.705713 15904 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:45.705943 20487 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.707002 15904 raft_consensus.cc:1240] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:45.672448 20369 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:45.704869 20280 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.709609 20482 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:45.710062 20482 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:45.713492 20515 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:25:45.715890 20310 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.718508 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 3002) took 1154 ms. Trace:
I20260709 12:25:45.718911 15838 rpcz_store.cc:276] 0709 12:25:44.564080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.885374 (+321294us) service_pool.cc:224] Handling call
0709 12:25:45.718300 (+832926us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54001f09d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:45.718447 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853925120}
I20260709 12:25:45.721411 20400 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.722150 15835 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:25:45.722474 15835 pending_rounds.cc:85] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 7
I20260709 12:25:45.722707 15835 pending_rounds.cc:107] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:45.722959 15835 raft_consensus.cc:2889] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:45.728937 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.729929 20383 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.733242 20464 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:45.735173 15980 raft_consensus.cc:2468] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:45.735621 20369 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.628830 20375 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:25:45.709224 20489 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:25:45.700179 16459 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:45.738058 15910 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:45.628654 20506 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:25:45.792618 15907 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:45.800174 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 100097us
I20260709 12:25:45.728786 20485 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:25:45.831159 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.833473 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.834151 15838 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
W20260709 12:25:45.836292 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 216582us
I20260709 12:25:45.836450 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.837644 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:45.843513 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 284571us
I20260709 12:25:45.845530 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.837150 15802 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:45.847010 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.847719 15838 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:45.863551 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.811726 20165 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:45.865690 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.867343 15837 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.868981 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:45.872737 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:45.874905 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:45.865792 20528 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:45.889328 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.890188 15980 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:45.896456 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.897015 15985 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.871286 20458 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:25:45.901276 20372 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:45.902164 20524 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.301s	user 0.002s	sys 0.000s
I20260709 12:25:45.903262 20522 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:45.908813 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.909832 15982 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 14: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:45.911188 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.911755 15983 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:45.914647 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.916217 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.917196 15986 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:45.923820 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:45.874204 20405 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:45.871133 20486 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.942531 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:45.883270 20383 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:45.868140 20535 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.944898 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:45.881979 20165 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:45.946244 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.912416 20333 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:45.912815 20505 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.951946 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.953342 15985 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:45.940274 20446 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:45.943463 20485 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:45.959038 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.004848 15983 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:45.960832 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.986445 15986 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:45.956817 20519 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 12:25:45.990325 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.009588 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.010257 15982 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:46.010370 15979 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:45.991313 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:45.940658 20375 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:25:45.928316 20525 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:45.956326 20414 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:25:46.019057 15836 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:46.026651 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:45.989686 20479 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.028750 15836 pending_rounds.cc:85] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:46.002539 20161 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:45.993835 20486 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.006345 20485 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:46.004089 20446 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.037300 15979 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:46.033165 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.084139 15982 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:46.030932 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:46.092558 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 68955.6us
I20260709 12:25:46.094398 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:46.032866 15836 pending_rounds.cc:107] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:46.096623 15838 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:46.004470 20546 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:25:46.028712 20461 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.032574 20544 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.097465 20414 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:46.062271 20379 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.103894 20535 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:46.111646 20395 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.787s	user 0.002s	sys 0.007s
I20260709 12:25:46.112756 20538 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:46.113132 20165 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.114904 20280 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.115917 20474 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:46.081301 20485 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:46.117261 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 211291us
I20260709 12:25:46.008960 20505 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:46.044239 20530 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:25:46.139293 15836 raft_consensus.cc:2889] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:46.143471 20123 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.144654 20310 consensus_queue.cc:1059] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:46.145654 20241 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.145730 20165 raft_consensus.cc:3055] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:46.146284 20165 raft_consensus.cc:740] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:46.147163 20165 consensus_queue.cc:260] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.149116 16457 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:46.150069 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 119219us
I20260709 12:25:46.126981 20538 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.043884 20506 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:25:46.149823 20161 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:46.126739 20395 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.169117 20395 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.169291 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.169764 15988 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.175630 20516 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.176648 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.176872 20516 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.183975 15837 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:25:46.056399 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 126393us
I20260709 12:25:46.040091 20405 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:46.123450 20366 consensus_meta.cc:287] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.000s
W20260709 12:25:46.040473 20537 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:25:46.058036 20479 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:46.207988 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.144546 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:46.097257 20548 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:25:46.131618 20280 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.126374 20535 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.125851 20461 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.166718 15905 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:46.195999 16489 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:46.125469 20544 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.198308 15904 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:46.242539 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:46.196379 20564 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:46.252393 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 103372us
I20260709 12:25:46.125612 20414 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.186502 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:46.254918 15911 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:46.209735 15836 raft_consensus.cc:2368] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
W20260709 12:25:46.248848 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 334475us
I20260709 12:25:46.221253 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:46.210419 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 112687us
I20260709 12:25:46.215723 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.257519 15837 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
W20260709 12:25:46.242697 20502 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:46.260289 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:46.263190 20414 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.263831 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.264386 20414 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.161538 20446 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.312191 20446 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.250540 20535 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.318014 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2953) took 1273 ms. Trace:
I20260709 12:25:46.283228 15833 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:46.285127 20490 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.285650 20516 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.324656 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:46.285866 20462 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.286017 20505 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.287182 20544 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.279114 20538 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.287819 20479 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.288012 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:46.288967 20550 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:46.289995 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 3016) took 1543 ms. Trace:
I20260709 12:25:46.348131 15831 rpcz_store.cc:276] 0709 12:25:44.746580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.919994 (+173414us) service_pool.cc:224] Handling call
0709 12:25:46.289797 (+1369803us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b540003a2d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:46.289917 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222143232}
I20260709 12:25:46.348656 20165 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.295164 20486 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:46.298548 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 844526us
I20260709 12:25:46.261284 20564 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.286382 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.254154 20558 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.304837 20027 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:46.305064 20480 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.309412 20548 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:46.309621 16492 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:46.309911 19718 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:46.320254 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 66822.4us
I20260709 12:25:46.318441 15913 rpcz_store.cc:276] 0709 12:25:45.045053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.247546 (+202493us) service_pool.cc:224] Handling call
0709 12:25:45.256733 (+  9187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.371073 (+114340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.371105 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:45.389967 (+ 18862us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.626093 (+236126us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:45.626135 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.317532 (+691397us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540010ca54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:46.317587 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.317654 (+    67us) raft_consensus.cc:1685] finished
0709 12:25:46.317674 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.317958 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":163,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":60544,"spinlock_wait_cycles":241916288,"thread_start_us":146443,"threads_started":1,"wal-append.queue_time_us":337816}
I20260709 12:25:46.413228 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:46.340593 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:46.346976 20538 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:46.325206 20161 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:46.349493 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 983) took 1002 ms. Trace:
I20260709 12:25:46.299319 20241 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:46.197415 20366 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.290753 20461 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:46.370302 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.372696 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.422257 15834 rpcz_store.cc:276] 0709 12:25:45.346697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.544892 (+198195us) service_pool.cc:224] Handling call
0709 12:25:45.546081 (+  1189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.613267 (+ 67186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.613312 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:45.621246 (+  7934us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.988774 (+367528us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:45.988817 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.304398 (+315581us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540003a7d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:46.304444 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.349218 (+ 44774us) raft_consensus.cc:1685] finished
0709 12:25:46.349238 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.349433 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1513,"raft.queue_time_us":64143,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":23261,"spinlock_wait_cycles":149758336,"thread_start_us":292514,"threads_started":1,"wal-append.queue_time_us":483263}
W20260709 12:25:46.428347 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 55754.1us
I20260709 12:25:46.429752 15879 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.384183 20027 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:46.331894 16489 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:25:46.405567 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.417960 15982 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:46.437929 15879 leader_election.cc:400] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:46.438220 15879 leader_election.cc:403] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:46.418124 15980 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:46.418555 20365 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.442677 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.420827 15909 raft_consensus.cc:2393] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:46.369433 20505 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.443334 15982 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:46.424707 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.425524 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.426388 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.431892 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.432677 15984 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.433050 20366 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.426806 20161 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.442598 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:46.458689 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 210684us
W20260709 12:25:46.435952 20369 consensus_meta.cc:287] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.002s
I20260709 12:25:46.485505 15909 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:46.485774 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.398666 20564 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.440039 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:46.487018 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47039.6us
I20260709 12:25:46.447065 20475 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:46.460163 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:46.488763 15833 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:46.436190 20559 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.436386 20464 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:46.442598 20480 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:46.495213 20480 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.495594 20480 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.489965 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:46.497623 15829 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 12:25:46.498425 20400 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:46.498932 20400 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.499331 20400 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:46.481410 15834 raft_consensus.cc:1275] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:46.386768 20548 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.503048 20453 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:46.503183 20548 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.426892 20506 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.503537 20453 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.503955 20453 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:46.503865 20506 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.504127 20464 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:46.505882 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.506242 15879 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.460011 20161 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:46.475214 20482 consensus_meta.cc:287] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 12:25:46.473342 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.423467 20558 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.494211 20559 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.506506 15838 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:46.507839 20329 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:46.443303 20486 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.506093 20506 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.515508 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:46.516402 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.509397 20482 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.520800 16496 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:46.516860 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:46.521610 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 335185us
I20260709 12:25:46.522145 15833 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:46.528693 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.529698 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.529071 16495 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:46.529632 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.473757 20505 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.478966 20459 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:25:46.537647 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 75522.7us
I20260709 12:25:46.519558 20372 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:46.520079 20329 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.518092 20558 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.541827 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:46.487752 20567 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:25:46.548411 16486 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:46.520207 20464 raft_consensus.cc:2804] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:46.548134 20576 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:46.532708 20544 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.546799 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.550452 16487 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:46.551728 20310 consensus_queue.cc:1048] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:46.535938 20486 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.554610 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34608 (request call id 993) took 1286 ms. Trace:
I20260709 12:25:46.556751 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2055) took 1197 ms. Trace:
I20260709 12:25:46.537392 20366 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.568550 20366 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:46.569537 20574 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:25:46.569684 20329 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.570787 20366 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.570967 20329 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.571805 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1558) took 1043 ms. Trace:
I20260709 12:25:46.572253 20559 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.572201 15910 rpcz_store.cc:276] 0709 12:25:45.527982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.607882 (+ 79900us) service_pool.cc:224] Handling call
0709 12:25:45.608199 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.793380 (+185181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.571559 (+778179us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400340654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:46.571749 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298075520}
I20260709 12:25:46.574159 20535 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.576228 20535 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.576136 20400 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.542955 20485 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.577235 16493 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.578514 20480 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.565579 16490 rpcz_store.cc:276] 0709 12:25:45.267737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.273230 (+  5493us) service_pool.cc:224] Handling call
0709 12:25:45.273599 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.568811 (+295212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.554367 (+985556us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54005ec254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:46.554536 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677326720}
W20260709 12:25:46.580204 15952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.581615 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.566465 15987 rpcz_store.cc:276] 0709 12:25:45.359790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.479287 (+119497us) service_pool.cc:224] Handling call
0709 12:25:45.490442 (+ 11155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.490678 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:45.620109 (+129431us) log.cc:844] Serialized 14 byte log entry
0709 12:25:46.556119 (+936010us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b1800333c40. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe4323a
0709 12:25:46.556331 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:46.556390 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:46.556455 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.556550 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.556682 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":300204,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1598,"spinlock_wait_cycles":215096192,"thread_start_us":333628,"threads_started":2,"wal-append.queue_time_us":330243}
W20260709 12:25:46.590754 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49004.3us
I20260709 12:25:46.591251 20165 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:46.591357 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44123.6us
I20260709 12:25:46.613003 15834 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:46.592073 20490 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:46.615459 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.592525 20482 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.520119 20027 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.616499 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.557950 20464 raft_consensus.cc:697] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:46.616881 20369 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:46.597801 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:46.617519 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.617585 20464 consensus_queue.cc:237] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.618621 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.619612 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:46.620103 15908 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.619920 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.601002 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 980) took 1350 ms. Trace:
I20260709 12:25:46.565204 20544 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.620963 20333 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:46.621389 20333 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.621835 20333 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.622658 20544 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.601564 20486 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.579314 20558 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.607895 15910 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:46.629914 15838 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:46.610649 16457 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.610934 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.630527 15983 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:46.621186 15830 rpcz_store.cc:276] 0709 12:25:45.250735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.495641 (+244906us) service_pool.cc:224] Handling call
0709 12:25:45.497255 (+  1614us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:45.502336 (+  5081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.502363 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:46.308215 (+805852us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b2c00057528. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:25:46.308758 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 12:25:46.467463 (+158705us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:46.467496 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.467559 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.600691 (+133132us) raft_consensus.cc:1685] finished
0709 12:25:46.600712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.600923 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92052,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8631,"spinlock_wait_cycles":17409792,"thread_start_us":158365,"threads_started":1,"wal-append.queue_time_us":228430}
I20260709 12:25:46.630966 15833 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:46.611099 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:46.631587 15909 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.609853 16495 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:46.558038 20576 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:46.634754 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.635941 15835 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:46.624835 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.602150 20505 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:46.625800 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.627274 15834 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:46.629449 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.634393 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.589298 20535 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.645677 15829 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:46.645907 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.647663 15913 raft_consensus.cc:2368] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11.
I20260709 12:25:46.640405 16493 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:46.557384 20564 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:25:46.612869 20165 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.650012 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.652897 15834 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:46.655234 15908 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:46.624169 20479 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.657285 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.658154 15908 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:46.661046 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.663187 15908 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:46.642259 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:46.666548 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.667269 15838 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:46.669621 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.644389 20482 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:46.641294 20405 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.623925 20465 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:25:46.629828 20567 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 12:25:46.681531 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56053.6us
I20260709 12:25:46.682324 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.673157 15830 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:46.645213 20375 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:46.679780 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:46.662204 20165 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.679800 15909 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:46.644107 20310 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:46.685382 15952 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:46.681073 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 83329us
I20260709 12:25:46.670547 15908 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:46.687042 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.687264 15912 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:46.688180 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:46.689410 20523 raft_consensus.cc:2804] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:46.690025 20523 raft_consensus.cc:697] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.690266 20591 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.690940 20400 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.690783 20591 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.693791 20486 raft_consensus.cc:3055] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:46.694267 20486 raft_consensus.cc:740] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:46.695174 20475 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.684912 20535 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.700155 20535 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.702593 15910 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:46.676852 20482 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:46.709489 20400 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:46.703446 20375 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:46.717029 20475 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:46.717288 20375 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:46.721854 20583 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:25:46.708909 20280 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.723691 20593 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:46.724360 20480 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.725545 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:46.726394 20593 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:46.726908 20593 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.727427 20593 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.701706 20558 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:46.730230 20453 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.730866 20558 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.731247 20558 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.732226 20453 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.733273 15906 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:46.733546 20453 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:46.734028 20551 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.483s	user 0.004s	sys 0.000s
I20260709 12:25:46.735900 20485 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.736366 20453 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:46.739372 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:46.664332 20479 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:46.741962 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 55002.2us
I20260709 12:25:46.683746 20464 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.743674 15802 leader_election.cc:400] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11.
I20260709 12:25:46.744213 20383 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.715328 20482 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.745862 20333 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.747144 20479 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:46.748483 20554 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 12:25:46.749743 15911 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:46.749639 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:46.769657 15830 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:46.678248 20405 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.751801 20532 raft_consensus.cc:3055] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:46.752916 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1492) took 1703 ms. Trace:
I20260709 12:25:46.776862 15988 rpcz_store.cc:276] 0709 12:25:45.050019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.050156 (+   137us) service_pool.cc:224] Handling call
0709 12:25:45.090937 (+ 40781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.170166 (+1079229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.752697 (+582531us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002f67d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:46.752860 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480668032}
I20260709 12:25:46.759016 20591 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.690938 20523 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.743116 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:46.761953 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:46.762533 15802 leader_election.cc:403] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:46.761889 20400 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:46.779968 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:46.780673 15910 raft_consensus.cc:2368] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:46.784528 15830 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:46.785470 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:46.710443 20161 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.769407 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:46.786943 15905 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:46.787075 15836 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:25:46.789655 15836 pending_rounds.cc:85] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 7
I20260709 12:25:46.789918 15836 pending_rounds.cc:107] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:25:46.790190 15836 raft_consensus.cc:2889] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:46.768982 20480 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.779830 15802 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:46.793159 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:46.793771 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.795544 15802 leader_election.cc:400] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:46.795852 15802 leader_election.cc:403] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:25:46.797502 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 54423.4us
I20260709 12:25:46.798292 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.776665 20532 raft_consensus.cc:740] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:46.786258 20383 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.802315 15950 leader_election.cc:400] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
I20260709 12:25:46.768196 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.804682 15879 leader_election.cc:400] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:46.791894 20369 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.776199 20453 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:46.805073 15879 leader_election.cc:403] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:46.795320 20465 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:46.802287 20280 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.799616 20538 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:46.810482 20538 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.811105 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.811384 20538 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.812044 20414 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:46.817248 20465 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:46.818410 20465 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.812275 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:46.822289 20161 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.823823 20329 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:46.824939 20329 consensus_queue.cc:1059] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:46.825060 20372 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:46.825690 20329 raft_consensus.cc:3055] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:46.826013 20329 raft_consensus.cc:740] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:46.827075 16488 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:46.826815 20329 consensus_queue.cc:260] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.828053 20329 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.830109 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:46.802656 20470 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9.
I20260709 12:25:46.844830 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.846740 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:46.847380 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:46.806242 20591 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:46.871642 16489 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:46.799276 20366 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:25:46.799681 20544 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:25:46.808347 20369 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.795120 20480 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.799477 20459 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:25:46.800472 20535 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:25:46.901023 20333 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:46.901388 20573 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.515s	user 0.000s	sys 0.003s
I20260709 12:25:46.904384 20383 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11.
W20260709 12:25:46.910113 20592 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:25:46.873756 20319 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.865335 20464 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11.
I20260709 12:25:46.918308 20567 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:25:46.918905 20474 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.918927 20329 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:46.919706 20535 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:46.920080 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:46.921475 20333 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:46.878116 20479 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:46.933514 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 111079us
I20260709 12:25:46.877063 20591 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:46.865842 20461 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:25:46.866191 20564 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:25:46.873591 20594 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:25:46.922099 20400 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.878242 20593 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.932935 20535 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:46.963783 20480 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.940637 20522 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:46.983632 20522 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.983191 20535 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:46.984026 20522 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.984470 20535 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:46.985775 20567 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.986315 20567 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.934597 20479 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:46.988684 20479 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:46.966137 20564 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:46.989436 20564 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:46.990188 20564 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.991299 20564 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.939038 20566 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:46.993108 20544 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.974798 20027 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.993978 20461 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.993844 20544 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.994485 20461 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.995999 20544 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.979341 20369 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:46.982087 20165 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.996454 20461 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.988297 20567 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.997457 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:46.998169 20165 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:46.998647 20567 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:46.998875 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:46.999161 20567 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.001176 20567 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.000918 20576 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.002050 20576 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.937549 20474 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.006875 20474 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:46.993307 20566 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:47.008108 20566 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:46.999512 15985 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
W20260709 12:25:46.980857 15718 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9fd62f0fa06a4561a0a7101b85942f86 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:25:47.011119 15718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61393.8us
I20260709 12:25:47.012135 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.013784 15985 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.014586 15832 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:25:47.015050 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 76017.7us
I20260709 12:25:47.026347 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.027825 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.029402 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.030870 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.031713 15980 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:47.032215 19718 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:47.033771 20490 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.034147 20490 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:47.034888 20490 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.035306 20566 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:47.035992 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.043037 15904 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.032701 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:47.036607 15982 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:47.037156 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.044844 15986 raft_consensus.cc:2410] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:25:47.042974 15981 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:25:47.030933 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:47.045588 15979 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.044649 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:47.037884 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:47.039902 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.047281 15831 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.056460 15980 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 8: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:47.057559 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.055190 15803 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.058346 15838 raft_consensus.cc:2410] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:47.058161 15981 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:47.059587 15985 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:47.062393 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:46.943222 20329 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:25:47.065204 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:47.065830 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49696us
I20260709 12:25:47.066385 15803 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.042713 20490 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.070351 20365 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:47.060985 20405 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:47.077674 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 205312us
I20260709 12:25:47.078090 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:47.078691 16487 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:47.079321 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:47.096735 15979 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:47.068065 20567 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:47.068396 20474 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.099844 20474 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.100241 20474 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.101150 20591 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.103133 20251 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.104509 15907 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.109368 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.111833 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.106905 20482 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.114074 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.115732 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.116636 15910 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:47.113921 15950 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.120986 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:47.121323 15911 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:47.121600 16487 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:47.122371 15907 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:25:47.130430 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 285653us
I20260709 12:25:47.132516 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.141273 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.146492 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.144440 15950 leader_election.cc:400] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13.
I20260709 12:25:47.076709 20522 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.148335 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.103065 20464 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:47.158699 15907 raft_consensus.cc:1240] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:47.166877 15988 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.111692 20594 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:25:47.168946 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:47.170185 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 66268.8us
W20260709 12:25:47.170989 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.171518 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.172310 15984 raft_consensus.cc:1240] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.174525 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.161342 20405 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:47.161538 20280 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:47.155647 20251 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.177548 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.110579 20558 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.186669 20523 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:47.187032 20329 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.201521 20329 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:47.177383 20538 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.204679 20482 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:47.164830 20564 consensus_queue.cc:1059] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:25:47.205422 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.207346 15979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:47.207892 15979 raft_consensus.cc:606] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.208189 15979 raft_consensus.cc:614] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:47.209429 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.210186 15980 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:47.210602 15986 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
W20260709 12:25:47.210688 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.210978 15986 pending_rounds.cc:85] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 11
I20260709 12:25:47.211265 15986 pending_rounds.cc:107] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:47.211531 15986 raft_consensus.cc:2889] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.213009 15982 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:47.213343 20333 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.214948 20333 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.215529 20333 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.224201 20522 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.141996 20414 consensus_queue.cc:1059] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:25:47.227280 20414 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:47.227864 20414 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.229094 20602 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:47.182515 20544 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.231026 20544 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:47.231554 20544 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.156008 20535 consensus_queue.cc:1059] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:25:47.178673 20465 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:47.147589 20372 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:25:47.201959 20329 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.235006 20372 raft_consensus.cc:3055] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:47.235349 20372 raft_consensus.cc:740] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:47.236126 20372 consensus_queue.cc:260] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.164937 20446 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:47.179472 20567 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:25:47.238808 20558 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:47.179586 20461 consensus_queue.cc:1059] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:25:47.239712 20461 raft_consensus.cc:3055] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.240111 20383 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.241299 20280 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:47.178299 20405 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:47.241644 20329 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.242264 20405 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.242400 20280 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.244583 20329 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.246238 20532 consensus_queue.cc:260] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.240065 20461 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:47.240056 20593 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:47.247777 20414 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.147320 20479 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:47.280328 20555 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:47.257320 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:47.281543 16487 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:47.255018 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 54669.7us
I20260709 12:25:47.259615 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:47.305888 16493 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.315536 16487 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:25:47.266916 15988 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:47.271623 15831 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:47.276412 20532 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.277391 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:47.278267 20461 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:47.278959 20596 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:25:47.190567 20464 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:47.327755 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.330610 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.290036 20486 consensus_queue.cc:260] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.291337 20375 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:47.293545 20598 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.336s	user 0.002s	sys 0.001s
I20260709 12:25:47.318915 15953 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:47.283663 20372 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:47.338372 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.339135 15910 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
W20260709 12:25:47.344859 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 212411us
I20260709 12:25:47.345810 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.320516 16493 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:47.325764 15983 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:47.287382 20479 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:47.360376 15910 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:47.331185 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.305222 15803 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.303054 20474 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.361308 15908 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:47.390461 15983 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:47.337740 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:47.363176 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:47.394181 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 89039.8us
I20260709 12:25:47.395181 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:47.392206 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 46501.6us
I20260709 12:25:47.408144 15838 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:47.411311 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 239864us
I20260709 12:25:47.412290 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.415513 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.414885 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.416080 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:47.339845 20414 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:47.417354 15833 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:47.403797 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.389183 20461 raft_consensus.cc:3060] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.418529 15831 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:47.419178 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.435045 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.435907 15830 raft_consensus.cc:2368] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 13.
I20260709 12:25:47.420193 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.437047 15838 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:47.421382 15982 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:47.426224 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:47.438346 15833 raft_consensus.cc:2393] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:47.438616 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.416329 20612 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.440205 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:47.440637 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:47.444896 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.403265 20567 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:47.445884 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:47.403319 20459 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:47.457976 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.458650 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.402283 20607 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.419221 20251 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.402376 20540 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.467638 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:47.469092 15829 raft_consensus.cc:2368] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14.
I20260709 12:25:47.428471 20557 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:47.469779 15911 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:25:47.472172 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.476089 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:47.339843 20375 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.476797 15909 raft_consensus.cc:2368] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11.
I20260709 12:25:47.446880 20622 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.445850 20414 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:47.452404 20567 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:47.464511 20594 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.506383 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.440308 20027 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:47.418599 20479 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:25:47.486003 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:47.527824 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:47.528043 15909 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.486624 15830 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
W20260709 12:25:47.487062 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 72247.3us
I20260709 12:25:47.529356 15879 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.451526 15831 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:47.473786 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.530646 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.533282 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:47.536237 15836 raft_consensus.cc:2368] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9.
I20260709 12:25:47.537292 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.537855 15830 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.539081 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.539793 15829 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.548370 15830 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:47.554095 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.557737 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.515594 15950 leader_election.cc:400] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 13.
W20260709 12:25:47.570218 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 54812.9us
I20260709 12:25:47.571238 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:47.513514 20576 consensus_meta.cc:287] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 12:25:47.572043 15913 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:47.572896 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.457068 20612 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.471109 20251 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:47.521183 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.522316 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:47.523641 16459 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.511473 20567 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.577693 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.581835 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:47.535418 19718 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:47.477962 20446 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:25:47.469727 20459 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.484313 15838 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:47.532178 20559 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.587446 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:47.589862 15952 leader_election.cc:400] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11.
I20260709 12:25:47.581269 20538 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.597386 15909 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:47.462703 20464 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.590651 20251 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.607208 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:47.610360 15952 leader_election.cc:403] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:47.505838 20557 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:47.477138 20540 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.612876 15988 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:47.614315 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 85055.6us
I20260709 12:25:47.623057 15879 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.614372 15835 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:47.601584 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:47.592278 20333 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.619421 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.571709 20453 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:25:47.620647 15838 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:47.538595 20506 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:25:47.624229 15834 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:47.587641 20482 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:47.641829 20625 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:25:47.636490 20446 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) with higher term. Message: Invalid argument: T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11.
I20260709 12:25:47.650206 20540 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.631673 20558 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:47.650983 20558 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:47.651818 20558 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.654309 20375 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:47.654811 15984 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:47.635372 20414 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.656291 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.657728 15988 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:47.659075 20612 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:47.659344 20366 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:47.659761 20474 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:47.660625 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:47.620368 20027 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.670166 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:47.670790 16460 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.622340 20463 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.671891 20576 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:47.676602 15982 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 12:25:47.671128 15835 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:47.677451 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.683193 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.616289 20559 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.684728 15983 raft_consensus.cc:2410] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:25:47.688242 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:47.690801 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:47.691519 15988 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:47.620858 20538 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.679535 19718 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:47.690445 20620 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.273s	user 0.001s	sys 0.001s
I20260709 12:25:47.685087 20576 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:47.687480 20474 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:47.725184 20474 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:47.725625 20474 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.693019 20366 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:47.717916 20624 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:47.718001 20566 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:47.718482 20557 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.681361 20490 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:25:47.680265 20446 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:25:47.700579 20564 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:47.715237 20610 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:25:47.701103 20535 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:25:47.767426 20251 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.729436 20576 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:47.730525 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 206958us
W20260709 12:25:47.767496 20626 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:47.746201 19718 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:25:47.761943 20566 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:47.760242 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 189077us
I20260709 12:25:47.745770 20375 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:47.792265 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:47.809350 16486 raft_consensus.cc:606] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:47.772887 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 136113us
I20260709 12:25:47.803650 15829 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:47.816681 15835 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:47.819267 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:47.810168 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:47.792898 20544 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.000s
W20260709 12:25:47.794751 20628 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:25:47.830405 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 248651us
I20260709 12:25:47.830466 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 2077) took 1078 ms. Trace:
I20260709 12:25:47.835057 20638 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.835539 20638 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.831132 15832 rpcz_store.cc:276] 0709 12:25:46.752257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.761237 (+  8980us) service_pool.cc:224] Handling call
0709 12:25:47.830253 (+1069016us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400082d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:47.830392 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332248320}
I20260709 12:25:47.807897 20459 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:47.839905 15986 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:47.840448 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 163156us
I20260709 12:25:47.844815 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.793154 20310 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 12:25:47.853417 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 162545us
I20260709 12:25:47.827561 20622 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.825500 20446 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:47.843015 20631 log.cc:927] Time spent T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:25:47.857839 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:47.832829 20544 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.868129 20564 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:47.859126 20559 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:47.879976 15833 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:47.861666 20505 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.886396 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:47.900164 20405 consensus_meta.cc:287] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 12:25:47.904340 20540 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:47.904783 20540 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:47.905656 20540 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.906826 20540 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.906257 20564 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.908329 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:47.908933 16486 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:47.865715 20251 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:47.912679 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:47.869895 20538 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:47.918867 20372 consensus_meta.cc:287] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.003s
I20260709 12:25:47.850675 20566 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.900621 20405 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:47.874421 20645 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.927176 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:47.927753 16486 raft_consensus.cc:606] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.928084 16486 raft_consensus.cc:614] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:47.878661 20375 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:25:47.918856 16013 heartbeater.cc:646] Failed to heartbeat to 127.14.78.126:37123 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.78.126:37123 timed out after 15.000s (SENT)
I20260709 12:25:47.921685 20365 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:47.953428 20544 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:47.963019 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 76678.5us
I20260709 12:25:47.965390 20251 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:47.965829 20251 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:47.966218 20251 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:47.966526 20633 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:25:47.969763 20602 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.970417 20602 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:47.978506 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:47.979115 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:47.937150 20638 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:47.986174 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:47.986749 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.946310 20566 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:47.994222 15985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:47.995057 15985 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:47.999089 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.000677 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.001812 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:47.945092 20365 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.013752 20372 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.020356 20372 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.022446 20372 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:48.031894 20558 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.032734 20486 raft_consensus.cc:3060] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.032645 20558 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.037240 20280 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:48.037640 20280 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:48.038719 15988 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:48.038431 20280 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.039326 20280 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.041786 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.041347 20365 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.058270 20558 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:48.060017 15833 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:48.065318 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:48.045397 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.069175 20575 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.069664 20575 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.073827 20486 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:48.083861 20405 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:48.085130 20461 consensus_meta.cc:287] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
W20260709 12:25:48.085479 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 462454us
I20260709 12:25:48.086475 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.087316 15879 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:48.006920 20637 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:48.098335 16493 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:48.101490 15950 leader_election.cc:400] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14.
I20260709 12:25:48.101956 15950 leader_election.cc:403] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 12:25:48.045871 20532 consensus_meta.cc:287] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.720s	user 0.001s	sys 0.011s
I20260709 12:25:48.100838 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.118986 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.119453 15950 leader_election.cc:400] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9.
I20260709 12:25:48.119854 15950 leader_election.cc:403] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:48.120457 16492 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:25:48.123528 15830 raft_consensus.cc:2410] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:48.119041 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.138361 15831 raft_consensus.cc:2468] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:48.016392 20602 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:48.142848 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.143872 16487 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:48.147037 16492 raft_consensus.cc:2410] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:48.104295 20333 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:48.118217 20622 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:48.018602 20576 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.151631 16487 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:48.104501 20637 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.041168 20567 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.140872 20486 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:48.156559 20461 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.157107 20522 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:48.158504 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.158999 15838 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:48.168931 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:48.169305 15829 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:48.172492 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.149758 20400 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:48.204823 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.215101 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.215739 15905 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:48.160472 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 286139us
I20260709 12:25:48.150243 20446 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.187990 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.103902 20474 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.195000 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.196633 15982 raft_consensus.cc:1240] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:48.200497 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.219853 15833 raft_consensus.cc:2410] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:48.206545 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.206983 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.202199 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.220691 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.222105 15833 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:48.152758 20623 raft_consensus.cc:2764] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:48.223042 15838 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:48.233196 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.235828 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.173166 20637 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.237491 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.238255 15987 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.152627 20594 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 12:25:48.254294 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 288742us
I20260709 12:25:48.255304 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.259562 15832 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:48.256492 20602 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.217474 20486 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:48.263890 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 120227us
W20260709 12:25:48.265398 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 96545.4us
I20260709 12:25:48.268766 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:48.231869 20538 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:48.272821 16459 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.281193 15988 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:48.187534 20461 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.343389 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.256870 20522 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:48.343803 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 75097.1us
I20260709 12:25:48.256662 20490 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.358772 15987 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
W20260709 12:25:48.359521 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:48.360458 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 88157.1us
W20260709 12:25:48.342226 20610 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:48.360775 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:48.363083 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 107907us
I20260709 12:25:48.366231 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.366235 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.369217 15876 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.369904 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:48.289523 20538 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:48.373888 15909 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:48.344750 20636 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.348109 20612 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.353590 20651 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:25:48.376375 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.376468 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:48.377532 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.385627 15909 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:48.379887 15910 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:48.386864 20672 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:48.387452 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.365541 20490 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.390267 20490 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:48.393069 20400 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.393206 20641 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.274923 20602 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.395035 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.386767 20659 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:48.369705 20453 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:48.394101 20400 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.399529 20557 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.399623 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:48.478560 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 79000.7us
W20260709 12:25:48.400249 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 131682us
I20260709 12:25:48.376719 20465 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.400597 20593 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:48.401057 20486 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.400631 20459 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.402411 20663 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:25:48.402590 20446 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 8. Current term is 9.
W20260709 12:25:48.403409 20660 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 12:25:48.415488 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.381973 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.492412 15982 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:48.474349 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.372982 20366 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:48.354307 20251 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.382997 20522 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:48.494264 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:48.494762 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.474932 20591 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:48.497071 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.503525 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 3042) took 1015 ms. Trace:
I20260709 12:25:48.531370 15831 rpcz_store.cc:276] 0709 12:25:47.488481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.530369 (+ 41888us) service_pool.cc:224] Handling call
0709 12:25:48.503357 (+972988us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400136fd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:48.503467 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288768256}
I20260709 12:25:48.489792 20623 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:48.534682 15982 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:48.538262 15834 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:48.546530 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.404222 20612 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.493062 20453 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.486444 20557 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.502491 20366 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.549983 15985 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:48.547164 15982 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:48.570711 15909 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:48.571154 16489 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:48.570056 20557 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.490957 20459 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.493245 20465 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:48.574188 20566 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
W20260709 12:25:48.587210 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95693.9us
I20260709 12:25:48.551213 20464 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:48.577524 20660 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:25:48.551033 20623 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.480176 20659 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.590629 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:25:48.598618 15982 raft_consensus.cc:606] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:48.600018 15982 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:48.543990 20522 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:48.540969 20372 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:25:48.501672 20591 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.543718 20333 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:25:48.541373 20365 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.598083 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 2089) took 1116 ms. Trace:
I20260709 12:25:48.496395 20414 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:25:48.608109 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.618588 15979 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:48.620687 20612 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:48.607115 20453 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.622936 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.626600 20459 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:48.634562 20629 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:25:48.638942 15836 rpcz_store.cc:276] 0709 12:25:47.482137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.613854 (+131717us) service_pool.cc:224] Handling call
0709 12:25:47.633230 (+ 19376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.640720 (+  7490us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:47.695380 (+ 54660us) log.cc:844] Serialized 14 byte log entry
0709 12:25:47.873940 (+178560us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:47.874446 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:25:47.874610 (+   164us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:47.874657 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.874751 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:48.597884 (+723133us) raft_consensus.cc:1685] finished
0709 12:25:48.597903 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.598012 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11455,"prepare.queue_time_us":54412,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":89342,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":17831,"thread_start_us":132182,"threads_started":1,"wal-append.queue_time_us":207295}
I20260709 12:25:48.637176 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.655521 16486 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:48.635999 20602 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:48.593498 20636 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:25:48.605504 20251 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:48.659845 15953 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:48.682556 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 188354us
I20260709 12:25:48.655033 20559 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.653999 20673 log.cc:927] Time spent T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.348s	user 0.000s	sys 0.004s
I20260709 12:25:48.656481 20461 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:48.659767 20540 consensus_meta.cc:287] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.005s
W20260709 12:25:48.663168 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 175197us
I20260709 12:25:48.637810 20591 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:48.693936 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.654626 20618 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 12:25:48.691517 20612 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:48.708082 15909 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:48.709997 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:48.684584 20619 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.161s
I20260709 12:25:48.712190 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.714445 15911 raft_consensus.cc:1240] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:48.714617 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:48.715813 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:48.716666 15911 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:48.716747 20621 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:25:48.718348 20522 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.718752 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:48.719794 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:48.691020 20559 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.723349 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:48.705862 20612 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.727553 15912 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:48.728159 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.728632 15910 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:48.729184 15909 raft_consensus.cc:2393] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:48.733258 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.734107 15831 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:48.725379 15988 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:48.707916 20629 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:48.741439 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:48.689055 20623 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.746656 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.724018 20619 consensus_queue.cc:1243] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:25:48.748193 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.748250 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:48.754351 15912 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:48.730567 20612 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.752657 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:48.764647 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:48.765795 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:48.766795 20458 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:48.767606 20458 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:48.770387 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:48.774127 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 74912.5us
I20260709 12:25:48.779337 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:48.748791 20464 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:48.783437 15907 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:48.783619 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3049) took 1293 ms. Trace:
I20260709 12:25:48.753005 20629 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.748632 20366 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:48.786571 15835 rpcz_store.cc:276] 0709 12:25:47.490227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.683360 (+193133us) service_pool.cc:224] Handling call
0709 12:25:47.816386 (+133026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.817123 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.783358 (+966235us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001f09d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:48.783548 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266534784}
W20260709 12:25:48.795542 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 522780us
I20260709 12:25:48.761459 20465 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:48.772074 20485 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.780705 20647 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.801025 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:48.803009 16486 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.752213 20621 consensus_queue.cc:1059] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:48.801568 20365 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:48.810184 20677 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:25:48.785892 20464 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.830713 20464 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.810264 20538 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.833294 20538 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.762503 20564 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:25:48.811600 20559 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:48.785096 20619 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:25:48.811976 20659 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:48.843053 20641 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.812588 15905 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:48.813026 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.747982 20685 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:25:48.825099 20683 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:48.794056 20682 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:48.855082 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1013) took 1013 ms. Trace:
W20260709 12:25:48.820885 20280 consensus_meta.cc:287] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.781s	user 0.012s	sys 0.000s
W20260709 12:25:48.824869 20622 consensus_meta.cc:287] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.002s
I20260709 12:25:48.845623 15905 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.848832 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1014) took 1006 ms. Trace:
I20260709 12:25:48.802706 20647 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.858053 15832 rpcz_store.cc:276] 0709 12:25:47.842806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.842930 (+   124us) service_pool.cc:224] Handling call
0709 12:25:47.843232 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:48.259957 (+416725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.848591 (+588634us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400136ad4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:48.848764 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957045120}
I20260709 12:25:48.860656 16487 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:48.874821 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:48.855506 15829 rpcz_store.cc:276] 0709 12:25:47.841549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.841712 (+   163us) service_pool.cc:224] Handling call
0709 12:25:47.842029 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:48.205449 (+363420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.854860 (+649411us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400082354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:48.855030 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752258304}
I20260709 12:25:48.875113 16486 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:25:48.857402 15905 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.877799 15905 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.878460 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:48.888887 15838 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:48.889284 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:48.890236 15833 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 14: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:48.890256 15834 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:48.895706 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:48.855026 20637 consensus_meta.cc:287] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 12:25:48.874270 20685 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:48.902251 20366 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:48.924154 15838 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:48.907603 20629 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:48.908490 20671 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 12:25:48.877581 20647 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.928815 15835 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:48.843663 20612 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.881239 20622 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14.
I20260709 12:25:48.931077 20591 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:48.936738 15832 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:48.941380 15832 pending_rounds.cc:85] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:48.941689 15832 pending_rounds.cc:107] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:48.941993 15832 raft_consensus.cc:2889] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:48.911825 20641 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:48.939399 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.944923 16486 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:48.915115 20685 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:48.924067 20459 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:48.949252 15905 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:48.950256 15905 pending_rounds.cc:85] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 8
I20260709 12:25:48.950553 15905 pending_rounds.cc:107] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:25:48.951100 20691 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:48.955387 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:48.954515 15987 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:48.957291 16486 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:48.958379 15905 raft_consensus.cc:2889] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:48.936070 20594 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:48.970073 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:48.926468 20637 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.938015 20366 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.975893 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:48.965189 20479 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:25:48.874132 20683 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.953159 20641 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:48.989670 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.951473 20685 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:48.995044 20637 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:48.997284 20165 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:48.997674 20685 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.979553 20622 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:49.000586 20622 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.002449 20612 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.002609 20622 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.004985 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:49.005532 16486 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.004901 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:49.009636 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:49.010499 16492 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
W20260709 12:25:49.011749 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.978097 20465 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.960175 20459 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:48.980000 19718 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:48.961300 20682 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:48.965672 20485 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:49.023229 16486 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:25:49.024912 15953 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:48.991986 20461 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.006862 20280 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:49.027371 15803 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:49.014844 20622 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:49.014604 20486 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:49.019150 20465 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:49.038030 20684 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:25:49.039783 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.040376 15982 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:49.041776 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.042304 15982 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:49.043061 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.043562 15982 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:49.044301 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:49.044781 15982 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.046382 20486 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.035616 20458 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:49.047731 20641 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.048853 20458 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:49.049806 20458 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.034565 20280 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.053503 20683 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.054893 20280 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:49.057260 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:49.022261 20564 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:49.036883 15831 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:49.030301 20612 raft_consensus.cc:2804] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:49.064654 15982 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:49.065557 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:49.069224 15982 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.036566 20465 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.086288 15982 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 17.
I20260709 12:25:49.032696 20461 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.056913 20622 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.061075 20564 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.082998 20612 raft_consensus.cc:697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:49.084617 20486 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.108937 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.121670 15982 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:49.124547 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1017) took 1101 ms. Trace:
W20260709 12:25:49.105825 20557 consensus_meta.cc:287] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.004s
I20260709 12:25:49.086018 20623 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:49.133292 20474 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.134352 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:49.135423 20414 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:49.135812 20414 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:49.139595 20576 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.142213 20532 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:49.142704 20532 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.147861 20383 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.148367 20383 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.136849 20414 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:49.149857 20693 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:25:49.150287 20414 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.153398 20532 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.153927 20564 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.154424 20383 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.130936 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.159859 15982 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:49.164733 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.165306 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.166277 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:49.156499 20677 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:49.169010 15986 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:49.167038 15982 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:49.171759 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.131013 20567 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.127797 20485 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:49.176929 20703 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:49.199669 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:49.200989 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57462 (request call id 3041) took 1712 ms. Trace:
I20260709 12:25:49.207307 15830 rpcz_store.cc:276] 0709 12:25:47.488212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.557495 (+ 69283us) service_pool.cc:224] Handling call
0709 12:25:49.200795 (+1643300us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400030a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:49.200922 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293075200}
I20260709 12:25:49.202421 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:49.211822 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:49.204463 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:49.169356 20479 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:49.213178 20458 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:49.213130 20479 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.213891 20458 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:49.214902 20458 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.222023 20461 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.223574 20622 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:49.213573 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:49.226843 20405 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:49.227939 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:49.229377 15803 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:49.230830 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:49.231786 20383 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:49.232148 15803 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:49.232350 20383 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:49.231921 20647 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.197723 20612 consensus_queue.cc:237] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.233322 20383 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.157227 20557 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.239812 20557 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.198453 20485 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.245352 20485 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.249275 20461 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:49.198086 20704 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:25:49.249892 20461 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:49.251181 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 48823.8us
I20260709 12:25:49.251114 20461 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:49.252218 20666 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.969s	user 0.000s	sys 0.002s
I20260709 12:25:49.252417 20685 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:49.253501 20486 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:49.254014 20486 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:49.254530 20486 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.229573 20459 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.249904 15980 raft_consensus.cc:1275] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:49.258247 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:49.269276 15980 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:49.205965 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:49.270094 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 64204.4us
I20260709 12:25:49.261427 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:49.271399 15906 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.213629 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.252233 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:49.272948 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.269972 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:49.125933 15837 rpcz_store.cc:276] 0709 12:25:48.022726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.042227 (+ 19501us) service_pool.cc:224] Handling call
0709 12:25:48.092001 (+ 49774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:48.092186 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:48.129434 (+ 37248us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.130054 (+   620us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.804788 (+674734us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b180034dbc0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:49.123909 (+319121us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b180034dbc0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03cbe59d70 00007f03cbe4d293 00007f03cbe42cea 00007f03cbe4323a 00007f03cc2ada2a 00007f03cc2bd0bf 00007f03cc2bd038
0709 12:25:49.124148 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:49.124205 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:49.124269 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.124358 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.124481 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16012,"prepare.queue_time_us":712215,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":1171,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9970,"spinlock_wait_cycles":16697472}
I20260709 12:25:49.279843 15980 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:49.281859 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:49.287664 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:49.301939 20685 consensus_queue.cc:1048] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:49.287652 15803 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:49.278848 20485 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:49.288466 20459 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.280278 20490 raft_consensus.cc:2764] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:25:49.288389 20463 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.289330 20682 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:49.305677 20594 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.336297 15984 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:49.342569 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 2075) took 1138 ms. Trace:
I20260709 12:25:49.299045 20333 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:49.316987 20567 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.320626 20383 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:49.318275 20485 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.343060 15985 rpcz_store.cc:276] 0709 12:25:48.199397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.200291 (+   894us) service_pool.cc:224] Handling call
0709 12:25:49.337204 (+1136913us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400315bd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:49.337323 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649494272}
I20260709 12:25:49.346118 15986 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:49.319962 20618 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.310707 20685 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:25:49.346967 20453 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.342393 20576 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:49.309720 20465 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.333778 20564 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:49.368534 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:49.375008 15985 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.327569 20629 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:49.340153 20682 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:49.328127 20708 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:25:49.351752 20383 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:49.361255 20485 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.394464 15912 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:49.394944 15912 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:49.396698 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:49.397929 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:49.399173 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1536) took 1400 ms. Trace:
I20260709 12:25:49.399524 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:49.399176 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:49.401260 15905 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:49.397293 15952 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:49.399544 15983 rpcz_store.cc:276] 0709 12:25:47.999012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.999122 (+   110us) service_pool.cc:224] Handling call
0709 12:25:47.999369 (+   247us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:47.999680 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.999712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:48.019846 (+ 20134us) log.cc:844] Serialized 52 byte log entry
0709 12:25:48.855195 (+835349us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b18002e5dc0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe430d1 00007f03cc25ea0f
0709 12:25:49.106123 (+250928us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:49.107254 (+  1131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.107335 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.386186 (+278851us) raft_consensus.cc:1685] finished
0709 12:25:49.386205 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.399112 (+ 12907us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8730,"spinlock_wait_cycles":49595776,"thread_start_us":250755,"threads_started":1,"wal-append.queue_time_us":1278931}
I20260709 12:25:49.395668 15912 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.419142 15912 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.421571 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:49.421883 15985 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:49.394491 20383 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.360358 20567 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.423543 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:49.375069 20453 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.399623 20641 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.376992 20576 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.373863 20618 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.444877 15983 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:49.436684 20329 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.436995 20683 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:49.456602 20575 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.472203 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:49.471212 15912 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:49.475698 15912 pending_rounds.cc:85] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 12
I20260709 12:25:49.475965 15912 pending_rounds.cc:107] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:49.476599 15912 raft_consensus.cc:2889] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:49.403636 20686 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:25:49.386775 20629 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.458493 20280 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.503186 20629 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.503719 15906 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
W20260709 12:25:49.505131 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:49.481236 20710 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:25:49.483043 20465 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.461647 20641 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.485296 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 867) took 1216 ms. Trace:
I20260709 12:25:49.512212 15982 rpcz_store.cc:276] 0709 12:25:48.268896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.179175 (+910279us) service_pool.cc:224] Handling call
0709 12:25:49.192229 (+ 13054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.192773 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.192801 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.193224 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.374615 (+181391us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:49.374657 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.374729 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.485100 (+110371us) raft_consensus.cc:1685] finished
0709 12:25:49.485121 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.485244 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5658,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":24123,"thread_start_us":181115,"threads_started":1,"wal-append.queue_time_us":263581}
I20260709 12:25:49.486028 20594 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:49.486195 20453 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.493016 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:49.520627 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:49.520947 15834 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.521323 15835 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:49.494411 15830 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:49.495841 20716 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:25:49.497193 20713 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:25:49.497442 15837 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:49.470008 20480 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:49.498653 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 79917.6us
W20260709 12:25:49.499240 20712 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:25:49.486294 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 2082) took 1278 ms. Trace:
W20260709 12:25:49.496438 20707 log.cc:927] Time spent T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:25:49.493672 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:49.567481 15987 rpcz_store.cc:276] 0709 12:25:48.207819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.365926 (+158107us) service_pool.cc:224] Handling call
0709 12:25:49.486096 (+1120170us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001879d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:49.486228 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171796992}
I20260709 12:25:49.507015 20647 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:49.550799 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:49.563189 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.503719 20629 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.508882 20522 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:49.570106 15837 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:49.495571 20486 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.608718 15837 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:49.602283 15834 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
W20260709 12:25:49.619872 20593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.009s	sys 0.020s
I20260709 12:25:49.476387 20682 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.643081 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:49.564973 20557 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:49.570727 20594 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.642253 20593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.009s	sys 0.020s
I20260709 12:25:49.568600 20480 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:49.651749 15836 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:49.650234 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 126073us
I20260709 12:25:49.657657 15837 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:49.583513 20490 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 12:25:49.642886 20463 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.646533 20459 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.666669 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:49.660039 20722 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:25:49.672657 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:49.616284 20629 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.675333 15838 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 8: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:49.657327 20593 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:49.583895 20575 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.679352 20576 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:49.680367 20725 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:25:49.693200 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 215614us
I20260709 12:25:49.670346 20736 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.700933 20485 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.661293 20594 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:49.705873 20726 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:49.706560 20724 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:25:49.707151 20728 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:25:49.707752 20727 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:25:49.669981 20647 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:49.675907 20463 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.729688 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:49.731550 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56196.3us
I20260709 12:25:49.735514 15838 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:49.702158 20575 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.737569 15838 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:25:49.741492 20730 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:25:49.742385 20731 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:49.745569 20485 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.746780 20567 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.711758 20736 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:49.729247 20618 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.699963 20480 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.738173 20641 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:49.763463 20740 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:49.769318 20575 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.786938 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:49.771675 20629 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.772651 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:49.794704 15835 raft_consensus.cc:2410] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:49.774652 20594 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:49.779115 20463 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:49.781662 20669 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.400s	user 0.004s	sys 0.000s
W20260709 12:25:49.789670 15979 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 2080) took 1582 ms (client timeout 1849 ms). Trace:
W20260709 12:25:49.817962 15979 rpcz_store.cc:269] 0709 12:25:48.207317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.207451 (+   134us) service_pool.cc:224] Handling call
0709 12:25:49.789511 (+1582060us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400139a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:49.789615 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815227264}
I20260709 12:25:49.795200 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:49.785423 20486 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:49.750006 20593 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:49.837052 20575 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.930055 20629 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.987100 20486 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.993194 20669 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:50.011247 20739 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.003870 20736 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.020906 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.001806 20575 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.004129 20629 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.027731 15983 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:25:50.052579 15983 pending_rounds.cc:85] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 7
I20260709 12:25:50.052830 15983 pending_rounds.cc:107] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:25:50.053084 15983 raft_consensus.cc:2889] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.053922 20629 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.034987 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.055768 20575 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.033573 20739 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.035983 20741 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:50.057512 20741 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:50.058537 20739 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:50.018182 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 258512us
I20260709 12:25:50.033267 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:50.041159 20661 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.638s	user 0.002s	sys 0.011s
I20260709 12:25:50.041500 20743 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:50.046182 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.046856 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.079391 15913 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:50.047710 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.080575 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.081183 15911 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:50.082304 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.010423 20486 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:50.018752 20383 consensus_meta.cc:287] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 12:25:50.060940 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.061688 20575 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.062810 20735 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:50.060011 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.083205 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.083689 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.096907 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:50.097592 15829 raft_consensus.cc:2393] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:50.097636 15908 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.084143 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.078889 15904 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:50.089192 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:50.100173 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.100510 15835 raft_consensus.cc:3060] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.100755 15911 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:50.090284 15838 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:50.091696 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:50.094311 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.103278 16457 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:50.058490 20741 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.111940 16489 raft_consensus.cc:1217] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.12->[15.13-15.13]   Dedup: 15.13->[]
I20260709 12:25:50.112473 16489 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:50.114768 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.115546 15831 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:50.114519 16489 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:50.121124 15911 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:50.120299 15831 raft_consensus.cc:1240] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:50.122959 15908 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:50.102857 20474 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.130290 20474 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.132318 20612 raft_consensus.cc:993] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:25:50.132654 20474 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:50.136296 20718 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.779s	user 0.009s	sys 0.013s
I20260709 12:25:50.136759 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.137157 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2994) took 1765 ms. Trace:
I20260709 12:25:50.137480 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 731) took 1073 ms. Trace:
I20260709 12:25:50.137862 16486 rpcz_store.cc:276] 0709 12:25:49.064378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.065136 (+   758us) service_pool.cc:224] Handling call
0709 12:25:49.087877 (+ 22741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.088263 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.088305 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.088822 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.285806 (+196984us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:49.285843 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.285902 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.128791 (+842889us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:50.137233 (+  8442us) raft_consensus.cc:1685] finished
0709 12:25:50.137250 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.137425 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1139,"raft.queue_time_us":4018,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4813,"spinlock_wait_cycles":5134720,"thread_start_us":196675,"threads_started":1,"wal-append.queue_time_us":268317}
I20260709 12:25:50.138809 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.139869 15913 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:50.140213 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.140770 15831 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:50.145303 20742 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:50.117643 19718 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:50.147976 19718 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:50.152318 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.152434 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.123579 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.153559 15911 raft_consensus.cc:2410] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:50.093050 20485 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.159855 20485 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.162475 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2087) took 1458 ms. Trace:
I20260709 12:25:50.162662 20485 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.092726 20383 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.165290 20383 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.166103 15834 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:50.101758 20575 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.169924 20575 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:50.170143 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.147297 20605 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:25:50.175185 15986 rpcz_store.cc:276] 0709 12:25:48.704019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.262125 (+558106us) service_pool.cc:224] Handling call
0709 12:25:49.337428 (+ 75303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:49.356586 (+ 19158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.162284 (+805698us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b5400315bd0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:50.162416 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172427648}
I20260709 12:25:50.154673 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:50.150846 19718 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.137492 15907 rpcz_store.cc:276] 0709 12:25:48.371813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.373194 (+  1381us) service_pool.cc:224] Handling call
0709 12:25:48.373463 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:48.786082 (+412619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.134712 (+1348630us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400430b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:50.137087 (+  2375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942420864}
I20260709 12:25:50.178557 20629 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.178695 20605 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.149225 20486 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.104421 20461 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.198933 20461 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.199579 16487 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:50.090740 20743 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.201156 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:50.201349 15988 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 2084) took 1993 ms (client timeout 2102 ms). Trace:
W20260709 12:25:50.201715 15988 rpcz_store.cc:269] 0709 12:25:48.208286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.369657 (+161371us) service_pool.cc:224] Handling call
0709 12:25:50.201209 (+1831552us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54000933d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:50.201302 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750312832}
I20260709 12:25:50.202633 20743 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.202652 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.179097 20629 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.209164 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2088) took 1494 ms. Trace:
I20260709 12:25:50.209610 15984 rpcz_store.cc:276] 0709 12:25:48.714741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.212339 (+497598us) service_pool.cc:224] Handling call
0709 12:25:49.212616 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:49.336755 (+124139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.208861 (+872106us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400139054. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:50.209093 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277340416}
I20260709 12:25:50.211145 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2092) took 1409 ms. Trace:
I20260709 12:25:50.211637 20564 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:50.212373 20564 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:50.219677 20622 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:50.220292 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 521751us
I20260709 12:25:50.221025 15952 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.226908 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:50.227741 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:50.224248 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.179458 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:50.186648 20715 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.734s	user 0.003s	sys 0.003s
I20260709 12:25:50.184985 15835 raft_consensus.cc:2468] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:25:50.190137 15831 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:50.242777 15907 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:50.190330 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 864) took 1922 ms. Trace:
I20260709 12:25:50.211552 15980 rpcz_store.cc:276] 0709 12:25:48.802025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.280791 (+478766us) service_pool.cc:224] Handling call
0709 12:25:49.281766 (+   975us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:49.300886 (+ 19120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.300933 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:49.301652 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 12:25:49.473697 (+172045us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:49.521826 (+ 48129us) log.cc:844] Serialized 14 byte log entry
0709 12:25:49.522148 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:25:50.170745 (+648597us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b180029faa0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:50.210634 (+ 39889us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b180029faa0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:50.210806 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.210892 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.210939 (+    47us) raft_consensus.cc:1685] finished
0709 12:25:50.210952 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.211078 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61631,"prepare.queue_time_us":104598,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":699182,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":14279,"spinlock_wait_cycles":56499840,"thread_start_us":134677,"threads_started":1,"wal-append.queue_time_us":319222}
W20260709 12:25:50.192282 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.197454 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.245146 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.245718 16486 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:50.198051 20691 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.198380 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.149537 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.223719 20612 raft_consensus.cc:1081] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:25:50.254109 16489 raft_consensus.cc:2410] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:50.236941 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.239701 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.255502 15988 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 8.
I20260709 12:25:50.256575 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.238976 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.241420 15982 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:50.260349 15982 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:50.261948 15982 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:25:50.262331 15982 pending_rounds.cc:85] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 5
I20260709 12:25:50.262594 15982 pending_rounds.cc:107] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:50.262876 15982 raft_consensus.cc:2889] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.246585 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.249632 20400 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.236436 20538 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:50.234166 20329 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:50.250366 15913 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:50.276566 15913 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:50.243623 15981 rpcz_store.cc:276] 0709 12:25:48.268246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.661109 (+392863us) service_pool.cc:224] Handling call
0709 12:25:48.661441 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.748832 (+ 87391us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:49.065281 (+316449us) log.cc:844] Serialized 14 byte log entry
0709 12:25:49.384401 (+319120us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.398467 (+ 14066us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.398628 (+   161us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:49.398674 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.189933 (+791259us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54001d5954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:50.189980 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.190031 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:50.190138 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.190274 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28733,"prepare.queue_time_us":281233,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":15958,"raft.queue_time_us":3492,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":14152,"spinlock_wait_cycles":200072064,"thread_start_us":574893,"threads_started":2,"wal-append.queue_time_us":391811}
I20260709 12:25:50.274827 15983 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:50.250771 15986 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:50.278134 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.235486 20479 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.254943 15909 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 7.
I20260709 12:25:50.221385 20733 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:50.240885 20461 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.180202 20605 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.322504 20605 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.334237 20366 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.312542 20594 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:50.339891 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.341167 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.310729 15913 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.341899 20463 consensus_queue.cc:1059] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:50.342656 20463 consensus_queue.cc:1243] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer b5f0a13b879f47dd804f8fc4b7b19a0a log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:50.236552 20636 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:50.343497 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:50.344097 16493 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:50.345286 16492 raft_consensus.cc:1240] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:50.314666 20733 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.277580 20538 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:50.348531 20538 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:50.350082 15952 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:50.351817 20636 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:50.313288 20735 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:25:50.315838 20675 raft_consensus.cc:3055] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:50.268707 20708 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:25:50.279556 20683 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.242583 20365 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:25:50.356119 15988 raft_consensus.cc:2410] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:50.224615 20564 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.397512 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.398316 16486 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:50.266302 15980 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:50.358656 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.360191 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:50.348702 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.360994 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.400794 15987 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:50.401753 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.240991 20622 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.402616 16460 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:50.293087 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 143579us
I20260709 12:25:50.369536 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.405251 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.405973 15981 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:50.406955 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.410115 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.318743 15879 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:50.413568 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 94892.6us
I20260709 12:25:50.306464 20575 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:50.416935 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.270499 20280 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.386204 16493 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:50.384698 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.423702 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.424232 15981 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:50.412482 15802 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.415040 15982 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.367566 20732 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.367729 20675 raft_consensus.cc:740] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:50.416476 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.375985 20636 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:50.417934 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.422833 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.384351 20612 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.387224 20522 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.425624 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:50.430315 16488 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:50.438421 15984 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:50.280750 20618 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:25:50.431066 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.425938 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.428891 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.421326 20453 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:50.446080 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.423422 20575 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.415962 20464 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.279783 20400 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.415904 15912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:25:50.456862 15912 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.457226 15912 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.269550 20691 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.427132 20682 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:50.444051 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.427305 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:50.443847 20479 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:50.377311 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.445176 20453 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:50.428864 20629 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.455184 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.456405 20618 consensus_queue.cc:1243] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:50.430014 20459 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:50.400581 20683 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.440980 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.423056 20333 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:50.401456 20744 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:25:50.425217 20749 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:50.447966 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.445075 20522 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.424989 20605 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:25:50.471232 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.467464 15982 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:50.428431 20619 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:50.455358 20575 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:50.480034 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 52826.9us
I20260709 12:25:50.555424 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.484524 20659 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:50.430270 20636 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.475396 15912 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.429517 20280 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.476054 20479 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.442919 20612 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.540410 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.539499 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.481794 20453 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:50.480573 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 103335us
I20260709 12:25:50.571110 15803 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:50.556201 15982 raft_consensus.cc:2410] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:25:50.482033 20486 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:50.471747 20733 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.488641 20459 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.439617 20732 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.563446 15980 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:50.495725 20618 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:50.484318 20643 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:50.556041 15802 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:50.622931 20618 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:50.623601 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 67625.5us
I20260709 12:25:50.624832 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:50.574705 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:50.546315 20749 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.563788 20479 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.583420 20612 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.585641 15913 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.588824 20461 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.591912 15984 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:50.633104 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 58473.9us
I20260709 12:25:50.595041 20558 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:50.537699 20755 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:50.472219 20682 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.640185 20465 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:50.641703 20682 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.642362 20333 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.642692 20558 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.642970 20333 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.602041 15912 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.603440 16492 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:50.610142 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.644822 20558 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.658175 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.561071 20636 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.562412 20659 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.639734 20647 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:50.600579 20559 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:50.646663 20622 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.569244 20567 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:25:50.597177 20459 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:50.632038 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 160106us
I20260709 12:25:50.631304 20735 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.632310 20749 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.479362 20675 consensus_queue.cc:260] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.633104 20251 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:50.692162 20333 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.638224 20486 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:50.701557 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.716032 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.689885 20366 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.663079 20766 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.726390 15913 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:50.719489 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:50.711345 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.694748 20659 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:50.695115 20755 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.724491 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.716114 15980 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:50.689684 20618 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.728464 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.729640 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:50.736996 16488 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.738420 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.742035 15950 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.718452 20486 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.717824 20564 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.746858 15912 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:50.748309 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.721392 20622 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:50.752235 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:50.756855 15907 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:50.760880 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.757916 20770 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.772056 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.718276 20735 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.729316 20366 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.758949 20383 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:50.772682 15980 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:50.780819 15980 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:50.784705 15981 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:50.785881 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.753863 20486 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.758255 20618 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:50.806077 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.772794 20641 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.770603 20691 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.773190 20400 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.732914 20766 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.806018 20618 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.742657 20755 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.810392 20559 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.807605 20683 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.842584 20755 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.833768 20618 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.844091 16488 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:50.845587 20453 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.847626 20453 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.849098 20366 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:50.849958 20756 log.cc:927] Time spent T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:25:50.772493 20770 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.853178 20770 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.855602 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2096) took 1541 ms. Trace:
I20260709 12:25:50.855983 15985 rpcz_store.cc:276] 0709 12:25:49.314542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.579330 (+264788us) service_pool.cc:224] Handling call
0709 12:25:49.620763 (+ 41433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:50.215043 (+594280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.215077 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:50.249738 (+ 34661us) log.cc:844] Serialized 52 byte log entry
0709 12:25:50.469942 (+220204us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:50.469979 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.471881 (+  1902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.855362 (+383481us) raft_consensus.cc:1685] finished
0709 12:25:50.855382 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.855541 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601509,"raft.queue_time_us":594947,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":219846,"threads_started":1,"wal-append.queue_time_us":308907}
I20260709 12:25:50.857978 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:50.860477 20538 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.004s
I20260709 12:25:50.861652 20735 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.865427 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.865643 20369 consensus_queue.cc:1059] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:50.869328 20732 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.864979 20465 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.873781 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:50.838157 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 180064us
W20260709 12:25:50.882648 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 140714us
I20260709 12:25:50.882715 15803 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:50.883752 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:50.884359 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.803179 15980 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.886670 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:50.901198 15803 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:50.903061 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.903571 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:50.868896 20641 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:50.910413 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 314334us
I20260709 12:25:50.860879 20538 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.899941 20735 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.899962 20564 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.905520 20366 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:50.910270 20365 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.885673 20465 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.914724 20764 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.933671 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:50.900489 20647 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:50.941792 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:50.915791 20683 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:25:50.946550 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.948539 15803 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.950860 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.920672 20479 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.954604 15803 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:50.925122 20366 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:50.958221 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.924258 20564 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.940392 20764 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.966866 20764 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.940786 20619 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:50.937765 20775 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:50.949352 20365 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.950183 20683 consensus_queue.cc:1243] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:50.951356 20461 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:50.952509 20383 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:50.968835 20575 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.969266 20486 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:50.989588 20538 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:50.990021 15833 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:50.984686 20479 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.955289 20618 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:50.992800 20618 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:50.997610 20766 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:50.998191 20647 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:51.012722 20763 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
I20260709 12:25:51.012814 20535 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:51.020285 20522 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.027356 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:50.983050 20619 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.039606 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:51.041904 20752 log.cc:927] Time spent T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.601s	user 0.002s	sys 0.000s
I20260709 12:25:51.042600 20575 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.047775 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.049247 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.051995 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.054764 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.059974 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.060748 15910 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:50.951553 20778 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:50.972977 20774 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.066985 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 2112) took 1447 ms. Trace:
I20260709 12:25:51.067113 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.067492 15834 rpcz_store.cc:276] 0709 12:25:49.619576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.656445 (+ 36869us) service_pool.cc:224] Handling call
0709 12:25:49.656749 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.166564 (+509815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.066724 (+900160us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400250654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:51.066908 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170858752}
I20260709 12:25:50.980726 20461 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.068833 20461 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.069389 20486 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:51.072332 15980 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.074327 20465 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.075821 20564 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.036365 20636 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.077589 15987 raft_consensus.cc:2393] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:51.078141 20459 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.080617 20459 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:51.081552 20758 log.cc:927] Time spent T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.528s	user 0.004s	sys 0.000s
I20260709 12:25:51.084847 20636 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.029201 20480 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.090384 20594 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:51.090772 20594 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:51.091588 20594 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.092581 20594 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:51.033514 20733 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:51.093365 20733 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:51.095024 20760 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.366s	user 0.003s	sys 0.005s
I20260709 12:25:51.096081 20733 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.033604 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:51.098331 15979 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:51.099640 15979 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:25:51.099707 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 66162.2us
I20260709 12:25:51.099738 20463 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:51.100515 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:51.101331 20659 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.113547 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.114154 15834 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:25:50.960198 20557 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:50.961350 20559 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:51.035339 20775 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:51.103185 15907 pending_rounds.cc:85] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 10
I20260709 12:25:51.133015 15907 pending_rounds.cc:107] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:25:51.133430 15907 raft_consensus.cc:2889] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:51.110117 15980 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:50.980186 20365 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.115234 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.141887 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.142225 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.142952 15834 raft_consensus.cc:2393] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:51.116009 15830 raft_consensus.cc:1275] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:51.144295 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.117579 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.119129 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.116781 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.146315 15836 raft_consensus.cc:2410] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:51.148324 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.152033 15837 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:51.152331 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.152874 15834 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.153607 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:51.004909 20464 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.542s	user 0.003s	sys 0.003s
I20260709 12:25:50.934509 20251 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:51.117476 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.165009 15838 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:51.106110 20366 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.113319 20463 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:51.118484 20557 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:51.118481 20465 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:51.167217 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.167754 15913 raft_consensus.cc:3060] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.157219 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.168340 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.168640 15835 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:51.118541 20765 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:51.169535 15950 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.170264 15906 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:51.145612 20559 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.160257 15912 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:51.147121 20459 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:51.147425 20749 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.174800 20559 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.175632 20779 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.176307 20749 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.177098 20459 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.178576 20643 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.179083 20643 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.179633 20459 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.166376 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.141264 20636 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:25:51.181154 20765 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.183194 15832 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:51.183964 20683 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:51.184636 20683 consensus_queue.cc:1048] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:51.183310 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.187513 15950 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.188614 16486 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:51.188927 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.189468 15834 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:51.192590 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.104437 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:51.199437 20779 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:51.200847 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 96471.1us
I20260709 12:25:51.201547 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:51.203121 15832 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:51.205605 16493 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:51.206110 15950 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.183202 20765 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.205886 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.211825 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:51.213250 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:51.216163 15913 raft_consensus.cc:2468] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:51.217581 15952 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:51.190873 20559 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:51.224429 20636 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:51.224879 20636 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.225268 20636 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.225881 20459 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.226413 20459 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.228487 20459 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:51.230068 20365 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.233314 20741 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.233232 20251 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.237851 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.239537 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.241230 20557 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.242594 20557 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.242654 20619 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:51.246045 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 44569.9us
I20260709 12:25:51.247368 20682 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:51.247936 20659 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:51.190477 20465 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.249594 20682 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:51.249972 16493 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:51.250258 20465 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.250537 20607 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:51.250888 20607 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:51.251107 15830 raft_consensus.cc:2410] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:51.146811 20775 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.251689 20607 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.221902 20782 raft_consensus.cc:2804] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:51.219594 20538 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:51.192920 20522 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:51.253690 20775 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:51.254666 20366 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.207692 20463 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:51.256052 20280 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:51.260504 15913 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:51.264564 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:51.271806 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:51.272585 16493 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:51.276125 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.218955 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:51.284227 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:51.285087 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:51.285499 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.287065 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.287300 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.288326 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.290210 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.292935 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:51.261144 20638 consensus_queue.cc:1175] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fd62f0fa06a4561a0a7101b85942f86" responder_term: 17 status { last_received { term: 17 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:51.296741 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.279284 20623 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:51.302711 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.280498 20749 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.271178 20161 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:51.280850 20675 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:51.319450 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 51881.4us
W20260709 12:25:51.321290 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51054.7us
W20260709 12:25:51.324491 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 105640us
I20260709 12:25:51.276909 15905 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:51.328182 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:51.329398 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.329650 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.329922 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.330480 15832 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.330587 15982 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:51.331509 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.331656 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:51.331902 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.332561 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.332912 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.333760 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.329955 15987 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:25:51.335099 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.335476 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.335852 15908 raft_consensus.cc:2410] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:51.336963 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.338112 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.338294 20686 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:51.338696 15913 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.339193 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.340245 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.339857 20461 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.341317 15834 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:51.338698 20686 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.342101 20686 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:51.324656 20749 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.345250 20749 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.345602 20623 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:51.346699 20461 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:51.348336 15905 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:51.348483 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.351831 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.352123 15913 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:51.352535 15835 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 14: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:51.353479 15803 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:51.355312 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.358430 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.359694 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:51.363400 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.364095 15838 raft_consensus.cc:2368] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:51.364800 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:51.365272 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.371843 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.375943 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.376449 15829 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:51.376506 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.377735 15829 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:51.384404 15832 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:51.386070 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:51.388145 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.375808 20564 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:25:51.347574 20366 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.347849 20485 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.319329 20782 raft_consensus.cc:697] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:51.346593 20623 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.371647 20459 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:51.371162 20365 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:51.405898 15829 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:51.414702 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.347642 20683 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:25:51.389545 20769 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:51.423926 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:51.446152 20607 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.462229 20770 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:51.463601 20770 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:51.464776 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.470153 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.474138 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:51.483188 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:51.495952 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:25:51.497736 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 73901.8us
I20260709 12:25:51.499529 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.465546 20764 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.464334 20770 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:51.493263 20783 log.cc:927] Time spent T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:51.414335 20485 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.499402 20575 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:51.435237 20745 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:25:51.488171 20459 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:51.555797 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 56753.4us
I20260709 12:25:51.556600 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:51.566704 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.568957 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:51.569820 15905 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:51.553524 20280 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:51.570482 20792 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:51.547943 20778 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:51.634891 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 332392us
I20260709 12:25:51.635949 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:51.638597 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 67199.4us
I20260709 12:25:51.638739 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.631187 15984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58562 (request call id 884) took 1256 ms. Trace:
W20260709 12:25:51.641537 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 67280.5us
W20260709 12:25:51.736225 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 100358us
I20260709 12:25:51.640782 20778 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.735149 20787 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:51.762993 15908 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:51.763540 20778 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.763177 20787 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.764544 20612 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:51.555676 20782 consensus_queue.cc:237] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.765053 20612 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.565132 20461 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:25:51.642673 15984 rpcz_store.cc:276] 0709 12:25:50.374829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.641729 (+266900us) service_pool.cc:224] Handling call
0709 12:25:50.642026 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.642231 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:51.246928 (+604697us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b1800305980. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03cbe4b4bc 00007f03c919948b 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cfc9b3c7 00007f03cc2ad9a7 00007f03cc2bd0bf
0709 12:25:51.247082 (+   154us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.572885 (+325803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.630858 (+ 57973us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.630923 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.630993 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.631129 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117983,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":14317,"spinlock_wait_cycles":3934976,"thread_start_us":483750,"threads_started":2}
I20260709 12:25:51.776312 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:51.771052 16459 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.801934 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:51.788547 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.809162 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:51.735795 20647 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.862409 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2112) took 1153 ms. Trace:
I20260709 12:25:51.869880 15985 rpcz_store.cc:276] 0709 12:25:50.708729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.880831 (+172102us) service_pool.cc:224] Handling call
0709 12:25:50.881370 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.901333 (+ 19963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.901364 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.901878 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.278156 (+376278us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:51.278203 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.278312 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.862189 (+583877us) raft_consensus.cc:1685] finished
0709 12:25:51.862213 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.862345 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19746,"raft.queue_time_us":22079,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":4212,"thread_start_us":375943,"threads_started":1,"wal-append.queue_time_us":521450}
W20260709 12:25:51.790819 20741 consensus_meta.cc:287] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.004s
I20260709 12:25:51.871906 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:51.872783 15985 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.735209 20567 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:51.802719 20645 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:51.885964 15904 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:51.893946 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:51.952550 15985 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:51.844635 20369 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:51.886314 20567 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:51.956522 20567 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:51.956677 20793 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:25:51.959393 20794 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.404s	user 0.000s	sys 0.000s
I20260709 12:25:51.959630 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2116) took 1241 ms. Trace:
I20260709 12:25:51.894658 20645 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:51.961545 20795 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.391s	user 0.000s	sys 0.000s
I20260709 12:25:51.961792 20645 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.893877 20682 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.965323 20567 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.965548 20682 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:51.967645 20567 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.969332 15985 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:51.972505 15985 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:51.960062 15983 rpcz_store.cc:276] 0709 12:25:50.718742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.962931 (+244189us) service_pool.cc:224] Handling call
0709 12:25:50.963258 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.978614 (+ 15356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.978663 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.980095 (+  1432us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.378281 (+398186us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:51.378316 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.378374 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.959397 (+581023us) raft_consensus.cc:1685] finished
0709 12:25:51.959418 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.959568 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8209,"raft.queue_time_us":8363,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":387134,"threads_started":1,"wal-append.queue_time_us":751005}
I20260709 12:25:51.984812 20764 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.986220 15979 raft_consensus.cc:1240] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:51.987638 20764 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:51.988188 20764 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.989629 15979 raft_consensus.cc:1240] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:25:51.992679 20791 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.440s	user 0.000s	sys 0.002s
I20260709 12:25:51.861685 20558 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:52.000675 15950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.042s	sys 0.087s
I20260709 12:25:51.960757 15988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2118) took 1217 ms. Trace:
W20260709 12:25:52.001296 15950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.043s	sys 0.087s
W20260709 12:25:52.002103 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 587450us
I20260709 12:25:52.001487 15988 rpcz_store.cc:276] 0709 12:25:50.743121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.040888 (+297767us) service_pool.cc:224] Handling call
0709 12:25:51.042615 (+  1727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.043191 (+   576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.043217 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.043613 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.387419 (+343806us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:51.387456 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.387527 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.960515 (+572988us) raft_consensus.cc:1685] finished
0709 12:25:51.960543 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.960692 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":89,"thread_start_us":343523,"threads_started":1,"wal-append.queue_time_us":449221}
I20260709 12:25:52.003116 15950 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:51.642285 20692 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.241s
W20260709 12:25:51.895372 20788 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
I20260709 12:25:52.005827 15986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1560) took 1647 ms. Trace:
I20260709 12:25:52.009436 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:52.008596 15986 rpcz_store.cc:276] 0709 12:25:50.357962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.358076 (+   114us) service_pool.cc:224] Handling call
0709 12:25:50.645289 (+287213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.651846 (+  6557us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:50.807407 (+155561us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.159979 (+352572us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.167136 (+  7157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.167178 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:51.167221 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.167283 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.182150 (+ 14867us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b1800046ba0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:51.185684 (+  3534us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800046ba0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:52.005675 (+819991us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540011a3d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:52.005776 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35680,"prepare.queue_time_us":155528,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":48811,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":707635968,"thread_start_us":430449,"threads_started":2,"wal-append.queue_time_us":491867}
I20260709 12:25:52.011253 15988 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:51.992547 20645 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:51.886024 20594 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:51.888610 20735 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:52.031077 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:52.045842 15984 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:52.031072 15953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.002s
W20260709 12:25:52.053334 15953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.003s
I20260709 12:25:51.780877 20459 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:52.023931 20675 consensus_meta.cc:287] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.000s
I20260709 12:25:52.068688 20612 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.069278 20612 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:52.070221 20636 consensus_meta.cc:287] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.000s
I20260709 12:25:52.070640 20636 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.072618 20636 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:51.736392 20770 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.073331 20463 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:52.073243 15987 raft_consensus.cc:2393] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:52.075910 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 3036) took 1018 ms. Trace:
W20260709 12:25:52.079006 20801 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:25:52.056258 20735 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.086772 20735 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:51.887773 20647 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.089924 20647 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:52.062736 20365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.002s	sys 0.013s
I20260709 12:25:52.076500 15907 rpcz_store.cc:276] 0709 12:25:51.057733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.102556 (+ 44823us) service_pool.cc:224] Handling call
0709 12:25:51.102945 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:51.134039 (+ 31094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.134068 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:51.141030 (+  6962us) log.cc:844] Serialized 52 byte log entry
0709 12:25:51.402561 (+261531us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:51.402608 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.402676 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.075628 (+672952us) raft_consensus.cc:1685] finished
0709 12:25:52.075658 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.075835 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8701,"raft.queue_time_us":1138,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4693,"thread_start_us":260467,"threads_started":1,"wal-append.queue_time_us":747170}
I20260709 12:25:52.063791 20622 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:52.114049 15981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2110) took 1669 ms. Trace:
W20260709 12:25:52.114116 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 312280us
W20260709 12:25:52.092095 20641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.003s
I20260709 12:25:52.114686 15981 rpcz_store.cc:276] 0709 12:25:50.444835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.786762 (+341927us) service_pool.cc:224] Handling call
0709 12:25:50.787109 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.811948 (+ 24839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.811989 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.817238 (+  5249us) log.cc:844] Serialized 26 byte log entry
0709 12:25:50.959930 (+142692us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:50.959986 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.960086 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.113826 (+1153740us) raft_consensus.cc:1685] finished
0709 12:25:52.113854 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.113991 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49083,"raft.queue_time_us":41678,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":22035,"thread_start_us":107627,"threads_started":1,"wal-append.queue_time_us":472284}
W20260709 12:25:52.095448 20365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.003s	sys 0.014s
W20260709 12:25:52.095595 20522 consensus_meta.cc:287] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.842s	user 0.001s	sys 0.014s
I20260709 12:25:52.075212 20787 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:52.059106 20681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.004s
I20260709 12:25:52.096451 20755 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:52.118311 20641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.014s	sys 0.003s
W20260709 12:25:52.120896 20681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.011s	sys 0.005s
I20260709 12:25:52.127727 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:52.128298 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.129805 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:52.121588 20522 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:52.130504 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:52.130714 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.164326 16488 raft_consensus.cc:2393] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:52.131547 16490 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:52.132511 16494 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:52.133385 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.135018 20369 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:52.119692 20365 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:52.139487 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1038) took 1278 ms. Trace:
I20260709 12:25:52.119868 20593 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:52.142784 16493 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:52.116927 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.166707 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.170531 15831 rpcz_store.cc:276] 0709 12:25:50.861001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.869841 (+  8840us) service_pool.cc:224] Handling call
0709 12:25:50.870160 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.870451 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.870477 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.870885 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.304168 (+433283us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.472138 (+167970us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.547721 (+ 75583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.547803 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.992111 (+444308us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:52.137806 (+145695us) raft_consensus.cc:1685] finished
0709 12:25:52.139269 (+  1463us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.139422 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29004,"prepare.queue_time_us":198579,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1644,"raft.queue_time_us":70864,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":16615,"spinlock_wait_cycles":9139456,"thread_start_us":600411,"threads_started":2,"wal-append.queue_time_us":608634}
I20260709 12:25:52.168970 15980 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:52.130120 16486 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:52.125465 20622 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:52.174690 16487 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:52.168124 16492 raft_consensus.cc:2393] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 12: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:52.171728 20764 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:52.193095 20802 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
I20260709 12:25:52.174269 20369 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.194185 20505 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:52.194629 20505 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:52.195215 20369 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.195956 20681 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:52.196403 20681 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:52.197543 20607 consensus_meta.cc:287] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.002s
I20260709 12:25:52.197448 20681 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:52.199209 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 82366us
I20260709 12:25:52.203845 16487 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:52.138589 20755 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.201890 20645 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.209211 20813 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.236227 20769 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:52.236740 20769 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:52.201639 20622 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.225735 20639 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.209273 20366 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:25:52.210013 20659 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:52.195997 20505 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:52.244215 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44291.2us
I20260709 12:25:52.240043 20638 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:52.247599 20623 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:52.248586 20643 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.283488 20755 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.285930 20622 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.274158 20813 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:25:52.241571 20365 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.292557 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.267970 20638 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.303887 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.304883 20638 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.311892 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.245961 20639 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:52.303004 20686 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.960s	user 0.011s	sys 0.000s
I20260709 12:25:52.313369 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:52.314284 20623 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:52.327196 20816 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:52.332042 20682 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.333083 20735 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:52.361519 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.366839 15985 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:52.369550 20639 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.370533 20559 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:52.371129 20559 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.325387 20741 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.359445 20807 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:52.393399 20807 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.396533 20807 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.399199 20769 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.322059 20686 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.401700 15983 raft_consensus.cc:1240] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:52.405249 15987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1586) took 1078 ms. Trace:
I20260709 12:25:52.405668 15987 rpcz_store.cc:276] 0709 12:25:51.326956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.335249 (+  8293us) service_pool.cc:224] Handling call
0709 12:25:52.405012 (+1069763us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540011a8d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:52.405185 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695106944}
W20260709 12:25:52.381778 20806 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.307s	user 0.000s	sys 0.004s
I20260709 12:25:52.411864 20686 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.413362 20559 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.414436 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3087) took 1083 ms. Trace:
I20260709 12:25:52.415153 15835 rpcz_store.cc:276] 0709 12:25:51.331513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.372724 (+ 41211us) service_pool.cc:224] Handling call
0709 12:25:51.373009 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:51.373393 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.373421 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:51.373923 (+   502us) log.cc:844] Serialized 52 byte log entry
0709 12:25:51.842789 (+468866us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:51.907316 (+ 64527us) log.cc:844] Serialized 14 byte log entry
0709 12:25:52.328813 (+421497us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b18003f1060. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:52.340711 (+ 11898us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:52.364801 (+ 24090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.364873 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.414213 (+ 49340us) raft_consensus.cc:1685] finished
0709 12:25:52.414234 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.414378 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12716,"prepare.queue_time_us":109793,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":17059,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":13391,"spinlock_wait_cycles":86563072,"thread_start_us":465087,"threads_started":2,"wal-append.queue_time_us":674055}
W20260709 12:25:52.417601 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 57340us
I20260709 12:25:51.402278 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.423733 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:52.363179 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:52.426561 15979 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:52.423738 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.430758 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.432597 15985 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:52.436544 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:52.425992 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 62906.4us
I20260709 12:25:52.437186 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.443214 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:52.446816 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.453516 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.438123 20766 raft_consensus.cc:2764] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:52.441722 20659 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:25:52.455127 20769 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.457250 20682 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:52.457767 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:52.457947 20463 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:52.464268 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:52.452641 20741 consensus_queue.cc:1059] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:25:52.457881 15731 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.443614 20383 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.439021 20686 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:52.451525 20813 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.468545 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:52.465816 20619 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:52.476279 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:52.483907 15904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1630) took 2347 ms. Trace:
I20260709 12:25:52.486941 20639 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.452783 20623 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:52.489307 20766 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.496966 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.499270 15904 rpcz_store.cc:276] 0709 12:25:50.136730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.136839 (+   109us) service_pool.cc:224] Handling call
0709 12:25:50.137162 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.889686 (+1752524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.483564 (+593878us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400340654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:52.483795 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4013881088}
I20260709 12:25:52.500823 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43666 (request call id 2126) took 1023 ms. Trace:
I20260709 12:25:52.500854 15876 leader_election.cc:400] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:52.505271 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:52.505450 15876 leader_election.cc:403] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:52.505275 15982 rpcz_store.cc:276] 0709 12:25:51.477353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.476021 (+998668us) service_pool.cc:224] Handling call
0709 12:25:52.500749 (+ 24728us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:52.508206 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.502264 20741 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:52.498575 20643 raft_consensus.cc:3055] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:52.522132 20643 raft_consensus.cc:740] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:52.506840 20383 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:52.511075 20532 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:52.523442 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:52.524740 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:52.526980 15834 raft_consensus.cc:2410] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:52.522348 15835 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:52.527433 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:52.529157 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.529557 20692 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.505391 20639 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.533154 20676 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:52.533581 20692 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.534166 20676 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:52.534549 20676 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:52.535604 20639 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.535341 20676 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.536202 20623 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:25:52.536556 20676 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:52.525858 20816 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:25:52.525722 20775 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.538426 20775 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.538792 20775 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.511601 20682 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 8. Current term is 9.
I20260709 12:25:52.523232 20619 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.526141 20383 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.542382 20383 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:52.542536 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.543285 16486 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:52.544867 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.545557 15979 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:52.546458 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.546291 20643 consensus_queue.cc:260] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.547425 20643 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:52.498919 20686 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.548951 20813 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.550056 20813 consensus_queue.cc:1059] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:52.548627 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.552066 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:52.552778 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:52.553807 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:52.535729 20692 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.557787 16457 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:52.560971 16457 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.569995 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.563580 20749 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:52.578780 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:52.580415 15986 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:52.568964 20735 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:52.588858 20741 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:52.580684 20621 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:52.598590 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:52.604629 15829 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:52.587069 20739 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.585397 20735 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.606012 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:52.612610 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:52.614553 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.620772 20686 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.630268 15988 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:52.632151 20780 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:52.633160 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:52.607961 20739 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.625628 20735 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:52.628450 20619 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:52.659149 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2127) took 1181 ms. Trace:
I20260709 12:25:52.659595 15983 rpcz_store.cc:276] 0709 12:25:51.477632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.973346 (+495714us) service_pool.cc:224] Handling call
0709 12:25:51.973585 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:52.402105 (+428520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.658895 (+256790us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b5400139a54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:52.659085 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984110336}
I20260709 12:25:52.627893 20621 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:52.661875 20741 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:52.662396 20741 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.664450 20741 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:52.644057 15802 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.66:41469 timed out after 2.130s (SENT) [suppressed 5 similar messages]
I20260709 12:25:52.645644 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:52.666517 15908 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:52.666930 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.651533 20383 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.669647 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:52.646660 20739 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:52.653875 15906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1610) took 2626 ms (client timeout 2130 ms). Trace:
W20260709 12:25:52.670516 15906 rpcz_store.cc:269] 0709 12:25:50.020498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.020659 (+   161us) service_pool.cc:224] Handling call
0709 12:25:52.647153 (+2626494us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001969d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:52.647250 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641788288}
I20260709 12:25:52.668318 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.672484 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:52.673532 20621 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.675452 15906 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:52.677630 20739 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.679039 15908 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:52.680611 20739 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.681488 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:52.682024 16487 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.682184 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:52.691256 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:52.692077 15983 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.694967 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.703712 16487 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:52.713805 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.664951 20741 consensus_queue.cc:1059] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:25:52.718398 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:52.710670 20846 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.079s	user 0.001s	sys 0.002s
I20260709 12:25:52.725001 20485 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.726816 20461 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:52.727245 20461 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:52.727902 20461 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.728741 20461 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:52.729787 20837 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:52.735145 20383 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.737128 20505 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:52.750313 20735 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.751351 20741 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:52.751756 20741 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:52.752544 20741 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:52.753167 20735 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.753665 20741 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.757738 20775 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.765115 20775 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.766705 20813 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:52.767053 20813 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:52.767731 20813 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:52.768822 20822 log.cc:927] Time spent T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 12:25:52.768826 20813 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:52.802747 15830 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:52.836701 15877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.851939 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1584) took 1525 ms. Trace:
I20260709 12:25:52.862005 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:52.866561 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:52.867352 15984 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:52.869755 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.909904 20463 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:52.911401 20333 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:52.911111 20463 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:52.912946 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.912549 20333 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.915825 20333 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:52.916487 20333 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.852622 15980 rpcz_store.cc:276] 0709 12:25:51.326348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.332349 (+  6001us) service_pool.cc:224] Handling call
0709 12:25:51.332625 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:52.175800 (+843175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.851150 (+675350us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54001b9254. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:52.851701 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922637696}
I20260709 12:25:52.917243 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:52.919674 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.921582 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:52.923475 15913 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:52.925220 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:52.946655 20463 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:52.925170 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:52.951663 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:52.976809 15907 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:52.975217 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:52.981722 20366 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:52.982592 20366 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:52.984202 20593 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:52.984625 20593 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:52.990835 20251 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:52.992283 20251 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:52.995762 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:52.996433 16496 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:52.999451 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:53.000706 16487 raft_consensus.cc:2393] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:53.002085 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 52946.8us
I20260709 12:25:53.005344 20778 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:53.006114 20778 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.008219 20414 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:53.009184 20414 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.018313 20778 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.020548 19718 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:53.020987 20619 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:53.021803 20619 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.023650 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.024494 20619 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.025766 20739 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:53.026521 20739 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.030607 15912 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:25:53.033887 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:53.034961 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:53.037477 20414 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:52.992740 20251 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:53.028901 20739 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.064714 15984 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:52.970120 20333 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.066079 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:53.083403 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47789.4us
I20260709 12:25:53.086351 20681 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.093307 20538 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.093973 20538 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:53.096117 20849 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.465s	user 0.004s	sys 0.000s
I20260709 12:25:53.108428 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:53.105227 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 66465.5us
I20260709 12:25:53.106160 20366 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.121510 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:53.122287 15830 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.123178 15981 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 9.
I20260709 12:25:53.084820 20535 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.124325 20535 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.127672 20333 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:53.147018 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 328748us
I20260709 12:25:53.161687 20251 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.163792 20251 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:53.173653 20594 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:53.175136 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:53.176465 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.173926 15731 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 9 to 14, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.177827 20538 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.178647 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.180320 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.181805 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.182785 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:53.184186 15906 raft_consensus.cc:2410] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:53.181871 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:53.185828 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:53.188282 20676 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:53.189625 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:53.189843 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:53.174492 20594 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.193256 15913 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:53.197685 15830 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:53.203953 20676 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:53.212055 20333 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.217928 20333 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:53.210500 15983 consensus_meta.cc:287] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.518s	user 0.014s	sys 0.010s
I20260709 12:25:53.223480 15983 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
W20260709 12:25:53.225833 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.224797 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:53.241468 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:53.242234 15984 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.245990 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:53.247027 20505 consensus_meta.cc:287] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.509s	user 0.001s	sys 0.017s
I20260709 12:25:53.251940 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.253427 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.254603 20461 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:53.255213 20461 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.258881 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.259280 20865 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.276511 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:53.277264 15904 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:53.240847 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 51178.7us
I20260709 12:25:53.280500 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:53.287388 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 92005.9us
W20260709 12:25:53.289937 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.302100 16496 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:53.305661 20778 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.306265 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.308820 20505 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:53.309439 20505 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:53.309978 20505 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.309911 20594 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.311717 20862 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:53.312153 20862 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:53.312584 20862 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:53.313944 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 79973.6us
I20260709 12:25:53.319727 20461 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.345256 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.346226 15835 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:53.348523 15835 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 12:25:53.376636 20859 log.cc:927] Time spent T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:25:53.380841 20480 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:53.384496 20480 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:53.386750 20856 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
I20260709 12:25:53.390555 20480 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.404089 20535 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:53.406711 20867 log.cc:927] Time spent T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:25:53.411576 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 131300us
I20260709 12:25:53.406950 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.408444 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.415333 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.417480 20815 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:53.417976 20815 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:53.418380 20815 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:53.425140 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 173327us
I20260709 12:25:53.426239 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:53.438994 20857 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:25:53.442687 20480 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.449856 20333 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.452565 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.454595 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.456106 15830 raft_consensus.cc:1240] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:53.455789 15838 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:53.458436 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.458746 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.459543 15913 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:53.462016 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:53.463354 20741 consensus_meta.cc:287] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.009s
W20260709 12:25:53.471779 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 247916us
I20260709 12:25:53.472059 15904 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:25:53.470844 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53857us
I20260709 12:25:53.479419 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:53.483211 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 168106us
I20260709 12:25:53.427071 20461 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:53.484205 15984 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:53.482613 15803 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:53.488871 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.491978 20594 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:53.499250 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73150.3us
I20260709 12:25:53.500483 16496 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:53.504772 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:53.505671 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:53.492805 20681 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:53.498706 20251 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:53.509359 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.511865 20741 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:53.513273 20770 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.517486 20329 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:53.517799 15830 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:53.520665 15906 raft_consensus.cc:2410] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:25:53.523824 15835 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:53.504562 20594 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.532387 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.533687 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.522106 20251 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:53.533088 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.521488 20505 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.524632 20329 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.544629 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.531152 20681 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.540253 20535 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.540866 20862 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.556152 20593 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.557459 20593 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:53.559103 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.559278 20862 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.559485 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:53.561961 20681 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:53.564262 15988 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:53.568034 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.569070 20594 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:53.573001 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 72389.7us
I20260709 12:25:53.572223 15913 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:53.576576 15907 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:53.578445 15731 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.580262 20329 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:53.580850 20329 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.580752 15731 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.581333 20329 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.584460 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.583277 15731 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 6 to 13, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 13 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.587244 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 72455.8us
I20260709 12:25:53.596006 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.598330 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:53.567608 20815 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.603089 16459 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:53.604813 15904 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:53.605561 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.593611 20251 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.611464 16486 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:53.614542 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:53.616948 20535 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.623557 20480 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.624114 20480 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.626411 20480 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:53.626997 20623 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:53.627368 20623 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:53.628046 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:53.629184 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:53.630087 20480 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:53.631795 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.636196 20692 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:53.619207 20329 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:53.642740 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.636803 20692 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.645540 15981 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:53.628293 20623 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.655619 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:53.645834 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 48182.6us
I20260709 12:25:53.641012 20480 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.662593 20639 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:53.668277 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68646.4us
I20260709 12:25:53.671351 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:53.683983 15906 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:53.669459 20862 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.679442 20505 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.694860 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.696048 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:53.684515 20681 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.691852 20623 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.696849 20692 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.700519 20815 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.673893 20329 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:25:53.711557 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:53.712483 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.674961 20741 consensus_queue.cc:1059] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:25:53.716845 20643 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:53.716845 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:53.719250 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73925us
I20260709 12:25:53.707283 20333 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:25:53.727126 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:53.727568 20741 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:53.727969 20741 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:53.728368 15988 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:53.728889 20741 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.731437 16496 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:53.732470 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.733212 20593 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:53.727603 20333 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:53.734826 20333 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:53.735435 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.730180 20741 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.735646 20333 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.736716 20594 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.737005 20333 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.738812 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.737536 20594 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.746253 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.745986 20643 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:53.758476 20643 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.773747 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:53.786053 20733 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:53.786566 20733 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:53.787504 20733 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.788223 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.789345 20532 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:53.789662 20505 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.790205 20505 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.790735 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.792019 20465 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:53.792366 20505 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:53.788859 20733 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.766924 15803 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:53.767419 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.806197 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.765187 20862 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.807034 15838 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:53.825228 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 86508.1us
W20260709 12:25:53.826550 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 82395.7us
I20260709 12:25:53.828759 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.812525 20538 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.833431 15830 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
W20260709 12:25:53.833909 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60278.3us
I20260709 12:25:53.832273 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:53.819033 20505 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:53.837074 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:53.844323 20659 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:53.844764 20659 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.845155 20659 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.845183 20692 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:53.845839 20692 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.846232 20692 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.850490 15876 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:53.853570 15835 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:53.849619 20505 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:53.857331 20505 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.861153 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:53.862250 20815 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:53.862527 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 53115.1us
I20260709 12:25:53.862767 20815 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:53.863904 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.863806 20815 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.866366 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:53.870442 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.864897 20735 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.871030 15731 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 4 to 7, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 7 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.876194 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 80577us
I20260709 12:25:53.873052 20770 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:53.882995 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:53.874775 20333 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:53.884338 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.887463 20770 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.898466 15905 raft_consensus.cc:2410] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:53.904143 20770 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.904516 20682 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.905020 20682 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.901594 20480 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:53.906109 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:53.907605 15952 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:53.908242 20538 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:53.908350 20681 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.908728 20538 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:53.909070 20733 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:53.909787 20733 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:53.909812 20778 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:53.907888 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.910969 20733 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.912077 15802 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:53.909161 20538 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.912899 20461 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.913843 20778 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:53.927237 20505 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.930784 20461 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.903563 20333 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:53.932822 20333 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.932402 20461 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:53.977237 20659 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.979656 20659 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.980551 20535 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:53.981048 20535 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:53.980751 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:53.981709 15983 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.982003 20535 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.983325 20535 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.934491 15731 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 6 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.936705 15905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37350 (request call id 1655) took 2297 ms (client timeout 2966 ms). Trace:
W20260709 12:25:53.991218 15905 rpcz_store.cc:269] 0709 12:25:51.638203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.638416 (+   213us) service_pool.cc:224] Handling call
0709 12:25:53.932892 (+2294476us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400430b54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:53.935494 (+  2602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5041320832}
I20260709 12:25:53.938282 20505 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.940498 20538 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:53.995218 20538 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:53.996767 15982 raft_consensus.cc:1240] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:53.996958 15728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 281) took 21026 ms (client timeout 15000 ms). Trace:
I20260709 12:25:54.003546 20465 consensus_queue.cc:1059] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:54.003839 15731 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 2 to 12, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 12 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.004485 20461 raft_consensus.cc:3055] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:54.006735 20461 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:25:53.997469 15728 rpcz_store.cc:269] 0709 12:25:32.970370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.970649 (+   279us) service_pool.cc:224] Handling call
0709 12:25:53.996706 (+21026057us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:46.318519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:46.392730 (+ 74211us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:46.392796 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:25:46.392833 (+    37us) tablet.cc:662] Decoding operations
0709 12:25:46.395256 (+  2423us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:46.395368 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:46.395406 (+    38us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:25:46.548287 (+152881us) tablet.cc:701] Row locks acquired
0709 12:25:46.548348 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:25:46.548532 (+   184us) write_op.cc:270] Start()
0709 12:25:46.548690 (+   158us) write_op.cc:276] Timestamp: P: 1783599946548462 usec, L: 0
0709 12:25:46.548726 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:25:46.551204 (+  2478us) log.cc:844] Serialized 9391 byte log entry
0709 12:25:46.965002 (+413798us) op_driver.cc:464] REPLICATION: finished
0709 12:25:47.250752 (+285750us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03c91990ac 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cfcd9ef0
0709 12:25:47.280551 (+ 29799us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b180041c260. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:47.409956 (+129405us) write_op.cc:301] APPLY: starting
0709 12:25:47.410125 (+   169us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:48.079566 (+669441us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:48.079607 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:49.003923 (+924316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:49.004369 (+   446us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 12:25:49.004433 (+    64us) write_op.cc:312] APPLY: finished
0709 12:25:49.112506 (+108073us) log.cc:844] Serialized 212 byte log entry
0709 12:25:49.466760 (+354254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:49.475688 (+  8928us) write_op.cc:454] Released schema lock
0709 12:25:49.515292 (+ 39604us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:49.607370 (+ 92078us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:49.616851 (+  9481us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126779,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":444633,"apply.run_cpu_time_us":63950,"apply.run_wall_time_us":2150327,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104111,"num_ops":24,"prepare.queue_time_us":303200,"prepare.run_cpu_time_us":21131,"prepare.run_wall_time_us":331101,"raft.queue_time_us":235222,"raft.run_cpu_time_us":13867,"raft.run_wall_time_us":446146,"replication_time_us":416125,"spinlock_wait_cycles":14284288,"thread_start_us":1108345,"threads_started":5,"wal-append.queue_time_us":547338,"wal-append.run_cpu_time_us":77796,"wal-append.run_wall_time_us":2444635}]]}
I20260709 12:25:54.007675 20461 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.011642 20461 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.014247 20741 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.014465 20333 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.014889 20741 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.016979 20333 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:53.988924 15983 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
W20260709 12:25:54.018265 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.019083 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.019618 20741 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.019845 15830 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:53.946720 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 226776us
I20260709 12:25:53.949275 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:54.023864 15803 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:53.957521 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:54.023932 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74809us
I20260709 12:25:54.024724 20659 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:54.024874 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.025382 20659 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:54.025739 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:54.019446 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:53.971542 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:53.972540 20770 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.084283 20877 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.084877 20877 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:54.070802 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45125.6us
I20260709 12:25:54.071211 20676 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.089624 20676 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.090790 20877 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.091779 20676 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:54.071879 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45063.7us
I20260709 12:25:54.026501 20733 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:53.957563 20682 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:54.074150 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:54.026690 20538 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:53.932523 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:54.086261 20770 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:54.070529 20535 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:54.087378 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:54.088176 15835 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:54.024876 15834 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:54.073963 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:53.958850 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:53.957742 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.103157 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.110929 15988 raft_consensus.cc:2393] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:54.111673 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.112263 15904 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.110515 15987 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:54.113313 16496 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
W20260709 12:25:54.106863 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 84069.4us
I20260709 12:25:54.114230 15879 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:54.108865 16486 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.117156 20733 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:54.120013 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.120919 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.117717 20733 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.118013 20659 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.125818 20532 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:54.126049 20414 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:54.126695 20733 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.127712 20365 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:54.128587 15980 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:54.129159 20594 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:54.129683 20594 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.130084 20594 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.129065 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.132845 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.133883 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.126411 20532 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.119815 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:54.136704 16486 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:54.136904 15908 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:53.969739 20815 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.136713 15838 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.136557 20333 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:54.142576 20532 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.143472 20251 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:54.158550 15879 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:54.144186 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.144691 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:54.145227 20877 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.175211 20480 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:54.159588 16459 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.175956 20480 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:54.177174 20480 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.145301 20639 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.178553 20639 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.151237 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.156733 15904 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:25:54.177184 15907 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:54.157011 16492 raft_consensus.cc:1240] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:54.175082 20877 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:53.944099 20692 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:54.211669 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 69886.7us
I20260709 12:25:54.213338 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.215575 15835 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:54.209421 15952 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:54.217592 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.217620 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:54.225330 15983 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:54.227035 15988 raft_consensus.cc:2393] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:25:54.231715 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73777.1us
I20260709 12:25:54.232563 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:54.206007 20778 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:54.240742 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 308323us
I20260709 12:25:54.246471 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:54.246991 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 87477.6us
I20260709 12:25:54.248234 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.214864 20682 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.238090 20735 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:54.239239 20676 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:54.256772 15904 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:54.242774 20733 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:54.257405 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.260198 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.261111 15907 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:54.242194 20538 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:54.189432 20815 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.260744 15906 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:54.266557 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.227010 20414 consensus_queue.cc:1059] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:25:54.251940 20778 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:54.280400 15802 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.278867 15913 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:54.255802 20878 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:54.278062 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.283845 15908 raft_consensus.cc:3060] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.256964 20676 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.263806 20505 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.306543 20505 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:54.285562 20682 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.264149 20733 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:54.311359 20815 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.313095 20815 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:54.313426 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.314181 15829 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:54.315186 20538 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:54.316254 20538 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.323654 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:54.327976 20692 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:25:54.290746 20888 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:54.291831 20639 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.291934 20778 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.287012 20676 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.303838 16494 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:54.304215 20884 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.289093 20813 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.317281 16457 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:25:54.347777 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.317694 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.313469 20815 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:54.320210 20733 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.354012 20805 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:54.354914 20639 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:54.355377 20639 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.355770 20639 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.357633 20888 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:54.358693 20888 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.362563 20480 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:54.363839 20883 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:25:54.365243 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:54.366673 20480 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.367245 20480 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.380470 20862 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:54.381278 20862 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.384133 20862 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:54.385223 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 129440us
I20260709 12:25:54.348516 20770 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:54.387717 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.387147 15981 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:54.389688 15835 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:54.390748 20682 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.392072 20877 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.398416 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.399595 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.402920 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.425361 15838 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:54.436180 16496 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:54.440249 20890 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:54.441679 20890 consensus_queue.cc:1243] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:25:54.442229 20681 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:54.442610 20681 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:54.443466 20681 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.444556 20681 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.457952 15908 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:25:54.461910 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 185075us
I20260709 12:25:54.372184 20813 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.478018 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.458814 20770 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:54.573107 20889 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.572944 20770 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.573787 20889 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.452391 20873 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:25:54.577076 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 158612us
I20260709 12:25:54.576179 20889 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.493413 20251 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:54.567258 20461 consensus_meta.cc:287] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.000s
I20260709 12:25:54.577414 20480 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:54.599287 20897 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:25:54.600454 20594 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.603339 20594 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:54.604620 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:54.605600 20333 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.460481 20815 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.614560 20815 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:54.618644 20813 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.616487 20639 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.653810 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.655859 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.656823 15908 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:54.660127 15905 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:25:54.660655 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.661944 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.663209 15913 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:54.663766 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:54.670598 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.671226 15905 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 8.
I20260709 12:25:54.671459 20461 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:54.674695 20901 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.675277 20901 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.675981 20894 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.676476 20894 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.680657 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.636693 20676 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.687290 20909 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.688659 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:54.694301 15988 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.690716 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:54.695192 15829 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.703114 20414 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:54.703689 20414 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.704134 20414 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.704296 20909 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.709537 20902 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.710162 20902 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.715157 16496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:54.716156 16496 raft_consensus.cc:606] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:54.716589 16496 raft_consensus.cc:614] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:54.719097 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:25:54.720989 15981 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:54.721529 15907 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:25:54.721879 15907 pending_rounds.cc:85] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 10
I20260709 12:25:54.725417 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.724678 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:54.727176 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 122673us
I20260709 12:25:54.722095 15907 pending_rounds.cc:107] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:25:54.730223 15907 raft_consensus.cc:2889] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:54.731181 20903 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.731673 20903 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.733740 20903 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.735555 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.734433 20365 raft_consensus.cc:3055] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:54.736810 20733 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.737571 20365 raft_consensus.cc:740] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:54.738588 20365 consensus_queue.cc:260] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.739332 20733 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.740484 20901 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.741266 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:54.742378 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.742417 20902 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.746773 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:54.748553 20888 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:54.748955 20888 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.749349 20888 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:54.749770 20904 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.757742 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:54.764436 15913 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
W20260709 12:25:54.775189 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46852.9us
I20260709 12:25:54.775377 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.778630 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:54.779338 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 115643us
I20260709 12:25:54.780453 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:54.781405 15952 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:54.781859 20902 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:54.783023 20905 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:54.783458 20905 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:54.783851 20905 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.784457 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.785161 15981 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:25:54.786474 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:54.789232 20733 raft_consensus.cc:2804] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:54.791975 20901 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:54.792315 20909 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:54.794087 20805 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:54.795224 20676 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.796838 20878 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:54.798565 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:54.799353 20901 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:54.799734 20901 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.800062 20901 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.801146 15907 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:54.797303 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:54.803535 20893 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:54.804100 20893 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:54.805101 20893 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.767732 20532 raft_consensus.cc:2764] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:54.810524 15829 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:54.812252 15988 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:54.816039 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:54.819393 20914 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:54.819953 20914 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:54.821096 20914 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.822654 20914 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.828860 20813 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.833837 15835 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:54.835254 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.834060 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.836681 15829 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:54.837415 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:54.841751 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50269.3us
I20260709 12:25:54.768004 20888 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:54.850762 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 93118.4us
I20260709 12:25:54.797281 20905 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:54.861327 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.845981 20594 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:54.874642 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.887835 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:54.831319 20901 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.893714 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:54.840680 20813 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.893968 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.898200 15911 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:54.900427 15907 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:54.889340 20733 raft_consensus.cc:697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:54.908274 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:54.910122 20900 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.474s	user 0.007s	sys 0.004s
I20260709 12:25:54.910375 20532 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:54.910545 20901 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.911166 20532 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:54.897709 20862 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.913230 20896 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:54.913784 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.913795 20896 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:54.915083 20532 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:54.918445 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:54.921849 20733 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.895246 20594 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:54.925577 20778 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.934971 20778 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:54.935348 20913 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:54.904596 20251 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.931944 20676 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.964079 15912 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:25:54.957616 20908 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:54.925787 20896 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:54.958194 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.961789 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.968139 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:54.970085 20480 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:54.967149 20778 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:54.986111 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:54.990533 15802 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:54.992187 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:54.992347 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:54.992908 16496 raft_consensus.cc:2368] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12.
I20260709 12:25:54.992985 15833 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.994160 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:54.994876 20365 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:54.995541 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:54.996029 16496 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.977373 20480 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.005656 15879 leader_election.cc:400] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12.
I20260709 12:25:55.006012 15879 leader_election.cc:403] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:55.005903 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.007117 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:54.976411 20251 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:55.008522 15837 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:55.008373 20594 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.009888 20682 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.016489 16496 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:55.022547 15833 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:55.028692 20888 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.030296 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:55.031044 20878 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.031965 20905 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:54.988029 20896 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:55.033463 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:55.033360 20896 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.035523 20896 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.036950 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.037672 15905 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:25:55.041420 15982 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:54.975924 20676 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.043754 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:55.044070 16494 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:55.044343 20676 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.047384 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:55.048126 16496 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 14: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:55.038324 20333 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:55.011991 20813 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:55.044281 15986 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:55.053058 20659 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.054870 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.055008 20659 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.055810 15829 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:55.056008 20903 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:55.056748 20903 consensus_queue.cc:1243] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:55.058051 15802 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:55.021499 20532 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:55.060652 20888 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:55.067219 15912 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:55.074318 15829 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:55.076830 20682 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12.
I20260709 12:25:55.082489 15834 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
W20260709 12:25:55.089171 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.094240 20480 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:55.072047 20813 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.097183 20813 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.098047 16496 pending_rounds.cc:85] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 8
I20260709 12:25:55.098380 16496 pending_rounds.cc:107] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:25:55.098627 16496 raft_consensus.cc:2889] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.099330 20813 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:55.100713 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:55.102898 16494 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:55.025679 20778 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:55.062673 20532 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.062503 20917 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:55.115087 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:55.114259 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.115659 15984 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:25:55.115855 15835 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:55.113802 16457 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:55.120509 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:55.118106 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:55.123152 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:55.122239 16494 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:55.125056 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.126308 20692 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:55.126852 20692 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:55.127110 20414 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.127755 20692 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.129355 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.129956 15833 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:55.130738 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.131398 15833 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.131872 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.132114 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.132436 15829 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:55.114869 20532 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.133222 20815 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:55.133906 15832 raft_consensus.cc:1275] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:55.134644 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:55.135226 15985 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:55.133850 20815 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:55.137759 15833 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:25:55.138651 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:55.118453 20676 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:55.147185 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.155984 15986 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:25:55.156685 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:55.159456 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.160490 20639 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.168170 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:55.168864 15906 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:55.170805 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.171592 15908 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:55.177287 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:55.178966 15912 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:55.141731 20878 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:55.180444 20639 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:55.180878 20815 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.182835 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:55.150413 20903 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:55.187137 15829 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:55.189308 15831 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:25:55.191238 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 76911.2us
I20260709 12:25:55.192484 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.193078 15831 raft_consensus.cc:2376] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13. Re-sending same reply.
I20260709 12:25:55.194166 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.194941 15831 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:55.196023 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.197479 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.198211 15829 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.196774 15831 raft_consensus.cc:2376] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10. Re-sending same reply.
I20260709 12:25:55.202781 15913 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:25:55.203009 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.204006 15829 raft_consensus.cc:2393] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.175649 20414 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.185863 20878 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.216506 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.218345 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.218232 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.190814 20903 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:55.216189 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.221649 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.217661 15803 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.219038 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:55.226327 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:55.226531 15838 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.226990 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.230757 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.216071 20594 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.216071 20878 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:55.238179 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.239256 15838 raft_consensus.cc:2410] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:55.234076 20896 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:55.245244 20896 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.245607 20896 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:55.224534 20903 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:55.249339 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.247361 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.239984 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.246969 20414 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:55.233575 20461 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:55.282248 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.284606 15829 raft_consensus.cc:2468] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:55.285843 20414 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:55.288203 20894 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:55.284610 20873 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:55.297107 20909 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:55.248268 20741 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:25:55.315305 15906 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:25:55.314491 20681 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:55.278251 20594 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.327488 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.327798 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.328102 15838 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:55.328647 15829 raft_consensus.cc:2393] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.327891 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.317829 20909 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:55.332340 20681 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:55.333365 20681 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.339689 15913 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:55.319497 20873 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.343513 20873 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:55.347716 20414 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.358600 20909 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:55.366937 15835 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:25:55.375830 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.376871 15835 raft_consensus.cc:2410] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:55.379948 15906 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:55.381790 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.383888 20594 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:55.386602 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.388571 20461 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.388973 15985 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:55.390681 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.391492 15833 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 17: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.392179 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.388993 20461 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:55.392810 15829 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:55.393137 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:55.393664 15984 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:55.392259 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:55.396502 15838 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:55.400483 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:55.401603 15835 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:55.398357 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:55.405979 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:55.419777 15832 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:55.433568 15913 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:55.433983 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.436218 15837 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:55.439379 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.440004 15838 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:55.441591 20733 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:55.469204 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:55.474486 15829 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:25:55.472973 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.432238 20682 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:55.490881 16496 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:55.495432 20888 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.496179 20888 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:55.498816 15731 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 177) took 25072 ms (client timeout 15000 ms). Trace:
I20260709 12:25:55.501096 20659 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:55.510406 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:55.466862 20904 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:55.502635 20888 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:55.518994 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:55.439738 20594 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:25:55.543215 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.437826 20896 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.545219 15913 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:55.553341 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.506047 20936 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:55.516860 20904 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.516228 20682 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:55.550266 20906 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:55.558817 20936 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.562882 20904 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:55.506953 15731 rpcz_store.cc:269] 0709 12:25:30.426319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.428846 (+  2527us) service_pool.cc:224] Handling call
0709 12:25:55.498734 (+25069888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:54.072642 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:54.091261 (+ 18619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:54.091313 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:25:54.091334 (+    21us) tablet.cc:662] Decoding operations
0709 12:25:54.092309 (+   975us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:54.092414 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:54.092441 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:25:54.113134 (+ 20693us) tablet.cc:701] Row locks acquired
0709 12:25:54.113182 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:25:54.113356 (+   174us) write_op.cc:270] Start()
0709 12:25:54.113504 (+   148us) write_op.cc:276] Timestamp: P: 1783599954113290 usec, L: 0
0709 12:25:54.113541 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:25:54.141501 (+ 27960us) log.cc:844] Serialized 3190 byte log entry
0709 12:25:54.846161 (+704660us) op_driver.cc:464] REPLICATION: finished
0709 12:25:55.076043 (+229882us) write_op.cc:301] APPLY: starting
0709 12:25:55.076142 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:55.081670 (+  5528us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:55.081786 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:55.085530 (+  3744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:55.085856 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:25:55.085931 (+    75us) write_op.cc:312] APPLY: finished
0709 12:25:55.086286 (+   355us) log.cc:844] Serialized 81 byte log entry
0709 12:25:55.086495 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.086618 (+   123us) write_op.cc:454] Released schema lock
0709 12:25:55.086678 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:55.088665 (+  1987us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.088697 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":229,"mutex_wait_us":6176318,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":223191,"apply.run_cpu_time_us":10428,"apply.run_wall_time_us":12615,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37455,"num_ops":8,"prepare.queue_time_us":61306,"prepare.run_cpu_time_us":33634,"prepare.run_wall_time_us":191723,"raft.queue_time_us":476421,"raft.run_cpu_time_us":15509,"raft.run_wall_time_us":291912,"replication_time_us":714098,"thread_start_us":555654,"threads_started":4,"wal-append.queue_time_us":132525}]]}
I20260709 12:25:55.582021 15913 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:55.549813 20893 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:25:55.578419 20770 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:55.630031 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:25:55.633419 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 131512us
I20260709 12:25:55.592440 20906 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:55.595825 20936 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:55.625922 20770 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:55.656769 15837 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:55.657209 15837 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:55.657964 15837 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.658751 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:55.658942 15837 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:55.665355 20935 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:25:55.667372 20940 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:25:55.669162 20682 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.689839 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.701380 16496 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:55.701911 20906 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:55.672996 20532 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.539s	user 0.003s	sys 0.007s
I20260709 12:25:55.701428 20770 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.717131 20896 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.717273 20770 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:55.717689 20946 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:25:55.641785 20733 consensus_queue.cc:1048] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:25:55.697559 20538 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:55.719321 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:55.751821 15837 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:55.707042 20888 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:55.788018 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73053us
I20260709 12:25:55.757244 20950 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:55.823217 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.823977 15904 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
W20260709 12:25:55.826721 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72495.4us
I20260709 12:25:55.715344 20532 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.738037 20461 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:55.841328 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52411.9us
I20260709 12:25:55.845983 15836 raft_consensus.cc:1240] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:55.846012 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:55.849268 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:55.755592 20538 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.795467 20888 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:55.892584 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.893263 15906 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
W20260709 12:25:55.894253 20909 consensus_meta.cc:287] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 12:25:55.898051 20909 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:55.889707 20681 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:55.912858 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:55.900779 20909 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:55.932631 15834 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:55.934324 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 141767us
W20260709 12:25:55.912061 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 62873.4us
I20260709 12:25:55.935876 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:55.927845 20862 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.905449 20952 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:25:55.968958 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:55.980202 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 197556us
I20260709 12:25:55.946442 20461 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:55.950244 20950 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:55.975131 20952 consensus_queue.cc:1243] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer 9fd62f0fa06a4561a0a7101b85942f86 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:55.974438 20805 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.018361 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49584.2us
I20260709 12:25:56.013607 15913 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:56.021781 15950 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:56.022367 20903 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.007s
I20260709 12:25:56.023041 20329 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:56.024102 20942 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 12:25:56.024518 20960 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:25:56.025146 20945 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 12:25:56.025240 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.025940 15910 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:56.026268 20954 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:56.000430 20681 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:25:56.033180 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 86141.5us
I20260709 12:25:56.033331 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:56.029443 20770 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.031457 20805 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.039541 20682 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:56.039415 20770 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.039971 20682 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:56.040396 20682 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:56.040589 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:56.041105 20805 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.041469 20594 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.042495 20770 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.044564 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:55.977795 20862 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.023742 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:56.063773 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:56.071838 20909 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:56.071959 20532 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.008615 20813 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:25:56.072456 20909 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:25:56.073396 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 65872.6us
I20260709 12:25:56.075438 20909 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.058547 20594 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.068562 20896 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:25:56.077405 20888 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:56.078202 20538 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:56.064288 20878 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 12:25:56.079113 20878 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.080583 20894 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:56.081095 20878 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:56.081277 20894 consensus_queue.cc:1243] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:56.084334 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.085194 20770 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:56.086782 20894 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:56.088706 15906 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:56.088490 20532 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:56.090371 20532 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:56.090739 20532 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:56.091545 20532 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.092710 20532 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:56.093325 15802 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.094594 20461 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:56.095240 20962 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 12:25:56.096550 20961 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:25:56.072190 20976 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:56.097352 15984 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:56.099632 15911 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:56.101774 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:56.102385 16494 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:25:56.067126 20950 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:56.069592 20329 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:25:56.099661 20975 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:25:56.107879 15802 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.109182 20894 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:56.111286 15910 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:25:56.031354 20959 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.120249 15910 pending_rounds.cc:85] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 6
I20260709 12:25:56.120548 15910 pending_rounds.cc:107] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:56.120777 15910 raft_consensus.cc:2889] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:56.121268 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:56.123383 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.133360 15904 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:56.133941 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 113049us
I20260709 12:25:56.124162 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.138705 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:56.127740 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.128556 15912 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:56.128688 15802 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:56.120841 15905 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:25:56.148720 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 104239us
I20260709 12:25:56.152237 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:56.153635 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:56.121448 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:56.160197 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.164479 15832 pending_rounds.cc:85] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 10
I20260709 12:25:56.164961 15832 pending_rounds.cc:107] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:25:56.165233 15832 raft_consensus.cc:2889] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:56.166671 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:56.167405 15834 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.164418 15836 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:56.168730 16496 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:56.169697 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.023698 20903 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.169351 15829 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 17: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:56.173301 15908 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:25:56.176796 15833 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:56.180914 15904 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:56.182209 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.183158 15980 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:56.172472 20251 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:56.184022 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.184959 15908 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:25:56.186264 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.173923 20681 consensus_queue.cc:1059] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:56.191534 15908 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:56.193401 20903 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.170998 20909 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:56.199606 15908 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:56.205003 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:56.206485 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:56.191660 20904 consensus_meta.cc:287] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.007s
I20260709 12:25:56.210705 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:56.218259 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:56.219587 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:56.223845 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:56.218727 20896 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:56.196983 20682 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.229907 20682 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.204774 20461 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.230894 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.231449 15904 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.231518 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:56.230175 20972 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.197471 20909 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:56.233803 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:56.214926 20906 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.171600 20465 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:25:56.176599 20333 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:56.207963 20251 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:25:56.272372 20251 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.234798 20896 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:56.230640 20681 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:56.249101 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.250149 20909 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.276684 20896 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.242327 20461 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.295097 20461 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.295662 20681 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:56.296675 20681 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.298002 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.298740 15912 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:56.252424 20972 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.238068 15834 raft_consensus.cc:2410] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:56.246928 15904 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:25:56.219444 20862 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.211320 20414 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:56.264026 20949 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:25:56.266184 20878 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:56.267004 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:56.267730 20906 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.216467 20904 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.234894 20888 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:56.269445 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:56.270179 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:56.316035 15986 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:25:56.325275 15834 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:56.315352 20465 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.322072 16493 raft_consensus.cc:2368] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15.
I20260709 12:25:56.236843 20676 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:25:56.326309 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:56.328897 15985 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:56.332959 15879 leader_election.cc:400] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15.
I20260709 12:25:56.333305 15879 leader_election.cc:403] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:25:56.342427 16492 raft_consensus.cc:2393] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:25:56.355736 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 119082us
I20260709 12:25:56.379679 15909 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:56.326220 20888 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:56.316955 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 77965.3us
I20260709 12:25:56.392004 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:25:56.392920 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 58060.4us
I20260709 12:25:56.343026 20862 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:56.370067 20903 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15.
I20260709 12:25:56.387465 20888 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.335529 20465 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.394698 20741 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:56.402840 20972 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.429664 20967 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.429755 20414 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:56.431459 20535 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:56.428969 20959 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:56.429387 20982 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:25:56.435041 20741 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.442080 20741 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.416298 20862 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:25:56.446189 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 49481.9us
I20260709 12:25:56.452297 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.436471 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.460987 15834 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:56.463109 15834 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:25:56.482618 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 95006.7us
I20260709 12:25:56.438287 20967 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.483482 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 73303.9us
W20260709 12:25:56.475876 20936 consensus_meta.cc:287] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.832s	user 0.006s	sys 0.005s
I20260709 12:25:56.473336 20917 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.498699 15836 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:56.499709 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.487906 20890 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.510620 20983 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:56.513183 20985 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:56.491182 20967 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.515035 21001 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.523921 20997 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:56.524813 20984 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:56.500136 20936 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.526388 20465 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.533330 20904 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.530515 20890 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.534549 20906 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.535040 20862 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.546317 20997 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.548132 20890 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.549034 20997 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.530905 20985 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:56.550118 20985 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.551203 20985 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:56.551693 20967 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.542454 21001 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.554936 20936 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.537447 20909 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.555706 15838 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:56.554955 15835 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:56.556752 20909 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:56.557412 15984 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:25:56.557775 21001 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:56.559098 20461 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:56.559649 20461 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.556965 20888 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.557487 15835 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:25:56.565267 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:56.577963 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.564092 16495 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:56.587020 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.591881 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.592645 15911 raft_consensus.cc:2393] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 10: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:56.587637 15907 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:56.594869 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.573048 20888 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.595553 15906 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:56.574272 20967 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:56.572695 20878 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:56.575541 20329 raft_consensus.cc:3055] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:56.600800 20329 raft_consensus.cc:740] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:56.601796 20329 consensus_queue.cc:260] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.603509 20329 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:56.604456 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.605230 15905 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
W20260709 12:25:56.574570 20992 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:25:56.606853 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:56.609304 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 139415us
I20260709 12:25:56.609395 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:56.614041 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.614648 15905 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.562465 20461 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:56.618551 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 143820us
I20260709 12:25:56.619516 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:56.620795 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.653117 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.655385 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:56.656220 15986 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.662814 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.664450 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.662093 16459 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:25:56.665047 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.677004 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:56.671590 15986 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:56.677748 15835 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:56.679389 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:56.645148 20985 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:56.679869 15835 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:56.680815 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:56.690342 15982 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:56.646231 20953 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:56.691156 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:56.697468 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:56.664359 20909 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:56.661778 20914 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:56.700675 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:56.706265 15905 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:25:56.709942 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:56.715619 16494 raft_consensus.cc:2393] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 15: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:56.689707 20985 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.688786 20967 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:56.664566 20904 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:25:56.727474 16460 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:56.707716 20659 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.712462 20909 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.744022 15835 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:25:56.715030 20998 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:56.751150 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.725087 20967 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.725801 20985 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:56.740494 20951 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:56.763885 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:56.720676 20914 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:56.759310 20995 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.260s	user 0.000s	sys 0.004s
I20260709 12:25:56.770533 20951 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.800323 20951 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:56.801467 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:56.802748 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 129408us
I20260709 12:25:56.805253 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.805367 20480 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:56.806835 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.807302 20953 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:56.807446 15905 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:56.807817 20953 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.808532 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:56.769124 20967 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:56.812628 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 70789.9us
I20260709 12:25:56.749878 20909 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:56.743511 20906 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:56.779268 20998 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:25:56.746649 20659 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:56.821457 20904 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:56.821632 20998 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:56.822927 20659 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:56.824882 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:56.826179 15912 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:25:56.810730 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:56.824903 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:56.839334 15802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.849359 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:56.845752 15876 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:56.857254 20914 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:56.857857 20914 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:56.859289 20480 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:56.859724 20480 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.860064 20480 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:56.862950 20904 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:56.863482 20904 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:56.864311 20904 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:56.979926 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 86311.9us
I20260709 12:25:56.980886 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:57.044625 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:57.044466 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 295258us
I20260709 12:25:57.045636 15831 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
W20260709 12:25:57.047086 20956 log.cc:927] Time spent T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.151s	user 0.000s	sys 0.003s
I20260709 12:25:56.850463 20682 raft_consensus.cc:2764] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:56.866956 20884 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:57.060384 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 234281us
I20260709 12:25:56.838663 21001 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.208s
I20260709 12:25:56.978531 20741 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.126049 15988 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:25:57.126646 15988 pending_rounds.cc:85] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 6
I20260709 12:25:57.126910 15988 pending_rounds.cc:107] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:25:57.127197 15988 raft_consensus.cc:2889] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:56.979434 21005 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:25:57.280102 15831 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:57.055840 20778 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:57.285285 20778 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:57.287400 20778 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:57.280480 20936 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.288300 20936 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.290274 20936 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:57.292330 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:57.281313 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:57.284869 21006 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 12:25:57.283852 20991 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.761s	user 0.006s	sys 0.009s
I20260709 12:25:57.294440 20953 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:57.296351 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3130) took 1172 ms. Trace:
I20260709 12:25:57.296741 15830 rpcz_store.cc:276] 0709 12:25:56.123469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.123591 (+   122us) service_pool.cc:224] Handling call
0709 12:25:56.123951 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.124349 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:56.128250 (+  3901us) log.cc:844] Serialized 14 byte log entry
0709 12:25:56.303276 (+175026us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b1800164ce0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b5c02 00007f03cbe3d20b 00007f03cbe42d23 00007f03cbe4323a 00007f03cc2ada2a
0709 12:25:56.622149 (+318873us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.641266 (+ 19117us) log.cc:844] Serialized 26 byte log entry
0709 12:25:56.641489 (+   223us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:56.647261 (+  5772us) log.cc:844] Serialized 14 byte log entry
0709 12:25:56.648061 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.648170 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.047828 (+399658us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:57.083094 (+ 35266us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b1800164ce0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b6522 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:25:57.296112 (+213018us) raft_consensus.cc:1685] finished
0709 12:25:57.296136 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.296265 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2325,"prepare.queue_time_us":624872,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":26907,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":26630,"spinlock_wait_cycles":150306816,"thread_start_us":318605,"threads_started":2,"wal-append.queue_time_us":355694}
W20260709 12:25:57.293588 20329 consensus_meta.cc:287] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.683s	user 0.003s	sys 0.006s
I20260709 12:25:57.063705 20884 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.305320 20884 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:57.078796 20733 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:57.306897 20733 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:57.307222 20480 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.312942 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:57.351446 16460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.032s
W20260709 12:25:57.353436 16460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.032s
I20260709 12:25:57.103380 20741 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:57.273074 20960 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:25:57.369875 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:57.377367 15983 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:57.285295 21012 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.439s	user 0.001s	sys 0.000s
W20260709 12:25:57.365447 20862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.021s	sys 0.065s
W20260709 12:25:57.416381 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 435578us
I20260709 12:25:57.417120 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:57.381264 20890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.033s	sys 0.073s
I20260709 12:25:57.420533 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:57.422431 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:57.310523 20733 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:57.416071 20862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.021s	sys 0.065s
I20260709 12:25:57.468202 20741 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:57.469089 20951 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.003s
W20260709 12:25:57.465993 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 43647.8us
I20260709 12:25:57.484413 20951 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:57.485531 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 786) took 1342 ms. Trace:
I20260709 12:25:57.485993 16496 rpcz_store.cc:276] 0709 12:25:56.142915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.143298 (+   383us) service_pool.cc:224] Handling call
0709 12:25:56.143627 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:56.169143 (+ 25516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.485232 (+1316089us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400493754. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:57.485437 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57303424}
W20260709 12:25:57.489132 20999 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.949s	user 0.000s	sys 0.006s
I20260709 12:25:57.487164 20951 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:57.474182 15838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59154 (request call id 1113) took 1320 ms (client timeout 1727 ms). Trace:
I20260709 12:25:57.490489 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:25:57.490610 15838 rpcz_store.cc:269] 0709 12:25:56.153267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.153415 (+   148us) service_pool.cc:224] Handling call
0709 12:25:57.473916 (+1320501us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540003b1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:57.474084 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923051776}
W20260709 12:25:57.491534 15904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41588 (request call id 996) took 1311 ms (client timeout 1727 ms). Trace:
W20260709 12:25:57.491894 15904 rpcz_store.cc:269] 0709 12:25:56.180600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.181910 (+  1310us) service_pool.cc:224] Handling call
0709 12:25:57.491329 (+1309419us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54001978d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:57.491452 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111460096}
I20260709 12:25:57.477339 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:57.478912 20931 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:57.504246 15983 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:25:57.492559 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:25:57.449472 20890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.036s	sys 0.077s
I20260709 12:25:57.493819 20894 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:57.416731 20480 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:57.514163 20931 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:57.554836 15837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.004s	sys 0.007s
W20260709 12:25:57.552911 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60063.9us
W20260709 12:25:57.555783 15837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.004s	sys 0.008s
I20260709 12:25:57.540988 20931 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:57.539963 21002 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:57.571789 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:57.577284 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:57.640179 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:57.640424 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:57.642046 15913 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 17.
I20260709 12:25:57.644662 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:25:57.575402 20953 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:57.575289 20741 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.655566 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:57.657116 20993 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 1.222s	user 0.017s	sys 0.005s
I20260709 12:25:57.656883 20414 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:57.657575 20733 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:57.658211 21024 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:25:57.657619 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:57.659065 21018 log.cc:927] Time spent T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:25:57.659215 20967 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.821s	user 0.006s	sys 0.003s
W20260709 12:25:57.729267 15879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.080s	sys 0.122s
W20260709 12:25:57.747200 15879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.080s	sys 0.122s
I20260709 12:25:57.579517 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:25:57.730702 15909 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:25:57.735659 15981 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.660781 20906 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:57.738445 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:57.566797 21002 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:57.835114 15830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.098s	sys 0.125s
W20260709 12:25:57.751154 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 171772us
W20260709 12:25:57.907164 15830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.117s	sys 0.142s
I20260709 12:25:57.729453 20251 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:57.910471 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:25:57.753293 21003 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.245s	user 0.008s	sys 0.010s
I20260709 12:25:57.567140 20959 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.295s
I20260709 12:25:57.578953 20862 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:57.758518 15985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1677) took 1061 ms. Trace:
I20260709 12:25:57.911792 15833 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:57.579073 20903 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:57.751523 21014 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:25:57.751353 21008 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:57.751127 20913 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.765870 20890 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:57.902968 21002 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:57.920588 21024 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:25:57.910461 20461 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.734742 20414 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.741233 20733 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.739369 20741 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:57.734261 20953 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.790725 20967 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:57.952759 21026 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:25:57.947708 20461 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:57.955914 20461 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:57.960628 20414 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:57.942101 20986 log.cc:927] Time spent T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 1.508s	user 0.005s	sys 0.012s
I20260709 12:25:57.962080 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3133) took 1796 ms. Trace:
I20260709 12:25:57.931860 21019 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:57.997946 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1124) took 1377 ms. Trace:
I20260709 12:25:58.000452 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:57.977356 15837 rpcz_store.cc:276] 0709 12:25:56.165925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.433383 (+267458us) service_pool.cc:224] Handling call
0709 12:25:56.446024 (+ 12641us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:56.456575 (+ 10551us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:56.564091 (+107516us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b180013f540. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cfc9b3c7 00007f03cc2ad9a7 00007f03cc2bd0bf 00007f03cc2bd038
0709 12:25:56.729699 (+165608us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.733376 (+1003677us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.733616 (+   240us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:57.741584 (+  7968us) log.cc:844] Serialized 52 byte log entry
0709 12:25:57.741734 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:57.742006 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.759047 (+ 17041us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.759317 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.759398 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.961868 (+202470us) raft_consensus.cc:1685] finished
0709 12:25:57.961885 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.962025 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42246,"prepare.queue_time_us":299222,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":8325,"raft.queue_time_us":99440,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":176809,"spinlock_wait_cycles":189200128,"thread_start_us":860978,"threads_started":2,"wal-append.queue_time_us":1118289}
I20260709 12:25:58.002914 16487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 787) took 1329 ms. Trace:
I20260709 12:25:57.998374 15829 rpcz_store.cc:276] 0709 12:25:56.620395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.620506 (+   111us) service_pool.cc:224] Handling call
0709 12:25:56.620811 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.627991 (+  7180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.628030 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.628549 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:25:56.793406 (+164857us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:56.793488 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.793666 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.997716 (+1204050us) raft_consensus.cc:1685] finished
0709 12:25:57.997739 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.997875 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1061,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4833,"thread_start_us":94822,"threads_started":1,"wal-append.queue_time_us":401163}
I20260709 12:25:58.008627 15829 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:57.980947 20333 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:57.980883 20461 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:57.918946 20251 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.015664 16489 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 16: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:58.005777 16490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34692 (request call id 0) took 1697 ms. Trace:
I20260709 12:25:57.929981 20903 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:57.929240 20862 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.016399 16490 rpcz_store.cc:276] 0709 12:25:56.285570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.285787 (+   217us) service_pool.cc:224] Handling call
0709 12:25:57.973315 (+1687528us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b54007693d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a9735 00007f03cc2a19fa 00007f03d12694c9 00007f03ca7e5c54 00007f03ca7e5be2 00007f03ca7e5b11 00007f03ca7e5a8c 00007f03ca7e4d42 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:57.982468 (+  9153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189750144}
I20260709 12:25:58.009003 15829 pending_rounds.cc:85] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 6
I20260709 12:25:57.997224 20505 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:58.027856 15829 pending_rounds.cc:107] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:58.029464 15829 raft_consensus.cc:2889] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:57.939605 20890 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.038432 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.003376 16487 rpcz_store.cc:276] 0709 12:25:56.673634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.673778 (+   144us) service_pool.cc:224] Handling call
0709 12:25:56.698648 (+ 24870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.709776 (+ 11128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.709805 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.721620 (+ 11815us) log.cc:844] Serialized 26 byte log entry
0709 12:25:57.040052 (+318432us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:57.339826 (+299774us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.341970 (+  2144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.342073 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.002703 (+660630us) raft_consensus.cc:1685] finished
0709 12:25:58.002726 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.002856 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16452,"prepare.queue_time_us":496194,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":24312,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":22952,"thread_start_us":567418,"threads_started":2,"wal-append.queue_time_us":719936}
W20260709 12:25:58.039570 15835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.014s	sys 0.034s
I20260709 12:25:57.996842 21035 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:57.937918 21008 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:58.041245 15835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.014s	sys 0.034s
I20260709 12:25:58.020787 20251 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.046788 20741 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.047323 20741 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.039191 20505 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.047740 20741 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.049912 20733 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:58.046171 21035 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:58.035868 21027 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:25:58.036746 20985 consensus_meta.cc:287] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.259s	user 0.011s	sys 0.002s
I20260709 12:25:57.911405 20906 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.029593 20461 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.010957 21019 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.069339 21032 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:58.099081 21032 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.042017 20333 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.066264 20505 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.065641 20985 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.103848 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1685) took 1984 ms. Trace:
I20260709 12:25:58.069180 20461 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.104305 15910 rpcz_store.cc:276] 0709 12:25:56.119509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.119631 (+   122us) service_pool.cc:224] Handling call
0709 12:25:56.120018 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:56.200130 (+ 80112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.200163 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:56.200713 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 12:25:56.328779 (+128066us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:56.411916 (+ 83137us) log.cc:844] Serialized 14 byte log entry
0709 12:25:56.434290 (+ 22374us) log.cc:844] Serialized 14 byte log entry
0709 12:25:56.435262 (+   972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.435403 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.490717 (+1055314us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:57.914858 (+424141us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b2400299678. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c903c9c4 00007f03c903aacb 00007f03c91f5dc9 00007f03c91f5a55 00007f03c91f509d 00007f03cbe2710e 00007f03cbe3e88c 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221
0709 12:25:58.103605 (+188747us) raft_consensus.cc:1685] finished
0709 12:25:58.103630 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.103761 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113186,"prepare.queue_time_us":82916,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":6289,"raft.queue_time_us":54334,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":11497,"spinlock_wait_cycles":74190336,"thread_start_us":127679,"threads_started":1,"wal-append.queue_time_us":228321}
I20260709 12:25:58.069607 21034 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.106863 21034 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:25:58.072021 21022 log.cc:927] Time spent T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.492s	user 0.001s	sys 0.000s
W20260709 12:25:58.108985 20988 log.cc:927] Time spent T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.683s	user 0.002s	sys 0.018s
I20260709 12:25:58.074968 20903 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.110487 15832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1114) took 1956 ms. Trace:
I20260709 12:25:58.076154 20890 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:58.086155 15800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.000s	sys 0.035s
W20260709 12:25:58.112298 15800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.000s	sys 0.035s
I20260709 12:25:58.103854 15987 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:58.114100 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:58.119040 21020 log.cc:927] Time spent T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.649s	user 0.002s	sys 0.000s
W20260709 12:25:58.050653 15836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.025s	sys 0.024s
W20260709 12:25:58.128003 15836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.025s	sys 0.024s
I20260709 12:25:58.121302 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 2199) took 1883 ms. Trace:
I20260709 12:25:58.110872 15832 rpcz_store.cc:276] 0709 12:25:56.154545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.157480 (+  2935us) service_pool.cc:224] Handling call
0709 12:25:56.164279 (+  6799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:56.172125 (+  7846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.172169 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:56.177652 (+  5483us) log.cc:844] Serialized 52 byte log entry
0709 12:25:56.342485 (+164833us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:56.342543 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.342618 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.108246 (+1765628us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:58.110193 (+  1947us) raft_consensus.cc:1685] finished
0709 12:25:58.110217 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.110430 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6796,"raft.queue_time_us":7122,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":25702,"spinlock_wait_cycles":14279936,"thread_start_us":164386,"threads_started":1,"wal-append.queue_time_us":247861}
I20260709 12:25:58.134629 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:57.918890 15985 rpcz_store.cc:276] 0709 12:25:56.697228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.697368 (+   140us) service_pool.cc:224] Handling call
0709 12:25:56.714701 (+ 17333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:56.810108 (+ 95407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.810136 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:56.810172 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:56.810201 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.758235 (+948034us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b540011a3d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:57.758298 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:57.758451 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219007744}
I20260709 12:25:58.142374 21001 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.142943 21001 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.128561 15834 rpcz_store.cc:276] 0709 12:25:56.237591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.476933 (+239342us) service_pool.cc:224] Handling call
0709 12:25:56.477310 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.486729 (+  9419us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:56.699854 (+213125us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.086685 (+386831us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.521483 (+434798us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.542072 (+ 20589us) log.cc:844] Serialized 26 byte log entry
0709 12:25:57.542589 (+   517us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:57.543439 (+   850us) log.cc:844] Serialized 14 byte log entry
0709 12:25:57.549706 (+  6267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.549913 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:57.761397 (+211484us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b4800003cd8. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d11ccaa1 00007f03d11c3b37 00007f03d11c39ca 00007f03d12bb26f 00007f03d12baf37 00007f03d12cf55c 00007f03d12cf508 00007f03d12cf488 00007f03d12cf443 00007f03d12ce6ec 00007f03d01f8a96
0709 12:25:58.077724 (+316327us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b1800487720. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d11ccaa1 00007f03d11c3b37 00007f03d11c39ca 00007f03d12bb26f
0709 12:25:58.078166 (+   442us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b4800003cd8. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d11ccaa1 00007f03d11c3b37 00007f03d11c39ca 00007f03d12bb26f 00007f03d12baf37 00007f03d12cf55c 00007f03d12cf508 00007f03d12cf488 00007f03d12cf443 00007f03d12ce6ec 00007f03d01f8a96
0709 12:25:58.118278 (+ 40112us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:58.121050 (+  2772us) raft_consensus.cc:1685] finished
0709 12:25:58.121079 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.121236 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27143,"prepare.queue_time_us":306334,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":122,"raft.queue_time_us":533796,"raft.run_cpu_time_us":4732,"raft.run_wall_time_us":1157339,"spinlock_wait_cycles":75625600,"thread_start_us":743791,"threads_started":3,"wal-append.queue_time_us":721092}
I20260709 12:25:58.146248 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.146817 15834 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:58.147820 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:58.097954 20967 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.127128 20913 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:58.070672 20862 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.146611 21001 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:58.155718 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:58.150873 20873 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.189440 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:58.193753 21019 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:58.160792 20972 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.197324 20972 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.199290 21019 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:58.199930 20972 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.199827 21019 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.200627 20972 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.202371 21019 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.205911 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:58.159063 20461 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:25:58.159991 20953 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.164644 20333 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.263911 15904 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:25:58.266047 15904 pending_rounds.cc:85] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 9
I20260709 12:25:58.266408 15904 pending_rounds.cc:107] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:25:58.266710 15904 raft_consensus.cc:2889] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:58.264722 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.264227 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.265491 21008 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.269449 20884 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.252058 20741 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.270278 21032 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.208129 20985 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.269980 20884 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.271595 16487 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:58.256567 21001 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:58.271955 21033 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.272370 21001 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.273685 21043 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.274248 21043 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.275712 21001 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.161778 20913 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.276384 21043 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.278028 20913 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.272495 21033 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.282240 21033 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.273145 20884 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:58.269596 20931 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 12:25:58.283535 20931 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.267168 20972 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.285604 20931 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.271502 20251 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.286330 15834 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
W20260709 12:25:58.271267 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 113192us
I20260709 12:25:58.287947 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:58.268606 21002 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.289677 20972 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.289942 21002 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.290135 20862 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.290696 15829 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:25:58.290745 20862 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.292069 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.292744 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.293355 15837 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:58.295454 15836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1125) took 1674 ms. Trace:
I20260709 12:25:58.295825 15836 rpcz_store.cc:276] 0709 12:25:56.620697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.620800 (+   103us) service_pool.cc:224] Handling call
0709 12:25:56.647579 (+ 26779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.660799 (+ 13220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.660845 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.486252 (+825407us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b2c00057528. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:25:57.486650 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:25:58.128411 (+641761us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:58.128480 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.128553 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.295192 (+166639us) raft_consensus.cc:1685] finished
0709 12:25:58.295210 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.295403 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":15381,"spinlock_wait_cycles":35453696,"thread_start_us":641400,"threads_started":1,"wal-append.queue_time_us":806983}
I20260709 12:25:58.297135 21035 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.298322 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.298918 15905 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:58.299701 20913 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.300249 20913 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.300863 15733 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 5 to 8, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 8 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:58.303843 20909 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 1.458s	user 0.005s	sys 0.007s
I20260709 12:25:58.304172 20913 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.304873 20906 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.212703 20873 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.309662 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:58.310412 15904 raft_consensus.cc:3060] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:58.270287 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.310983 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:58.310693 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.312960 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:58.313333 15905 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:58.210292 20964 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:58.318255 15981 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:25:58.321878 15983 raft_consensus.cc:1240] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:58.322962 15913 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:58.322875 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:58.327334 15904 raft_consensus.cc:2468] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
W20260709 12:25:58.331491 15878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.011s
I20260709 12:25:58.292902 20862 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:58.339879 15878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.010s	sys 0.011s
I20260709 12:25:58.333282 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.319633 20985 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:58.318225 20953 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.346153 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:58.425138 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74049.1us
I20260709 12:25:58.461967 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.462596 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.462872 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.463677 15907 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:58.465402 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:58.466861 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.468294 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.470075 21047 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.470914 21047 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.471724 15913 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:58.474939 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:58.330258 20913 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:58.484292 20985 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.484858 20985 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.487319 20985 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:58.489116 15952 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:58.323578 20972 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:58.490278 20972 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.491715 20950 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:58.493223 20414 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:58.493656 20873 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.317919 20909 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.498575 15984 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:58.499666 20909 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:58.501801 20949 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:58.328926 20964 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.470136 20862 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:25:58.448087 20904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.000s	sys 0.035s
I20260709 12:25:58.554462 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.557487 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.492691 20972 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.344592 21034 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:58.564577 16489 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34608 (request call id 1071) took 1830 ms (client timeout 2087 ms). Trace:
W20260709 12:25:58.554032 16460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.022s	sys 0.029s
I20260709 12:25:58.564100 15733 catalog_manager.cc:5697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 2 to 5, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 5 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:58.604960 16460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.022s	sys 0.030s
W20260709 12:25:58.605419 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 590699us
W20260709 12:25:58.573251 15912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.023s	sys 0.033s
W20260709 12:25:58.606076 15912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.023s	sys 0.035s
W20260709 12:25:58.604486 16489 rpcz_store.cc:269] 0709 12:25:56.722069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.777966 (+ 55897us) service_pool.cc:224] Handling call
0709 12:25:58.552542 (+1774576us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400500354. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:58.552709 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769815424}
W20260709 12:25:58.612812 15987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58562 (request call id 962) took 1954 ms (client timeout 2029 ms). Trace:
I20260709 12:25:58.562501 20480 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:58.624199 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:58.615262 15987 rpcz_store.cc:269] 0709 12:25:56.652718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.652855 (+   137us) service_pool.cc:224] Handling call
0709 12:25:58.606980 (+1954125us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400119ed4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:58.607142 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3334300032}
I20260709 12:25:58.352373 20953 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.608739 20873 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.611008 20659 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.611240 20461 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:58.638710 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 448850us
I20260709 12:25:58.631644 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:58.604074 20862 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.646189 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:58.651041 15904 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:25:58.629199 21047 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.664983 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.652269 21034 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:58.628918 20480 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.652251 20936 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:58.656445 20998 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:58.652987 20964 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.677661 21043 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:25:58.678503 16458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.002s	sys 0.030s
I20260709 12:25:58.678187 21043 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:58.678843 16458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.002s	sys 0.030s
W20260709 12:25:58.680068 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2fa3925738bd485e912c7ac0e28b0265 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:25:58.675634 20931 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:58.681586 20931 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.682529 20535 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:58.683024 20535 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.683249 20889 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:58.683601 20931 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.684106 20931 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.683943 20889 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.650023 20659 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.684959 20535 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:58.686450 20889 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.687718 20659 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:58.688575 15838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.012s	sys 0.022s
W20260709 12:25:58.689165 15838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.022s
I20260709 12:25:58.642874 20461 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:58.697772 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.022s	sys 0.025s
W20260709 12:25:58.699427 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.022s	sys 0.026s
I20260709 12:25:58.703436 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:58.700699 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 662256us
I20260709 12:25:58.652426 20873 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.707074 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:58.723124 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.724757 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.723891 16490 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:58.702719 20884 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:58.701906 20889 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:58.684618 20931 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.703181 21034 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:58.705199 20998 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:58.727928 15835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.025s
W20260709 12:25:58.733490 15835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.011s	sys 0.025s
I20260709 12:25:58.705852 20967 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:58.733273 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:58.717846 20964 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:58.735975 16489 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 16: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:25:58.691190 20936 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.757295 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:25:58.725746 21043 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:58.734073 20965 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.022s	sys 0.012s
W20260709 12:25:58.891961 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 156567us
W20260709 12:25:58.896615 15829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.031s	sys 0.034s
W20260709 12:25:58.897161 15829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.032s	sys 0.034s
W20260709 12:25:58.894718 15910 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.012s	sys 0.056s
W20260709 12:25:58.903812 15910 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.012s	sys 0.056s
I20260709 12:25:58.929076 20461 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.929194 20733 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:58.929960 20461 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.929935 20733 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:58.930622 20461 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:25:58.895473 20965 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.022s	sys 0.012s
I20260709 12:25:58.890026 20535 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.936424 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.932790 20461 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:58.937450 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:58.954941 15833 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:25:58.894809 21046 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:58.735562 21034 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.754422 20889 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.962955 15950 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:58.875447 20967 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:58.994773 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.997741 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:58.953284 20949 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:25:58.987424 15837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.013s	sys 0.009s
I20260709 12:25:58.905995 20365 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:58.971390 20964 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:25:58.971911 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74321us
I20260709 12:25:58.986318 20733 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:58.933686 21053 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 12:25:59.001561 15837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.013s	sys 0.010s
I20260709 12:25:59.077598 16489 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:58.958642 20535 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.007634 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.098826 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:59.090713 15952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.012s
W20260709 12:25:59.100317 15952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.012s	sys 0.012s
I20260709 12:25:59.013515 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.014355 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.012509 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.012151 15983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43666 (request call id 2205) took 1237 ms. Trace:
I20260709 12:25:59.017966 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.088318 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.119385 16490 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:25:59.118209 15983 rpcz_store.cc:276] 0709 12:25:57.775237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.775490 (+   253us) service_pool.cc:224] Handling call
0709 12:25:58.320835 (+545345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.322247 (+  1412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.011969 (+689722us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002f62d0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a28ad 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:59.012095 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955051776}
I20260709 12:25:59.009407 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.023208 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:59.103518 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.128731 15986 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:59.119520 15988 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:59.102803 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:59.002943 21049 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
W20260709 12:25:59.002532 21050 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:25:59.000618 20914 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:59.096623 20505 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.010s	sys 0.018s
I20260709 12:25:59.136404 20535 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:59.136858 20505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.011s	sys 0.019s
I20260709 12:25:59.136798 20914 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:59.100666 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 610282us
I20260709 12:25:58.993917 20953 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:59.129366 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 106216us
I20260709 12:25:59.137809 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.138492 15987 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:25:59.025664 20873 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.131222 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.139283 20931 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.140305 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.141078 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.141368 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.141732 15838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3141) took 1581 ms. Trace:
I20260709 12:25:59.141836 20733 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.143232 20967 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.142168 15838 rpcz_store.cc:276] 0709 12:25:57.559959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.927736 (+367777us) service_pool.cc:224] Handling call
0709 12:25:57.942126 (+ 14390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.961594 (+ 19468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.961625 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.962036 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:25:58.689597 (+727561us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:58.697837 (+  8240us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.698714 (+   877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.698819 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.141542 (+442723us) raft_consensus.cc:1685] finished
0709 12:25:59.141560 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.141678 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19051,"prepare.queue_time_us":6911,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":25248,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":46001,"thread_start_us":658047,"threads_started":1,"wal-append.queue_time_us":1097528}
I20260709 12:25:59.143270 20733 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:59.144556 20889 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:59.118566 15832 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 9.
I20260709 12:25:59.145620 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.148054 15832 raft_consensus.cc:1240] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:25:59.102604 20981 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:59.149879 20936 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.103874 20639 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:59.151118 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:25:59.151345 21052 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:25:59.067173 21043 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:59.152434 21043 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.152988 20959 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:59.153466 20959 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:59.153838 20959 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:59.154918 21043 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.156234 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.156752 21034 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.137499 20914 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.167977 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.168118 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.149744 20981 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.138005 15830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 2208) took 2275 ms. Trace:
I20260709 12:25:59.139312 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:59.172578 15987 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:59.144496 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.169533 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.092912 20862 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.158555 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.159346 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.177114 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:59.170238 15830 rpcz_store.cc:276] 0709 12:25:56.862651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.300818 (+438167us) service_pool.cc:224] Handling call
0709 12:25:57.309219 (+  8401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:57.907597 (+598378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.907647 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:57.914010 (+  6363us) log.cc:844] Serialized 52 byte log entry
0709 12:25:58.344554 (+430544us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:58.344602 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.344681 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.137790 (+793109us) raft_consensus.cc:1685] finished
0709 12:25:59.137811 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.137950 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460,"raft.queue_time_us":107084,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10655,"thread_start_us":1000898,"threads_started":2,"wal-append.queue_time_us":767886}
I20260709 12:25:59.173532 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.179225 15987 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:59.181644 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.182345 15983 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:58.992671 21046 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.184113 15987 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:59.193836 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:59.201406 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:59.185577 16460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.012s	sys 0.037s
W20260709 12:25:59.205459 16460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.012s	sys 0.038s
W20260709 12:25:59.185954 15909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.006s	sys 0.043s
I20260709 12:25:59.131469 20770 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:59.068485 20949 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.000892 20998 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.187024 21047 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:59.105268 20365 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.219203 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:25:59.228864 15733 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.016s
I20260709 12:25:59.229408 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.183758 20953 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:25:59.204572 20862 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:59.212186 21015 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 1.797s	user 0.016s	sys 0.018s
I20260709 12:25:59.220566 20981 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.246470 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:25:59.207890 15909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.006s	sys 0.043s
I20260709 12:25:59.230268 21047 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:59.249634 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.253172 16493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34602 (request call id 793) took 1228 ms. Trace:
I20260709 12:25:59.259218 20953 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:59.259872 21051 log.cc:927] Time spent T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:25:59.266851 16493 rpcz_store.cc:276] 0709 12:25:58.025695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.025951 (+   256us) service_pool.cc:224] Handling call
0709 12:25:58.026269 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.131789 (+105520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.131823 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.131861 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:58.131892 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.252933 (+1121041us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54004ffe54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:59.252995 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.253123 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242177920}
I20260709 12:25:59.269860 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.209589 20964 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.262920 20862 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:59.250976 15733 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.002s	sys 0.016s
W20260709 12:25:59.279529 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 163874us
I20260709 12:25:59.265219 21032 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:59.282640 15984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36158 (request call id 1673) took 2625 ms (client timeout 3221 ms). Trace:
I20260709 12:25:59.290907 15904 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:59.292848 15980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1674) took 2641 ms. Trace:
I20260709 12:25:59.293255 15980 rpcz_store.cc:276] 0709 12:25:56.651354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.653655 (+  2301us) service_pool.cc:224] Handling call
0709 12:25:56.654018 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.689497 (+ 35479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:56.689528 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.701525 (+ 11997us) log.cc:844] Serialized 26 byte log entry
0709 12:25:56.847919 (+146394us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:56.847977 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.848072 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.981160 (+2133088us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:59.292538 (+311378us) raft_consensus.cc:1685] finished
0709 12:25:59.292560 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.292762 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27725,"raft.queue_time_us":37675,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":14096,"spinlock_wait_cycles":23006464,"thread_start_us":112122,"threads_started":1,"wal-append.queue_time_us":554714}
I20260709 12:25:59.294691 20251 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.295352 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.296178 15907 raft_consensus.cc:2393] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:25:59.296573 15982 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36158 (request call id 1689) took 1163 ms. Trace:
I20260709 12:25:59.297057 15982 rpcz_store.cc:276] 0709 12:25:58.132811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.135812 (+  3001us) service_pool.cc:224] Handling call
0709 12:25:58.136141 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.278801 (+142660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.278844 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.278897 (+    53us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:25:58.278958 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.296300 (+1017342us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002c5954. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:59.296358 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.296503 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327591680}
I20260709 12:25:59.299115 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.299860 15912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1697) took 1659 ms. Trace:
I20260709 12:25:59.300251 15912 rpcz_store.cc:276] 0709 12:25:57.640742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.641148 (+   406us) service_pool.cc:224] Handling call
0709 12:25:57.641566 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.641983 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.642017 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.953059 (+311042us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b2c00001158. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cabac372 00007f03cc2dea01 00007f03cc2a343a 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2
0709 12:25:57.953435 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 12:25:58.606418 (+652983us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:58.606469 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.606535 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.299577 (+693042us) raft_consensus.cc:1685] finished
0709 12:25:59.299598 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.299802 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302848,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":33265,"spinlock_wait_cycles":14266624,"thread_start_us":652608,"threads_started":1,"wal-append.queue_time_us":782215}
I20260709 12:25:59.301807 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.267323 21047 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.306576 20365 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:59.283902 15984 rpcz_store.cc:269] 0709 12:25:56.650947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.664704 (+ 13757us) service_pool.cc:224] Handling call
0709 12:25:59.276039 (+2611335us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400314cd4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:59.276187 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4195979136}
I20260709 12:25:59.312669 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.324178 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.324780 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:59.268774 20953 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:25:59.348209 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.281199 20862 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.263566 21059 consensus_queue.cc:1059] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 12:25:59.353562 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 201343us
I20260709 12:25:59.326568 20365 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:59.359658 16494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:25:59.339962 21043 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:59.353149 20532 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:59.360508 20365 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:59.368000 16460 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.78.67:39871 timed out after 2.029s (SENT) [suppressed 6 similar messages]
I20260709 12:25:59.424522 15910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 3131) took 1128 ms. Trace:
I20260709 12:25:59.383687 20365 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.438860 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.439688 15987 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:25:59.490809 15835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.030s
W20260709 12:25:59.491324 15835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.030s
I20260709 12:25:59.502130 15834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57452 (request call id 2212) took 1387 ms. Trace:
I20260709 12:25:59.502700 15834 rpcz_store.cc:276] 0709 12:25:58.114522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.147559 (+ 33037us) service_pool.cc:224] Handling call
0709 12:25:59.501451 (+1353892us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540027f6d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a72fa 00007f03d1268b17 00007f03ca7e36d4 00007f03ca7e3662 00007f03ca7e3591 00007f03ca7e350c 00007f03ca7e27c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:25:59.501934 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316029312}
W20260709 12:25:59.517869 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 360519us
I20260709 12:25:59.518694 15952 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:59.438808 21046 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:25:59.569191 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 210620us
I20260709 12:25:59.574635 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:59.526847 21064 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
I20260709 12:25:59.377108 20953 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.575862 15835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3136) took 2723 ms. Trace:
I20260709 12:25:59.428406 21043 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.584481 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.577399 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.525674 20917 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.584877 15835 rpcz_store.cc:276] 0709 12:25:56.841442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.076949 (+235507us) service_pool.cc:224] Handling call
0709 12:25:57.077430 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:58.044963 (+967533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.044996 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:58.127909 (+ 82913us) log.cc:844] Serialized 52 byte log entry
0709 12:25:58.733923 (+606014us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:58.890105 (+156182us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.950099 (+ 59994us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18003c6700. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9198e07 00007f03d1ff39a9 00007f03c91b569b 00007f03c91b393f 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:25:59.492021 (+541922us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.516235 (+ 24214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.522052 (+  5817us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.564190 (+ 42138us) raft_consensus.cc:1685] finished
0709 12:25:59.564216 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.564437 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63551,"prepare.queue_time_us":156136,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":9782,"raft.queue_time_us":296719,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":38134,"spinlock_wait_cycles":28206720,"thread_start_us":2075426,"threads_started":3,"wal-append.queue_time_us":999183}
I20260709 12:25:59.605065 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.612500 21048 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.613129 21048 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.615293 21048 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:25:59.585175 21060 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:25:59.530038 20949 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:25:59.583169 21058 log.cc:927] Time spent T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:25:59.622676 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 108223us
W20260709 12:25:59.627189 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 259536us
I20260709 12:25:59.629900 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:59.632062 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.629555 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.633757 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:59.635111 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:25:59.612412 20959 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.647776 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.656210 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.657536 15835 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:59.575325 21082 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:25:59.659092 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.660746 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.631858 20914 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.670274 15982 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:59.662916 15913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41588 (request call id 1016) took 1188 ms. Trace:
I20260709 12:25:59.670856 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 3123) took 1408 ms. Trace:
I20260709 12:25:59.672974 15913 rpcz_store.cc:276] 0709 12:25:58.474268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.478252 (+  3984us) service_pool.cc:224] Handling call
0709 12:25:58.478494 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.661426 (+182932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.661472 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.661537 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:58.661588 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.662663 (+1001075us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400305554. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:25:59.662720 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.662860 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420102528}
I20260709 12:25:59.643031 21048 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:59.679426 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.674098 15909 rpcz_store.cc:276] 0709 12:25:58.262128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.262261 (+   133us) service_pool.cc:224] Handling call
0709 12:25:58.262618 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:58.266329 (+  3711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.266369 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:58.266805 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.265826 (+999021us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:59.266296 (+   470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.266365 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.670646 (+404281us) raft_consensus.cc:1685] finished
0709 12:25:59.670670 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.670798 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125480,"raft.queue_time_us":65555,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8260,"thread_start_us":998703,"threads_started":1,"wal-append.queue_time_us":985509}
I20260709 12:25:59.682260 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.682687 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.658015 21032 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:25:59.685384 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 291183us
I20260709 12:25:59.684508 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.688495 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:25:59.691393 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 121257us
I20260709 12:25:59.680330 21046 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:59.691027 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 172413us
I20260709 12:25:59.694428 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.696117 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.698341 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3147) took 1379 ms. Trace:
I20260709 12:25:59.698693 15837 rpcz_store.cc:276] 0709 12:25:58.318757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.318881 (+   124us) service_pool.cc:224] Handling call
0709 12:25:58.319249 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:58.319603 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.319635 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:58.322700 (+  3065us) log.cc:844] Serialized 52 byte log entry
0709 12:25:59.096243 (+773543us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:59.129867 (+ 33624us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.130160 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.130255 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.698128 (+567873us) raft_consensus.cc:1685] finished
0709 12:25:59.698147 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.698290 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23983,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":599,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10657,"spinlock_wait_cycles":24303872,"thread_start_us":747561,"threads_started":1,"wal-append.queue_time_us":873151}
I20260709 12:25:59.668174 20365 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.686048 20949 raft_consensus.cc:2804] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:59.700891 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.685914 21044 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:59.703281 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.721757 21044 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:59.705140 20914 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:59.428776 15910 rpcz_store.cc:276] 0709 12:25:58.295666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.296407 (+   741us) service_pool.cc:224] Handling call
0709 12:25:58.296668 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.296861 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:58.933777 (+636916us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.424060 (+490283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:59.424134 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:59.424194 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.424282 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.424437 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":887969,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":5015,"thread_start_us":1096176,"threads_started":2}
I20260709 12:25:59.722565 20949 raft_consensus.cc:697] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:59.689327 21032 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.723470 20949 consensus_queue.cc:237] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.724695 21032 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.713363 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.682480 21048 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.701743 21046 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.714813 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.715899 20365 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:59.716519 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:25:59.734091 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.735324 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.736367 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.716909 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.737157 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.737926 15987 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:25:59.718319 20959 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:59.719002 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.685842 21088 consensus_queue.cc:1059] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:59.732575 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.743196 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.720937 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.722154 21044 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.751528 21048 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.752388 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:25:59.727234 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.753352 15837 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:25:59.754233 21043 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.756270 20480 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.756536 21046 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.757246 21046 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:59.757773 21046 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.760144 21046 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.762842 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.764722 21044 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.766978 21044 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.767836 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.768515 15984 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:25:59.768153 21047 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.770141 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:59.770668 21047 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:25:59.773049 20917 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:59.773615 20917 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.775815 20917 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.729022 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:25:59.777400 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 81737.5us
I20260709 12:25:59.778105 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:25:59.779187 21045 log.cc:927] Time spent T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 1.130s	user 0.004s	sys 0.007s
I20260709 12:25:59.779510 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.779850 15983 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:59.780433 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.780619 15831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57452 (request call id 2205) took 2918 ms. Trace:
I20260709 12:25:59.781803 21100 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:59.782691 21100 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:59.781193 15831 rpcz_store.cc:276] 0709 12:25:56.861909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.283485 (+421576us) service_pool.cc:224] Handling call
0709 12:25:57.283819 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.552588 (+268769us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:57.552851 (+   263us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.564502 (+ 11651us) log.cc:844] Serialized 26 byte log entry
0709 12:25:58.209949 (+645447us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:58.209985 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.210999 (+  1014us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.778493 (+1567494us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:25:59.780346 (+  1853us) raft_consensus.cc:1685] finished
0709 12:25:59.780367 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.780559 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26072,"raft.queue_time_us":181735,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":17292,"spinlock_wait_cycles":4753152,"thread_start_us":716911,"threads_started":2,"wal-append.queue_time_us":1051886}
I20260709 12:25:59.783294 21100 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.783740 21100 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:59.784235 21100 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.785637 21088 raft_consensus.cc:3055] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:59.786177 21088 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:25:59.787191 21088 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.788669 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.789377 15906 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:25:59.702440 15834 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:25:59.791296 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:59.744508 21086 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:59.745294 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.746574 20862 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.794662 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.796981 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.800388 15910 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:59.788669 21088 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.801123 20480 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:59.801491 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.801710 20480 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.802647 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.803635 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.803956 20480 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.804131 15904 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.804979 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.805590 15906 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.806279 21100 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.807972 20465 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.808609 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.809294 15834 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:25:59.810241 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.811681 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.821945 15906 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:59.821854 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.859560 15904 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:59.876085 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.816699 20480 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:59.883924 15953 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.816551 21002 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:59.886189 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.891332 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.808534 20465 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.891551 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.858671 20873 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.897143 20862 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:25:59.894706 21046 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:25:59.897871 20480 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.878328 21065 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:59.880746 21097 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.900513 21100 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:25:59.904114 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:25:59.907527 15907 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:59.908957 20873 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.913653 15829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3161) took 1383 ms. Trace:
I20260709 12:25:59.916043 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.925446 15829 rpcz_store.cc:276] 0709 12:25:58.530374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.147340 (+616966us) service_pool.cc:224] Handling call
0709 12:25:59.147605 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.147908 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.147935 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.168084 (+ 20149us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.534864 (+366780us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:59.534925 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.535035 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.913388 (+378353us) raft_consensus.cc:1685] finished
0709 12:25:59.913416 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.913584 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2542,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":329563,"threads_started":1,"wal-append.queue_time_us":471052}
I20260709 12:25:59.934382 15953 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.937536 20914 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:59.939224 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.942471 20914 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.943753 21073 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:59.943863 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.944408 21073 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:25:59.944904 20914 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:59.944901 21073 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:59.945479 20914 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:25:59.946002 20914 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.951357 15986 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:59.953346 15953 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:25:59.955199 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:59.940855 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 305817us
I20260709 12:25:59.961493 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.957291 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.962625 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.967024 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.970911 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:25:59.970935 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 277602us
I20260709 12:25:59.972003 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.972201 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.972884 15909 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:25:59.974061 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:25:59.974063 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.977334 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.977928 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:59.978603 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:25:59.978694 15984 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.982609 15907 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:25:59.982563 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:59.984187 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.984871 15829 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:25:59.985980 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:25:59.986749 15834 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:25:59.988951 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.952111 21100 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:59.913959 21046 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:25:59.961808 20953 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:59.911945 21002 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.996757 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:25:59.995697 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.000607 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:25:59.998171 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.029853 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.038693 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.006326 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.007222 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.004966 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.039644 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.040426 15835 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.040815 15907 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:00.007781 15984 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:00.040707 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:59.919103 21065 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:25:59.967216 21082 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:00.041913 15834 raft_consensus.cc:3060] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.046180 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:00.046401 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:25:59.921712 21097 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.068195 15952 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:00.049863 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:00.043583 15908 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:25:59.988381 20251 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:26:00.085575 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:00.049398 15879 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:00.069088 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:00.071970 15905 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.001382 21048 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:00.069587 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.081651 15833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57462 (request call id 3148) took 1761 ms. Trace:
I20260709 12:26:00.045224 20741 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.084882 21084 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.096342 21084 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.096838 15905 raft_consensus.cc:1240] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:00.097986 20480 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:00.098645 21084 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.098757 20480 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:00.085052 20414 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:00.100855 20414 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:25:59.999854 21100 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:00.091704 15833 rpcz_store.cc:276] 0709 12:25:58.320283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.955668 (+635385us) service_pool.cc:224] Handling call
0709 12:25:58.988424 (+ 32756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:59.132268 (+143844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.132313 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:59.135599 (+  3286us) log.cc:844] Serialized 52 byte log entry
0709 12:25:59.355265 (+219666us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:59.370021 (+ 14756us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.370272 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.045339 (+675067us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540033d1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:00.045390 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.045448 (+    58us) raft_consensus.cc:1685] finished
0709 12:26:00.079349 (+ 33901us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.081594 (+  2245us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17612,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":807,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":338381184,"thread_start_us":218528,"threads_started":1,"wal-append.queue_time_us":465496}
I20260709 12:26:00.071437 21059 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.120543 20465 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.119515 15986 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
W20260709 12:26:00.122038 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53034.7us
I20260709 12:26:00.045878 21107 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:00.122278 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.122793 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.081619 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:00.086714 21034 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.120630 21059 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.127674 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:00.171744 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 49029.5us
W20260709 12:26:00.172482 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 90945us
I20260709 12:26:00.104491 20862 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:00.094617 21048 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:00.116945 20414 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.172538 15834 raft_consensus.cc:2468] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:00.085301 21019 raft_consensus.cc:2804] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:00.188433 15835 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
W20260709 12:26:00.188675 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61151us
I20260709 12:26:00.122087 21100 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.191748 15876 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.192878 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
W20260709 12:26:00.199882 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 591051us
I20260709 12:26:00.187938 21047 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:00.200649 20914 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.201507 20963 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:00.201901 16459 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.204418 21059 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:00.201200 21047 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:00.184908 20862 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:00.205868 20862 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.206327 21047 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.209877 20966 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:26:00.209937 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 580156us
I20260709 12:26:00.210436 20966 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:00.210834 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.211345 20966 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.212083 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.213387 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.214888 20951 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:00.215694 20951 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:00.216012 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.216305 20951 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.194969 21048 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.219519 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.222661 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.188283 20949 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.167423 21107 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.174281 21044 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.236589 21080 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:00.237468 21121 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:00.239774 20873 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.232980 16494 raft_consensus.cc:606] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.240942 16494 raft_consensus.cc:614] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:00.241730 20951 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.242555 21002 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:00.243283 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47921us
I20260709 12:26:00.189893 20365 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:00.244261 20365 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:00.244779 20365 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:00.245236 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 49188.1us
I20260709 12:26:00.246958 21097 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.236348 21044 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.249092 21065 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.249421 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.250234 16460 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.250965 21046 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:00.251430 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:00.252074 16460 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.255268 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.255686 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.257339 15984 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:00.251027 20974 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:00.256786 15986 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.260306 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.240298 20873 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:00.255577 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.223004 16488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34692 (request call id 1) took 1143 ms. Trace:
W20260709 12:26:00.265597 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.271940 16488 rpcz_store.cc:276] 0709 12:25:59.079784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.080094 (+   310us) service_pool.cc:224] Handling call
0709 12:26:00.222736 (+1142642us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54007693d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a9735 00007f03cc2a19fa 00007f03d12694c9 00007f03ca7e5c54 00007f03ca7e5be2 00007f03ca7e5b11 00007f03ca7e5a8c 00007f03ca7e4d42 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:00.222943 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448629376}
I20260709 12:26:00.212842 20966 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:00.278797 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 190616us
I20260709 12:26:00.281122 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.190644 21084 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:00.283638 15983 raft_consensus.cc:2410] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:26:00.285902 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.271554 20873 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.279125 20959 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:26:00.287547 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2fa3925738bd485e912c7ac0e28b0265 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:00.293967 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.294725 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:00.294356 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 206745us
I20260709 12:26:00.265149 20963 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.271659 21056 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.272236 21082 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.264952 20914 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.306788 15879 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.271977 20951 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:00.316825 15986 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.290815 20975 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.298877 20873 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.329439 20951 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.331816 21019 raft_consensus.cc:697] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:00.332981 21084 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:00.333788 20951 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:00.320909 21107 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:00.334013 21084 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.347302 20873 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.352252 20873 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.318943 21034 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:00.372452 21074 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.797s	user 0.001s	sys 0.002s
I20260709 12:26:00.373723 16489 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:26:00.343365 21104 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.239s	user 0.004s	sys 0.000s
I20260709 12:26:00.358969 15879 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:00.382899 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:00.382089 21065 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:26:00.357300 20465 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:26:00.408244 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 215432us
I20260709 12:26:00.409063 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.430302 20949 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.430940 20949 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:00.432112 21116 log.cc:927] Time spent T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:26:00.403192 21102 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:00.435431 15876 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:00.445590 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.332993 21019 consensus_queue.cc:237] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.459813 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.465229 20414 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.479884 15911 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:00.481581 20414 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:00.482679 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.466913 20365 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.467365 21100 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.487489 15984 raft_consensus.cc:1240] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:00.467720 21032 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.468613 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:00.489451 15835 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 8.
I20260709 12:26:00.468742 15876 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.471349 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.476058 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.476306 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.476758 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.476960 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.490319 21100 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.511677 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.491346 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.510556 21032 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.513063 20414 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:00.517249 20365 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:00.518159 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 68929.7us
I20260709 12:26:00.418887 20741 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.522614 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:00.538756 21096 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:00.539359 21096 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.539865 21096 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:00.541644 21122 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:26:00.446722 20333 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.449016 21102 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:00.561088 21102 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.451707 21125 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:00.565490 21125 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.565950 21125 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.567484 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:00.568632 20333 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:00.453786 21073 consensus_meta.cc:287] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 12:26:00.569190 20333 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.569823 20333 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.569604 21073 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.572197 21073 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.449999 20873 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.415731 20465 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.575948 20465 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.417460 20862 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.578329 20862 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:00.584421 15905 raft_consensus.cc:1240] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.526484 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.533592 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:00.597157 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63640.1us
W20260709 12:26:00.598263 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 77207.2us
I20260709 12:26:00.584084 20333 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:00.522723 21124 log.cc:927] Time spent T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:26:00.523370 21117 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:26:00.530483 21103 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.612089 16496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 850) took 2343 ms. Trace:
I20260709 12:26:00.617689 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.614449 15802 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.525244 20949 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.620231 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.616232 16496 rpcz_store.cc:276] 0709 12:25:58.260856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.260971 (+   115us) service_pool.cc:224] Handling call
0709 12:25:58.261293 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.514277 (+252984us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:59.092412 (+578135us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.376827 (+284415us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.166883 (+790056us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b18004c3de0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c9130c0a 00007f03d2870219 00007f03c91b8a40 00007f03c91b34e4 00007f03c91b3455 00007f03cc29b060 00007f03cc2ad716 00007f03cc2be287 00007f03cc2be208
0709 12:26:00.167002 (+   119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:00.167037 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:00.167081 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.603497 (+436416us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54007693d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:00.603552 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.603700 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":831275,"prepare.queue_time_us":428047,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":99,"raft.queue_time_us":797481,"raft.run_cpu_time_us":2409,"raft.run_wall_time_us":22065,"spinlock_wait_cycles":829568256,"thread_start_us":769708,"threads_started":2,"wal-append.queue_time_us":582115}
I20260709 12:26:00.625684 15802 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.629498 21128 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:00.630156 20333 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.630081 21128 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:00.630847 20733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.016s	sys 0.006s
W20260709 12:26:00.631212 20733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.016s	sys 0.006s
I20260709 12:26:00.597839 21034 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:00.529572 21025 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:26:00.638378 15802 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:00.607522 21065 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:00.641140 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:00.642359 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 363822us
I20260709 12:26:00.533066 21048 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.644922 15802 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.647609 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.648337 15911 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:00.649686 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.648274 15802 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.647030 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.646041 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.654989 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.647614 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.690615 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:00.631770 21106 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:00.653879 15802 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:00.689496 15831 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:00.636053 20532 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:00.700315 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46504.2us
I20260709 12:26:00.628166 20959 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:00.642004 21033 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.697695 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.692776 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.705083 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:26:00.653855 20953 consensus_meta.cc:287] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.003s
I20260709 12:26:00.709141 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.710338 20333 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:26:00.710512 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 62958.4us
I20260709 12:26:00.710573 15907 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:00.645807 20465 raft_consensus.cc:2749] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.642592 21065 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.710667 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.714145 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.653460 21073 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.691493 21069 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:00.718036 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.720196 15908 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.722849 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:00.695506 21002 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:00.709169 21033 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:00.736019 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:00.737748 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.738091 20959 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.739081 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.716198 21065 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.741277 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:00.740438 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.744175 15913 raft_consensus.cc:2393] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:00.722339 21141 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:00.725013 21106 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.726872 20505 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.725795 21002 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:00.751050 21090 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
W20260709 12:26:00.752763 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.732826 21140 consensus_queue.cc:1059] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:26:00.756166 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.740075 21033 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:00.764561 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 55919us
W20260709 12:26:00.765386 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.769894 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.727208 20981 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:26:00.772174 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.772876 15980 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:00.774039 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:00.774731 15983 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.775914 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.778599 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:00.786130 21105 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:00.786695 21105 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.788887 21105 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:00.750156 21141 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.762827 21002 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.762509 21106 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.810050 21141 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:00.845309 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 47437us
I20260709 12:26:00.773681 21090 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.843679 15983 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:00.846213 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:00.852548 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:00.807116 21096 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.862131 21033 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.893200 21033 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:00.863345 20251 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:00.894059 20251 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.894459 20251 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.863418 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.898504 15802 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.899628 15802 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.867905 21090 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.902215 15981 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:00.813525 21059 consensus_queue.cc:1059] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:26:00.874363 21141 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.875299 21065 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.882407 21106 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.855880 20532 consensus_queue.cc:1059] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:26:00.893246 21096 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.900652 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:00.863698 21048 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:00.868916 21125 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.904469 15802 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.915304 15802 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:00.916338 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.903457 21140 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:00.903903 21043 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:00.923161 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:00.926995 15982 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.903815 21033 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.944010 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:00.946796 15802 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:00.912109 21034 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:00.952437 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:00.950172 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:00.927095 21106 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.925210 21147 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.957419 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:00.958905 15913 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 9.
I20260709 12:26:00.958954 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.926349 21069 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.960119 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:26:00.964753 21150 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:26:00.954169 21034 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.967602 21141 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.969637 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:00.970178 15834 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.972255 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60434 (request call id 10) took 1632 ms. Trace:
I20260709 12:26:00.973958 21102 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.975538 21102 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:00.977823 15834 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:00.954448 21126 consensus_queue.cc:1059] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:26:00.981530 21111 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.778s	user 0.003s	sys 0.000s
I20260709 12:26:00.982045 21065 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:00.982190 21126 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:00.982589 21126 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:00.983350 21126 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:00.984476 21126 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.954497 20532 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:00.987936 21047 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.972668 16494 rpcz_store.cc:276] 0709 12:25:59.339475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.359528 (+ 20053us) service_pool.cc:224] Handling call
0709 12:26:00.972054 (+1612526us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54007693d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc29d853 00007f03d126b60a 00007f03ca7f17d4 00007f03ca7f1762 00007f03ca7f1691 00007f03ca7f160c 00007f03ca7f08c2 00007f03ca5de48c 00007f03ca5dd8c6 00007f03ca5dd26f
0709 12:26:00.972172 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007084800}
I20260709 12:26:00.990300 15982 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:00.990864 15831 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:00.992853 20917 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:00.993251 20917 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:00.989342 21125 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:01.003346 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.033362 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.034894 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.035660 15912 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:01.032864 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:01.041682 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.040339 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:01.044601 15986 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.047390 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:00.996523 21002 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.049917 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:01.051261 15983 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:01.057453 21034 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.060542 20951 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:01.060647 20964 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:01.062253 20951 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:01.060575 21034 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:01.062645 20951 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.063752 20951 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:01.065305 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73989.3us
I20260709 12:26:01.045531 21147 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:01.073360 21147 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:01.073712 21147 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.068753 20917 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.077286 20917 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:01.078043 15909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1702) took 1223 ms. Trace:
I20260709 12:26:01.065011 20951 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:01.086395 21109 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.896s	user 0.000s	sys 0.002s
I20260709 12:26:01.038554 21048 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:26:01.090840 15833 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.078404 15909 rpcz_store.cc:276] 0709 12:25:59.854640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.072336 (+217696us) service_pool.cc:224] Handling call
0709 12:26:00.082221 (+  9885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:00.289468 (+207247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.289509 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:00.289556 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:00.289590 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.077845 (+788255us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540010cf54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:01.077888 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.077992 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475658496}
I20260709 12:26:01.097898 15832 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:01.103116 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.104959 21103 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.107510 21103 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:01.108371 21103 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.109525 21103 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.109383 20251 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.111726 20966 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:01.112427 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:01.116688 15907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 3156) took 1301 ms. Trace:
I20260709 12:26:01.116868 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.112737 20966 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:01.115031 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.117026 15950 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:01.119334 21100 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:01.119810 21100 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:01.119954 21065 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:01.120203 21102 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:01.120711 21100 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.121701 15835 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:26:01.122087 21142 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:01.122473 21142 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:01.123360 21132 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.123615 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.123775 21132 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.124671 21132 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.105170 15831 raft_consensus.cc:1240] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:01.115856 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.115180 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.121145 21105 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:01.127233 21105 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:01.128168 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:01.128011 21105 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.129128 21105 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.129320 21087 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:01.130647 21128 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:01.130697 20959 consensus_queue.cc:1059] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:01.131762 20959 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:01.132088 20959 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:01.115449 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.117076 15907 rpcz_store.cc:276] 0709 12:25:59.815793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.045442 (+229649us) service_pool.cc:224] Handling call
0709 12:26:00.085346 (+ 39904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:00.718802 (+633456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.116500 (+397698us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400421654. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:01.116639 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422076672}
I20260709 12:26:01.117239 21135 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.132853 20959 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.136128 20959 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.136788 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.138470 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.116030 15909 raft_consensus.cc:1275] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:01.141170 15907 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:01.117599 20966 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.117995 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.118088 15908 raft_consensus.cc:2410] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:26:01.150457 21080 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:01.165644 21142 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.167034 21142 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:01.169626 20966 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.169947 21147 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.170835 20966 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.171025 20251 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:01.174582 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.175040 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.175351 15911 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.177850 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:01.178524 15983 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:01.150125 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:01.133803 15833 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:01.153491 15835 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.159579 21102 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.177795 15913 raft_consensus.cc:1240] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:26:01.161427 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.161712 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.162454 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:01.163110 15912 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:01.181695 15905 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:01.163305 15803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.185803 15984 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:01.186640 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.192395 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:01.193938 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 43923us
I20260709 12:26:01.195223 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:01.106144 21048 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:01.198757 20251 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.209622 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:01.211120 15952 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:01.212280 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:01.213337 15981 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:01.203473 15986 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
W20260709 12:26:01.204046 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.185745 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.208088 15987 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.208108 15911 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:26:01.230355 15988 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:01.215081 20251 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:01.231285 20251 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.178918 21132 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.237059 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.235201 15802 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:01.237514 15986 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:01.238240 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.241909 15983 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:01.242694 15980 raft_consensus.cc:1240] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:26:01.243362 15905 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:26:01.193445 21140 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.197099 21082 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.244833 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:01.249171 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.249480 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.252470 15879 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:01.214560 21048 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:01.257555 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.254945 20251 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:01.195582 21102 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.214309 21033 consensus_queue.cc:1059] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 12:26:01.328133 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.328855 15905 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:01.285574 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.287499 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:01.245091 21065 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:01.248724 21073 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.320519 21067 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.238293 21137 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
W20260709 12:26:01.433183 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 145757us
I20260709 12:26:01.248736 21135 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.253747 20733 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:01.246287 21069 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:26:01.395963 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 110456us
I20260709 12:26:01.446468 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:01.448357 15831 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:01.449349 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.251072 20949 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.188s
I20260709 12:26:01.450732 15835 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:01.452360 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.453099 15837 raft_consensus.cc:2368] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13.
I20260709 12:26:01.453862 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.454577 15834 raft_consensus.cc:2393] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 18: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:26:01.441066 21087 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:01.455240 20535 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:01.455807 15838 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:01.456462 21069 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:01.457351 21069 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.277707 21147 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:01.455752 20535 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
W20260709 12:26:01.461397 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 77486.4us
I20260709 12:26:01.462069 20535 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.298933 20505 consensus_queue.cc:1059] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.164s
I20260709 12:26:01.298445 20967 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
I20260709 12:26:01.467110 20981 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.431082 20931 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.467767 20251 raft_consensus.cc:3055] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.467615 20981 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.437786 21067 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.468161 20251 raft_consensus.cc:740] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:01.468962 21067 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.470283 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.468997 20251 consensus_queue.cc:260] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.471241 20251 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.471335 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.476428 15832 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 16: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:26:01.471992 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.472736 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.473506 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.473619 20505 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:01.478238 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.479580 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.480293 15834 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:26:01.288816 21002 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:01.474380 20967 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.482877 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.469995 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.269387 21140 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:01.258138 21019 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.258824 20936 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:01.490274 15838 raft_consensus.cc:1240] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:01.258973 21129 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:01.479797 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.474182 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.323546 20815 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 12:26:01.315251 21082 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:01.481644 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:01.257313 21059 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:01.255088 20480 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:01.477574 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2fa3925738bd485e912c7ac0e28b0265 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:01.469998 21067 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.499814 21019 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.518532 21019 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:01.525341 15721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 47814.6us
I20260709 12:26:01.489302 20949 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:26:01.483348 20967 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.544508 15910 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:01.257140 20953 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.224s
I20260709 12:26:01.494262 15829 raft_consensus.cc:1240] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.469671 20981 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:01.498195 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.259217 21136 consensus_queue.cc:1048] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.231s
I20260709 12:26:01.550411 21080 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:01.554736 21080 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.555049 21080 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.555603 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.556298 15912 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:01.546547 20480 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.560830 20480 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.562937 20480 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:01.510615 15834 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:01.478324 20505 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.564640 20505 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.565768 20505 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:01.483085 20733 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:01.476922 21048 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.569537 21080 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.569733 20733 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.571838 16492 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:01.572471 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.573124 15834 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.552639 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.576468 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.578687 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:01.587397 15834 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:01.589552 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:01.584952 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:01.612356 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.614969 15912 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:26:01.623425 16459 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.050s
W20260709 12:26:01.624408 16459 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.013s	sys 0.050s
I20260709 12:26:01.514117 20936 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:01.534878 20967 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.630688 15904 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.633226 15912 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.636227 15912 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.500905 21129 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.642235 15913 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:01.622493 21134 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:01.622872 21076 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:26:01.645066 21166 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:26:01.643777 15831 raft_consensus.cc:2410] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:26:01.648801 15909 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:26:01.669373 15909 pending_rounds.cc:85] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 10
I20260709 12:26:01.669723 15909 pending_rounds.cc:107] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:26:01.670020 15909 raft_consensus.cc:2889] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:01.650849 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:01.651445 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:01.651770 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.661334 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:01.663050 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.514801 21082 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.624749 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:26:01.675453 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 50762.5us
I20260709 12:26:01.678031 21129 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:01.679544 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:01.680348 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.681917 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.682485 15834 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:26:01.683653 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:01.685674 15908 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:01.687304 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.688282 15985 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:01.674784 20414 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.646036 21134 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.694698 21134 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:01.694936 15904 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:01.696885 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.696719 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.697642 15908 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:26:01.665663 21080 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:01.702775 20967 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.705658 15912 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:01.675021 21087 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:01.707288 16486 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:26:01.718567 20951 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:01.719604 20951 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:01.719970 20951 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:01.720307 20951 raft_consensus.cc:3060] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.720497 21155 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:01.721885 20998 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:01.721993 21076 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.722294 20998 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.708160 21142 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.638768 21105 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:26:01.720326 21129 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:01.732724 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.732897 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.737370 15912 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.723074 21076 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:01.740389 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 277806us
I20260709 12:26:01.674178 21059 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:01.754205 15833 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:01.741523 20981 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:26:01.723320 20998 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:01.757727 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 81244.3us
I20260709 12:26:01.735646 21129 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.763238 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:01.777205 15985 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:01.782598 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.767872 15912 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:01.745292 20966 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:01.745119 21156 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:26:01.761248 20535 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:01.780561 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:01.768584 21019 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:26:01.833974 21059 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.857158 20815 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:01.857666 20815 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.858596 20815 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.786785 20998 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.850569 20953 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:01.782958 20917 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:01.835675 21129 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.786056 20936 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.850283 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.870613 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:01.871275 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:01.877955 15836 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:26:01.874850 15803 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:01.876266 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.880126 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:01.881544 16489 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:26:01.788004 20981 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:01.894721 21129 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.898389 21059 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:01.895758 16496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:26:01.816522 21132 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 12:26:01.902246 16496 raft_consensus.cc:2410] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:26:01.902557 15876 leader_election.cc:400] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13.
I20260709 12:26:01.905876 15876 leader_election.cc:403] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:01.909772 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.915812 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.917339 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.883442 20981 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.916623 20953 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.922498 21102 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:01.920502 21128 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:01.917140 21059 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:01.933676 21157 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:01.934129 21157 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:01.934754 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:01.935024 21157 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.935032 21082 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:01.938447 15907 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:01.913132 21125 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945) with higher term. Message: Invalid argument: T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13.
I20260709 12:26:01.889117 21134 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:01.941892 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:01.942884 21134 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:01.952296 16490 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:26:01.935070 15876 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:01.956010 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:01.965167 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:01.967594 20998 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:01.968124 20998 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:01.972213 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.973837 21034 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.974452 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:01.979053 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44077.7us
I20260709 12:26:01.979758 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:01.985002 15980 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
W20260709 12:26:01.985795 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.911798 20951 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:01.993732 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.997956 20333 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.999063 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:02.005553 20998 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:02.008502 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.012113 16486 raft_consensus.cc:606] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.012778 16486 raft_consensus.cc:614] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:02.011479 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:01.995539 21102 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.003834 21047 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.012148 20981 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.017015 20951 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:02.017688 20981 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:01.990268 21087 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:26:02.012089 20480 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.010967 21125 consensus_queue.cc:1059] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:26:02.022535 16493 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:26:02.028260 21090 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:02.015209 20333 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:02.030762 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.043955 15876 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.047735 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:02.049576 15876 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:02.055619 20333 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.036906 21090 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:02.049131 21047 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.051472 21128 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:02.050565 21102 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.063781 20953 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.070541 21048 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:02.057296 21059 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:02.090276 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:02.092046 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:02.104233 15986 raft_consensus.cc:2393] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:02.107077 15982 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:02.111068 15910 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:26:02.120162 15911 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:02.123693 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 67642.2us
I20260709 12:26:02.103447 21128 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:02.103015 20733 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.145124 15913 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:02.097579 21034 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:26:02.152549 21183 log.cc:927] Time spent T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:02.116178 20998 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:26:02.166971 21182 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:26:02.167557 21128 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:02.168296 21185 log.cc:927] Time spent T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:02.160701 20998 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.174134 20998 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:02.177215 15911 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 19.
I20260709 12:26:02.178541 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:02.156672 20733 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.190038 20733 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:02.190852 21157 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:02.202886 20917 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:02.203012 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 328215us
I20260709 12:26:02.205003 20931 consensus_queue.cc:1059] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:02.208994 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:02.212414 15803 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:02.216153 15834 raft_consensus.cc:2468] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:26:02.216959 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.217396 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.220009 15832 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:02.220695 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.222280 15829 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 18.
I20260709 12:26:02.223685 15833 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:02.224371 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.227630 15833 raft_consensus.cc:1275] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:02.228323 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:02.231948 16457 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:02.235066 21100 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.228876 16486 raft_consensus.cc:606] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:02.236655 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.237855 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.241312 15980 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:02.243404 16493 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:02.243741 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:02.259783 16493 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:02.244266 15834 raft_consensus.cc:3060] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:02.331781 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 92638.2us
W20260709 12:26:02.333977 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 102093us
W20260709 12:26:02.334777 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.338495 15831 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:26:02.340077 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:02.155128 21090 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.344698 15837 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:26:02.346724 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:02.331467 21194 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:26:02.354137 16458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.332921 21002 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:02.357167 15834 raft_consensus.cc:2468] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 19.
I20260709 12:26:02.359333 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.343739 21059 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.369465 15803 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:02.359954 15831 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:02.344542 21129 raft_consensus.cc:2804] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:02.372138 20251 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:02.346086 21193 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:02.378147 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:02.379818 20251 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.369302 20949 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.382652 21019 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:02.375262 20414 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:26:02.383936 21170 consensus_queue.cc:1048] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.369913 20931 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:02.412568 21193 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:02.448895 16486 raft_consensus.cc:606] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:02.416623 21129 raft_consensus.cc:697] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
W20260709 12:26:02.447628 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 90853.1us
I20260709 12:26:02.458511 20414 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.466146 15837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59154 (request call id 1170) took 1009 ms. Trace:
I20260709 12:26:02.466568 15837 rpcz_store.cc:276] 0709 12:26:01.456625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.456991 (+   366us) service_pool.cc:224] Handling call
0709 12:26:01.457307 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:02.347344 (+890037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.465914 (+118570us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540003b1d4. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:02.466088 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040219008}
I20260709 12:26:02.469592 21107 raft_consensus.cc:3055] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:02.470044 21107 raft_consensus.cc:740] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:02.470911 21107 consensus_queue.cc:260] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.471112 21129 consensus_queue.cc:237] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.476428 20815 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:02.477281 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.478883 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.423708 20931 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:02.452353 15987 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:02.443699 21059 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.449329 21193 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.487856 21156 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.490129 20998 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.490375 20931 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.507130 16494 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:02.496256 20480 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:26:02.494102 21059 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.520267 15837 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:02.523761 21179 raft_consensus.cc:993] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:02.524212 21179 raft_consensus.cc:1081] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:02.530616 21019 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.535065 21019 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.537214 21019 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:02.553741 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 183154us
I20260709 12:26:02.555781 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:02.556383 15952 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:02.557924 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 188534us
I20260709 12:26:02.560882 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:02.516782 21002 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:02.543686 21059 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:02.582814 21067 raft_consensus.cc:993] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:02.583475 21067 raft_consensus.cc:1081] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:02.586534 20535 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:02.557369 21019 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:26:02.590787 21186 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.472s	user 0.002s	sys 0.001s
I20260709 12:26:02.591059 21019 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.561136 21065 raft_consensus.cc:2804] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:02.593545 21065 raft_consensus.cc:697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:02.551362 20998 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:26:02.609160 15907 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:02.625321 15980 raft_consensus.cc:1240] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:02.597283 21065 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.600265 20917 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:26:02.664839 15904 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:02.658639 21059 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:02.655098 21047 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:02.680580 20931 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.645573 21002 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.649979 21205 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:26:02.688719 16490 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:26:02.689219 16490 pending_rounds.cc:85] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 12
I20260709 12:26:02.689510 16490 pending_rounds.cc:107] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:26:02.689797 16490 raft_consensus.cc:2889] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:02.694339 15982 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:02.686040 21059 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.695456 21082 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.707561 15830 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:02.707909 21082 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.709138 20931 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:02.711975 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:02.717128 21082 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:02.718309 16493 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:02.676189 20535 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:26:02.687455 21047 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:02.716780 15982 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:02.726315 21047 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:02.730000 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:02.730193 20333 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.730494 21059 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:02.730579 21019 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:02.730796 15982 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:02.733815 15879 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:02.737727 15904 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:02.738714 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:02.739437 15988 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:02.742054 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:02.745054 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.746124 20333 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.746321 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:02.746588 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.747342 15836 raft_consensus.cc:2393] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:26:02.767994 16493 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:26:02.775384 16486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:02.775980 16486 raft_consensus.cc:606] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.776314 16486 raft_consensus.cc:614] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:02.780942 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.761468 21157 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.757668 21047 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:02.794165 21047 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:02.794613 21047 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.781495 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.796568 15834 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:02.782202 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.782675 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:02.786118 15879 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.763475 15904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:26:02.805987 15904 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.806447 15904 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.809206 20333 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:02.813133 21019 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:02.818943 21019 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.819336 21019 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:02.822744 21107 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:02.761574 21076 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:26:02.763800 20535 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:26:02.836711 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:02.837731 15911 raft_consensus.cc:2393] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:02.838291 21087 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.840905 15802 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:02.850478 15950 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:02.807548 21157 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.871696 21157 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:02.839718 21087 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.874888 21087 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:02.883399 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:02.884023 16486 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:02.887850 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:02.889791 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:02.895577 21008 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:02.896009 21008 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.858358 15904 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.847316 20917 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:26:02.910605 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46630.6us
I20260709 12:26:02.904845 21008 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.915128 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:02.918447 15904 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:02.921362 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:02.921900 16490 raft_consensus.cc:3055] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:02.922185 16490 raft_consensus.cc:740] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:02.922983 16490 consensus_queue.cc:260] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:02.924554 16490 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.925017 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:02.925990 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:02.909976 21134 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:02.928422 15950 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:02.940418 21065 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:02.940936 15829 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 18.
I20260709 12:26:02.941318 21008 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:02.968642 16460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.972090 15950 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:02.940850 21065 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.006664 16490 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:02.928074 21135 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.032441 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.033135 15912 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:02.998746 21136 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:02.928758 21193 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.022373 21065 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.026273 21163 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.054803 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:03.058480 15829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:59154
I20260709 12:26:03.059019 15829 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.059345 15829 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.056145 15879 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:03.059911 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.112491 15909 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:03.111975 15833 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:03.098635 20333 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:03.107131 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44983.7us
I20260709 12:26:03.114099 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.046065 21136 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.121496 15913 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:03.135551 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.136873 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.137528 15913 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:03.037573 21135 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.057255 21163 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.119067 20953 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:03.140982 21047 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.147946 21135 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.148983 21047 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.149250 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:03.149526 21224 log.cc:927] Time spent T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:26:03.125986 21209 log.cc:927] Time spent T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:26:03.119794 21217 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:26:03.118820 21206 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:03.150578 21206 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.150882 21193 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.150964 21206 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.150988 20953 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:03.154001 20953 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.133473 21136 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.155910 21129 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.149917 16494 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:03.156381 21129 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.165354 21129 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
W20260709 12:26:03.175457 21222 log.cc:927] Time spent T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:26:03.231035 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.244765 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:03.251058 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:03.256729 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:03.305696 15833 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:03.329159 15986 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:26:03.339489 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.344108 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2fa3925738bd485e912c7ac0e28b0265 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:03.348042 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:03.349861 21157 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:26:03.355674 21233 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260709 12:26:03.359942 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:03.362068 21125 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:03.365355 21127 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:03.365702 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:03.366115 21127 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.366869 15835 raft_consensus.cc:2393] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:26:03.364817 21002 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:03.369585 21002 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.371923 21002 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.368875 21127 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.265475 21008 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:03.381592 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:03.382742 15835 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:03.390595 15982 raft_consensus.cc:1275] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:03.390838 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.391261 21205 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:03.393735 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:03.394594 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:03.400421 20998 consensus_queue.cc:1048] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:03.411562 21157 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:03.426684 21157 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:03.427425 21157 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.430753 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.438941 15907 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:26:03.442906 15950 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:03.443113 20949 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:03.443830 20949 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.446187 21101 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:03.446719 21101 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.447121 21101 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.433816 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.449937 15833 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:26:03.452144 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:03.454681 21163 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.459586 21090 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.466179 15913 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:26:03.468602 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:03.469403 16488 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:03.470914 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:03.471822 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:26:03.460390 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45842.6us
I20260709 12:26:03.472664 15909 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:03.474227 20949 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:03.476913 20815 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.477625 20815 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:03.478307 15910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.009s
I20260709 12:26:03.464644 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:03.480412 15904 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:03.482336 21227 log.cc:927] Time spent T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:26:03.476215 21206 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.487123 20815 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:03.489679 15910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.005s	sys 0.009s
I20260709 12:26:03.491258 21136 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.363128 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:03.501243 21019 consensus_meta.cc:287] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.019s
I20260709 12:26:03.501919 21019 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.512408 21136 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.513746 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:03.514688 15982 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 9.
I20260709 12:26:03.511260 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.515115 21019 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:03.530704 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.518381 21157 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.494017 15829 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.531718 15913 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:03.532101 15834 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:03.534013 15829 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.521513 15904 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:03.522064 21201 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.534916 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:03.535600 16494 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.535553 21201 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.455899 21178 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:03.539170 16492 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:26:03.522848 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:03.539564 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:03.540014 15988 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.540124 15987 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:03.540386 16486 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:03.541314 21201 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.541715 21178 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.542140 21178 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.542343 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:03.543246 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.526381 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.544761 15911 raft_consensus.cc:2393] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:03.527717 15912 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.529703 21103 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:03.546233 16459 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:03.546541 21103 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.548344 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:26:03.548954 21243 log.cc:927] Time spent T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:26:03.549096 15837 raft_consensus.cc:3060] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.555821 21157 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:03.557229 21157 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:03.557677 21157 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:03.492058 21101 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.582376 16494 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 19.
I20260709 12:26:03.581423 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.590340 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:03.591001 15834 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.593310 15953 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:03.608012 15837 raft_consensus.cc:2468] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 19.
I20260709 12:26:03.610268 15912 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:03.625686 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:03.625530 15835 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:03.606189 20949 raft_consensus.cc:2804] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:03.628780 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:03.632946 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.638023 16486 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.648373 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:03.648918 15879 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:03.651007 21102 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:03.651697 21102 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:03.653775 20815 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.654294 20815 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.654707 20815 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.654982 21178 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.658792 16486 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:03.659799 20949 raft_consensus.cc:697] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:03.628432 21101 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.661067 20949 consensus_queue.cc:237] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:03.662294 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 94790.4us
I20260709 12:26:03.663414 20414 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.632378 21157 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.663914 20414 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.664595 21157 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.665184 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:03.666920 20414 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:03.668247 20931 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.670629 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:03.677834 15988 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:26:03.685717 15834 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:03.710698 21127 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:03.711730 21127 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.714895 21127 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.668978 20931 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.678500 21206 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:03.686354 21008 raft_consensus.cc:2764] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:03.756984 21127 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:26:03.795550 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 94684us
W20260709 12:26:03.798883 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 54256.6us
I20260709 12:26:03.803653 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:03.652981 21102 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.797443 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:03.796947 21129 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:03.832645 21178 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:26:03.833427 20414 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:03.834182 20414 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:26:03.835112 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 146190us
I20260709 12:26:03.836058 15803 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:03.837199 21002 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:03.837600 21019 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:03.838384 20936 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:03.838722 21065 consensus_meta.cc:287] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Time spent flushing consensus metadata: real 0.777s	user 0.004s	sys 0.015s
I20260709 12:26:03.839496 21019 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:03.839280 21065 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.839851 21019 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:03.837615 21002 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:03.842366 21002 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.845460 21206 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.845997 20931 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.845960 21206 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.844513 20815 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:03.838788 20936 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:03.869158 20936 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:03.881943 21140 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:03.886744 20815 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.888942 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.908947 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:03.914742 21206 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.915493 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:03.916334 16489 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.897119 21127 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.920949 21127 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:03.926939 16489 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:03.933414 16486 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:26:03.935460 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.942240 15913 raft_consensus.cc:2393] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:03.936486 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.937315 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:03.939193 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:03.929320 21065 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:03.949187 16459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.951347 15907 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.951496 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:03.952262 16492 raft_consensus.cc:2368] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:26:03.953331 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:03.953955 15909 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.959841 15908 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:03.900034 21019 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.967173 15907 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:03.967257 15952 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:03.961283 21019 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.974411 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:03.975049 15834 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.972317 21107 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:03.981078 21137 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:03.981791 21107 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.987293 21237 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:03.987864 21237 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:03.988940 21237 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:03.990756 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:03.991219 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:03.992116 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:03.992389 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:03.992694 15831 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:03.993135 21065 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:03.993592 21065 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:03.991314 15905 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.992116 20414 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:04.012339 20414 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.012866 20414 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.001698 21205 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.020628 15834 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:04.027182 15803 leader_election.cc:400] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:26:04.027526 15803 leader_election.cc:403] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:04.030455 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:04.053386 21205 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.055546 21205 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:04.057653 21002 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.059957 21002 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:04.062749 15909 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:04.067013 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:04.076560 15907 raft_consensus.cc:2393] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:04.074853 15905 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:04.079038 21214 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:26:04.098592 21103 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:04.113741 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.114837 15983 raft_consensus.cc:2393] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 9: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:04.103729 21065 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.119045 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.119823 15987 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:26:04.120838 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.126302 21214 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10.
I20260709 12:26:04.109086 15952 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:04.152109 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:04.155016 15952 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:04.160732 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:04.163751 21204 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:04.164287 21204 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.164683 21204 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:04.167224 21170 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:04.167717 21170 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:04.168665 21170 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.151515 21127 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:04.157958 21253 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:04.156159 21103 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.190336 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:04.208107 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:04.209646 20414 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.211076 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:04.195909 21127 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.225178 21127 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:04.214751 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.229969 21107 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:04.234529 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:04.192111 20936 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.245291 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:04.245446 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.193919 21253 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:04.251585 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:04.252267 16489 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:04.256036 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:04.211650 20414 leader_election.cc:290] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:04.212313 21102 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:04.256356 15980 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:04.262277 15830 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.262617 15802 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:04.194060 21103 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.304349 15835 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:26:04.306782 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:04.309417 20251 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:04.306953 16457 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:04.311363 20936 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:04.311556 15904 raft_consensus.cc:2393] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:04.323266 16489 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:26:04.324913 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:04.325644 16495 raft_consensus.cc:2368] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 16. Current term is 17.
I20260709 12:26:04.327996 15803 leader_election.cc:400] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 16. Current term is 17.
I20260709 12:26:04.328294 15803 leader_election.cc:403] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:26:04.326203 21204 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.331840 20998 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:04.338187 16494 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:04.332875 21204 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:04.341383 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 57081.6us
I20260709 12:26:04.337563 16488 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
W20260709 12:26:04.347735 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 78747.3us
I20260709 12:26:04.350255 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:04.356468 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:04.354429 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.364748 15983 raft_consensus.cc:2368] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14.
I20260709 12:26:04.332358 21253 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.342854 20815 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:04.369222 15879 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:04.370497 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:04.371012 15985 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:04.376852 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:04.377151 21048 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:04.377625 15910 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.377676 21048 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.380196 21048 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:04.363622 21214 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:04.368031 20998 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:04.391919 15879 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:04.393465 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.395797 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:04.398774 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:04.399462 15905 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.367218 21102 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:04.372319 21107 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:26:04.406271 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 133443us
I20260709 12:26:04.395486 21059 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:04.417482 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:04.402247 21214 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:04.419793 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:04.427825 21261 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:04.425220 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:04.436590 21103 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:04.431896 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.446908 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:04.450337 15830 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:04.416414 21107 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:04.465484 21214 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.465744 21107 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.451630 21127 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) with higher term. Message: Invalid argument: T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 16. Current term is 17.
W20260709 12:26:04.455993 21256 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:26:04.469267 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:04.456398 21059 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:04.458263 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:04.460372 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:04.472025 16494 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:26:04.461108 21102 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.462483 20998 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.462937 15905 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:04.469632 15803 leader_election.cc:400] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14.
I20260709 12:26:04.469841 15986 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:04.478916 15803 leader_election.cc:403] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:04.479450 15985 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:26:04.480754 21204 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.488737 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:04.495880 15980 raft_consensus.cc:1275] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:04.496543 20414 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.497473 20414 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.494587 21205 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:04.529537 15910 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:04.538305 15835 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:26:04.555930 21204 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14.
I20260709 12:26:04.558444 15727 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:04.560878 15986 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:26:04.566093 15982 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:04.567293 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 77252.9us
I20260709 12:26:04.567251 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:26:04.584798 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 48412.3us
I20260709 12:26:04.615406 15835 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.622200 15834 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:04.561025 15727 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 10, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 10 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.646931 21273 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:04.647763 21273 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:04.657673 15952 leader_election.cc:304] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:04.663509 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:04.665089 21105 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:04.668063 21059 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:04.670166 21203 consensus_queue.cc:1048] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:04.672253 15803 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:04.694582 16459 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:04.711889 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:04.668821 21059 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.708529 20414 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:04.693387 21091 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:04.692054 21205 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:04.732959 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:04.719762 15834 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:04.713469 20815 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:04.707108 21065 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 12:26:04.740819 21091 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:04.740561 21205 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:04.766984 21091 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.767968 21059 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:04.770931 21205 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.777254 16489 raft_consensus.cc:1275] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:04.779994 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:04.748916 20815 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:04.787961 20815 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:04.790727 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95077us
I20260709 12:26:04.805454 15953 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:26:04.808372 15733 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 278) took 64122 ms (client timeout 15000 ms). Trace:
I20260709 12:26:04.810498 15727 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 14, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 14 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.806730 21253 consensus_queue.cc:1048] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:26:04.818668 21087 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:04.760154 21273 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:04.819398 15727 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 11 to 13, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:04.850797 15802 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:04.853699 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 95208us
I20260709 12:26:04.864603 15727 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.867311 15727 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 11, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 11 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:04.808866 15733 rpcz_store.cc:269] 0709 12:25:00.685931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.686296 (+   365us) service_pool.cc:224] Handling call
0709 12:26:04.808118 (+64121822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:59.438147 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:59.651690 (+213543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:59.655378 (+  3688us) write_op.cc:435] Acquired schema lock
0709 12:25:59.660642 (+  5264us) tablet.cc:662] Decoding operations
0709 12:25:59.668677 (+  8035us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:59.668763 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:59.668794 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:59.669163 (+   369us) tablet.cc:701] Row locks acquired
0709 12:25:59.669186 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:25:59.669338 (+   152us) write_op.cc:270] Start()
0709 12:25:59.669470 (+   132us) write_op.cc:276] Timestamp: P: 1783599959669293 usec, L: 0
0709 12:25:59.669494 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:25:59.673107 (+  3613us) log.cc:844] Serialized 923 byte log entry
0709 12:26:01.085702 (+1412595us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:26:01.768391 (+682689us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.926999 (+158608us) write_op.cc:301] APPLY: starting
0709 12:26:01.927087 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:01.928718 (+  1631us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:01.928743 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.946439 (+ 17696us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.946651 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:26:01.946707 (+    56us) write_op.cc:312] APPLY: finished
0709 12:26:01.946899 (+   192us) log.cc:844] Serialized 33 byte log entry
0709 12:26:01.964101 (+ 17202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.976784 (+ 12683us) write_op.cc:454] Released schema lock
0709 12:26:01.986006 (+  9222us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.996135 (+ 10129us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.996169 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":153171,"apply.run_cpu_time_us":4634,"apply.run_wall_time_us":69107,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12459,"num_ops":2,"prepare.queue_time_us":666494,"prepare.run_cpu_time_us":26856,"prepare.run_wall_time_us":595468,"raft.queue_time_us":641474,"raft.run_cpu_time_us":9339,"raft.run_wall_time_us":183451,"replication_time_us":2076019,"spinlock_wait_cycles":118301440,"thread_start_us":1379244,"threads_started":4,"wal-append.queue_time_us":421176,"wal-append.run_cpu_time_us":65177,"wal-append.run_wall_time_us":2850535}]]}
I20260709 12:26:04.853195 20931 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:04.889086 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:04.892729 15727 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:04.896145 15727 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:04.918008 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:26:04.919827 21282 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
W20260709 12:26:04.922712 21280 log.cc:927] Time spent T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:26:04.924276 21294 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:26:04.926434 21283 log.cc:927] Time spent T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:26:04.899767 15727 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 11, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 11 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.933514 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:04.945341 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:04.959414 16493 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:04.955571 21291 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:04.963970 15879 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:04.955614 15727 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:04.969753 21137 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:04.969547 15727 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 12, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.971729 15727 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 9, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:05.137822 20936 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:05.138556 20936 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:04.988520 21261 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:04.960994 21291 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.146046 20931 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:05.149132 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:05.149433 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:05.149854 15912 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:05.155170 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:05.146586 20931 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:05.200810 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 52728.2us
I20260709 12:26:05.225684 15910 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:05.157481 21296 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:26:05.226269 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:05.140897 20936 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:05.242524 15982 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:26:05.146616 21291 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:05.247447 15912 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:26:05.240340 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 164270us
I20260709 12:26:05.249655 15879 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:05.261879 21132 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:05.156858 21203 consensus_queue.cc:1059] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:26:05.270512 21203 raft_consensus.cc:3055] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:05.270881 21203 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:05.271710 21203 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:05.243095 15727 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 8, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 8 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.282383 15727 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.284010 15727 catalog_manager.cc:5697] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 11, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 11 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:05.272838 21203 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:05.288506 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:05.295634 21281 log.cc:927] Time spent T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.529s	user 0.002s	sys 0.000s
I20260709 12:26:05.299674 20931 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:05.301904 21048 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:05.313053 15727 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 11 to 12, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.318934 15910 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:05.320741 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:05.321384 21205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.004s
W20260709 12:26:05.321879 21205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.008s	sys 0.004s
I20260709 12:26:05.322751 15836 raft_consensus.cc:1240] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:05.324222 21103 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:05.324752 21103 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.325232 21103 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:05.332389 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 43993.1us
W20260709 12:26:05.335031 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 178772us
I20260709 12:26:05.339239 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:05.345389 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:05.345079 15727 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:05.350293 21293 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.487s	user 0.008s	sys 0.000s
I20260709 12:26:05.349601 15727 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 4 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 15 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:05.357429 15830 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:05.357669 15829 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:05.347450 21059 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:05.371881 21237 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:05.378743 21279 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.379312 21279 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.379683 21103 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.351804 15727 catalog_manager.cc:5697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.385962 15727 catalog_manager.cc:5697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 13, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.387189 21103 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:05.387604 15832 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:26:05.387995 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.397461 21289 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:05.400020 15727 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:05.405012 21279 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:05.406435 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:05.401823 15727 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 10, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 10 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:05.407065 16493 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:05.410403 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:05.410130 15727 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:05.411235 20949 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:05.411600 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:05.412184 16493 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.411760 20949 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.414501 21082 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:05.414849 21082 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.415225 21082 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.420495 16493 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:05.424520 21170 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:05.427287 16486 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:05.435768 15910 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:26:05.437044 15910 pending_rounds.cc:85] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 8
I20260709 12:26:05.445958 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:05.437366 15910 pending_rounds.cc:107] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:26:05.447687 15910 raft_consensus.cc:2889] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:05.448985 15879 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:05.449023 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:05.455890 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:05.470026 16486 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:05.479915 21303 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:05.480430 21303 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:05.481186 21277 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:26:05.481693 15985 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:05.481395 15727 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 15, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.483826 15727 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 14 to 17, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 17 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.460673 21272 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:05.488710 21286 log.cc:927] Time spent T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.725s	user 0.007s	sys 0.046s
I20260709 12:26:05.489786 21103 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:05.490410 21261 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.492439 21034 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.553323 15721 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2fa3925738bd485e912c7ac0e28b0265 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:05.553642 21034 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.553956 21261 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:05.555941 21034 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:05.494638 20949 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:05.480808 21303 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:05.501858 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:05.544106 21103 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:05.545642 15727 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:05.546765 20917 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:05.549449 16494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 908) took 1064 ms. Trace:
I20260709 12:26:05.552287 21140 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:05.556126 21261 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:05.603420 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:05.604663 15830 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:26:05.609309 15986 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:05.611079 16494 rpcz_store.cc:276] 0709 12:26:04.485575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.485761 (+   186us) service_pool.cc:224] Handling call
0709 12:26:04.486112 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.486571 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:04.486612 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:04.487173 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:26:04.757560 (+270387us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:04.757600 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.757663 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:05.488107 (+730444us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:26:05.549152 (+ 61045us) raft_consensus.cc:1685] finished
0709 12:26:05.549173 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:05.549375 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":210930560,"thread_start_us":261655,"threads_started":1,"wal-append.queue_time_us":276025}
I20260709 12:26:05.626168 21214 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:26:05.663090 21291 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:26:05.711755 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 262852us
I20260709 12:26:05.742916 15910 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:26:05.751514 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 141486us
I20260709 12:26:05.750590 15906 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:05.662778 21019 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:26:05.758219 15910 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:05.762383 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:05.723090 21291 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:05.828986 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:05.830935 21315 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.831702 21315 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:05.834720 21310 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:26:05.835875 21316 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.836402 21316 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.837672 16494 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:05.761528 21103 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.849068 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:05.755055 15727 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 5 to 8, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 8 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:05.875136 15727 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:26:05.877470 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.760881 21102 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:26:05.881541 21082 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.879789 21132 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.900084 21132 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:05.903630 15982 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:05.903944 15904 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:26:05.907732 21132 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:05.907943 21315 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:05.876602 15727 catalog_manager.cc:5697] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 11, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 11 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:05.925940 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:05.927857 15727 catalog_manager.cc:5697] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:05.945086 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 192916us
I20260709 12:26:05.952242 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:05.952935 15907 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:26:05.932884 21316 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:05.971592 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:05.967036 16493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:05.973302 21201 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:05.971524 21008 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:26:05.989606 16493 raft_consensus.cc:606] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:06.005690 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46594.6us
I20260709 12:26:05.988984 15953 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:05.971812 21302 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.026861 16494 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:06.008344 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:05.969660 21019 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:26:06.043253 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68543.3us
I20260709 12:26:05.979473 21279 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 12:26:06.044798 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 98680.1us
I20260709 12:26:06.054718 21291 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:06.067108 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 78231.7us
I20260709 12:26:06.075201 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:06.060819 21157 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:06.065975 21137 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:06.070921 21315 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:06.080456 21291 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:06.080638 21082 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.081912 21157 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.094789 21237 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:06.096341 21318 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.226s	user 0.003s	sys 0.000s
I20260709 12:26:06.097090 16492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:06.097728 16492 raft_consensus.cc:606] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:06.098048 16492 raft_consensus.cc:614] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:06.039141 21302 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.101227 15906 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:06.103760 21315 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:06.107949 21303 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:06.122404 21326 log.cc:927] Time spent T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:26:06.113763 21157 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.130278 21302 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.130520 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1796) took 1597 ms. Trace:
I20260709 12:26:06.130849 15911 rpcz_store.cc:276] 0709 12:26:04.532783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.532914 (+   131us) service_pool.cc:224] Handling call
0709 12:26:04.541558 (+  8644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:04.821241 (+279683us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:26:04.873752 (+ 52511us) log.cc:844] Serialized 14 byte log entry
0709 12:26:04.874644 (+   892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:04.874707 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:04.874764 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.128834 (+1254070us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b18002506c0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91842a6 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419
0709 12:26:06.130288 (+  1454us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400299d54. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a3e01 00007f03cc2a283e 00007f03d1267419 00007f03ca7debd4 00007f03ca7deb62 00007f03ca7dea91 00007f03ca7dea0c 00007f03ca7ddcc2 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:06.130338 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:06.130447 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52455,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":94,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3644,"spinlock_wait_cycles":656939520,"thread_start_us":52103,"threads_started":1}
I20260709 12:26:06.131896 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:06.132507 16492 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:06.134555 16489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661598743dad4055844a0b0f97c07156"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:06.135152 16489 raft_consensus.cc:606] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:06.138195 16489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:06.140365 15802 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.122324 21315 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.143913 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.144126 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.144390 21305 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:06.145596 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.138734 16489 raft_consensus.cc:606] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.146834 16489 raft_consensus.cc:614] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:06.147867 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.149915 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.150039 16489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:60434
I20260709 12:26:06.146200 15835 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:06.158056 21268 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:06.158608 21268 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.163681 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:06.195685 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 119651us
I20260709 12:26:06.198534 15908 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:06.199155 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:06.199843 15913 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:06.194936 21272 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.189945 21268 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.198655 21059 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:06.236949 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:06.271153 21157 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.280431 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:06.292272 21319 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:06.294073 21287 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:06.294673 21287 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.296726 21287 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.297212 21304 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:06.297771 21102 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:06.309690 21281 log.cc:927] Time spent T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:26:06.316941 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.318470 16486 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:06.327606 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:06.235889 21272 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:06.336699 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 56040.6us
I20260709 12:26:06.337795 15952 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:06.339968 21091 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:06.319499 21102 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.277416 21059 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:06.395813 16489 raft_consensus.cc:606] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:06.406352 16489 raft_consensus.cc:614] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:06.393105 21310 log.cc:927] Time spent T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:06.433897 15835 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:26:06.434319 15835 pending_rounds.cc:85] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 9
I20260709 12:26:06.434592 15835 pending_rounds.cc:107] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:26:06.434837 15835 raft_consensus.cc:2889] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:06.292855 21319 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:06.410969 21323 log.cc:927] Time spent T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:26:06.405609 21102 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.443632 21273 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:26:06.352913 21304 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.458240 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.462306 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.462980 15986 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:06.478127 21059 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.480196 21157 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:06.485191 21319 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.488615 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.489732 21312 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:06.490384 21312 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:06.518471 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.526558 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.532068 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:06.532836 21206 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.532930 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:06.533342 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.533712 21206 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:06.534842 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.543367 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:06.534060 21206 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:06.544219 21206 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.547302 15837 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:06.552279 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:06.554039 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.557407 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:06.562017 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.574213 21312 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.575753 21178 raft_consensus.cc:993] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:06.576251 21178 raft_consensus.cc:1081] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:06.564368 16457 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:06.578570 21320 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:06.588095 16494 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:06.589869 21289 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:06.581851 21059 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:06.617537 20998 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:06.617823 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.618965 21059 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:06.623440 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.625767 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.602564 21312 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:26:06.585719 21102 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:06.632002 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.633378 21102 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.634518 21303 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.599121 21206 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.634845 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.653903 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.655778 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.639652 21206 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.659840 21261 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:06.664342 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:06.669235 16495 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:06.669889 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.671120 21320 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:06.671160 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:06.668205 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:06.672808 15987 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.647225 21178 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.672992 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.658870 21302 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.686939 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:06.672431 21272 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.680330 21287 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:06.680612 15834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "661598743dad4055844a0b0f97c07156"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:59154
I20260709 12:26:06.688706 15834 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.688512 21287 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:06.689157 15834 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.690667 21287 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:06.706416 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:06.708114 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:06.710103 15987 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:06.711139 15984 raft_consensus.cc:1240] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:26:06.711529 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:06.716557 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:06.692992 21048 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:06.716965 21312 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:06.750982 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:06.752988 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.753793 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.730592 21034 consensus_queue.cc:1059] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:26:06.741628 15834 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.798941 15834 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.786687 21312 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:26:06.807611 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 87113.1us
I20260709 12:26:06.809712 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.814635 21287 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:06.818457 21312 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:06.834559 21178 raft_consensus.cc:993] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:06.835045 21178 raft_consensus.cc:1081] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:06.837067 15831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:59154
I20260709 12:26:06.845188 15831 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.845680 15831 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:06.837064 21315 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:06.850641 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:06.856809 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:06.863036 21304 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.850472 21287 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:26:06.871287 21287 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:06.871696 21287 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:06.878374 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:06.879583 15836 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.847575 21315 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:06.885754 21315 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.887104 21315 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:06.893002 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:06.872474 21287 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.908694 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:06.905478 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:06.919441 15980 raft_consensus.cc:2368] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
I20260709 12:26:06.899005 15831 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.927388 21272 raft_consensus.cc:2749] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.933101 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.934439 15876 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:06.936519 21102 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:06.937135 21319 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:06.938023 21319 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.941447 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:06.942286 16486 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:06.942691 16486 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:06.943754 16486 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:06.951574 15803 leader_election.cc:400] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
I20260709 12:26:06.954799 15803 leader_election.cc:403] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:26:06.952194 15802 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:06.937225 21102 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:06.958480 15831 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:06.959203 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:26:06.945544 20936 consensus_queue.cc:1175] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "761f08e40cdf4af396105d67949c0afc" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 10 } }
I20260709 12:26:06.962225 16486 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.967585 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:06.969173 15909 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.956447 21287 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.965557 21304 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.986563 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:06.989699 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:06.990304 15910 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:06.994720 15836 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:06.995491 21304 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 11. Current term is 12.
I20260709 12:26:07.000399 15910 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 18.
I20260709 12:26:06.993623 21369 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:07.007457 16486 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:07.008491 21319 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:07.018990 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:07.019560 16492 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:07.019831 16492 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:07.020921 15909 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:07.022264 15910 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:07.023595 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:07.022179 16492 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:07.024824 16492 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.028391 15802 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:07.036156 16459 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:07.037068 21289 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:07.047607 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:07.054284 20936 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:07.054838 15803 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:07.074676 21370 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:26:07.128089 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 73333.3us
I20260709 12:26:07.130108 16492 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 18.
W20260709 12:26:07.141100 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 112784us
I20260709 12:26:07.097328 20936 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:07.159155 20936 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:07.097993 21370 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:07.166828 21370 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:07.209812 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 54272.3us
I20260709 12:26:07.395027 15831 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:07.397065 21102 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:07.398319 15732 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.400125 15732 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 8 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 9 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.404934 15980 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:07.435637 21102 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:07.437674 15732 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.440054 15732 catalog_manager.cc:5697] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 7 to 8, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 8 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:07.449363 15727 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 282) took 12007 ms (client timeout 15000 ms). Trace:
W20260709 12:26:07.454483 15727 rpcz_store.cc:269] 0709 12:25:55.441863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.474026 (+ 32163us) service_pool.cc:224] Handling call
0709 12:26:07.449273 (+11975247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:06.527865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:06.528537 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:06.528595 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:26:06.528615 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:06.603256 (+ 74641us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:06.603349 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:06.603376 (+    27us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:26:06.629680 (+ 26304us) tablet.cc:701] Row locks acquired
0709 12:26:06.629731 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:26:06.629899 (+   168us) write_op.cc:270] Start()
0709 12:26:06.630066 (+   167us) write_op.cc:276] Timestamp: P: 1783599966629830 usec, L: 0
0709 12:26:06.630104 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:26:06.630884 (+   780us) log.cc:844] Serialized 11691 byte log entry
0709 12:26:06.960383 (+329499us) op_driver.cc:464] REPLICATION: finished
0709 12:26:07.023996 (+ 63613us) write_op.cc:301] APPLY: starting
0709 12:26:07.024492 (+   496us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:07.190248 (+165756us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:07.190355 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:07.279612 (+ 89257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:07.280057 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=0,mrs_lookups=0
0709 12:26:07.280116 (+    59us) write_op.cc:312] APPLY: finished
0709 12:26:07.280644 (+   528us) log.cc:844] Serialized 260 byte log entry
0709 12:26:07.280834 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:07.281112 (+   278us) write_op.cc:454] Released schema lock
0709 12:26:07.281209 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:07.281612 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:07.281640 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":877668,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":63329,"apply.run_cpu_time_us":39049,"apply.run_wall_time_us":257615,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129107,"num_ops":30,"prepare.queue_time_us":247734,"prepare.run_cpu_time_us":44069,"prepare.run_wall_time_us":192820,"raft.queue_time_us":123683,"raft.run_cpu_time_us":16806,"raft.run_wall_time_us":54434,"replication_time_us":330131,"thread_start_us":413064,"threads_started":4,"wal-append.queue_time_us":182236}]]}
I20260709 12:26:07.450942 15732 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 5 to 6, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 6 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.477450 15732 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.491189 15732 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 8 to 9, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 9 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.506062 15732 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 2 to 9, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 9 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.514459 15732 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.590404 15906 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:07.592155 21291 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:07.617111 16486 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:07.618830 20535 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:26:07.634801 16489 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:07.636894 21291 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:07.675489 15906 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:07.679937 21291 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:07.686474 15727 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 12 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.692051 15727 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 15, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.702692 15727 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 13, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.705420 15727 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 14, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 14 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.706959 15727 catalog_manager.cc:5697] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 13, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.708506 15727 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.709939 15727 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 18, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 18 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.711277 15727 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.715360 15727 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 11 to 12, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 12 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.716768 15727 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.718499 15727 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 10, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 10 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.720412 15727 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.722124 15727 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.723506 15727 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.724762 15727 catalog_manager.cc:5697] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 9, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 9 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.726158 15727 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 12 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.727577 15727 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 12 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.728897 15727 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.730391 15727 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 15 to 17, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 17 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.732585 15727 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.734159 15727 catalog_manager.cc:5697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.735602 15727 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.737175 15727 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.739696 15727 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 13 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.741115 15727 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 12, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.742753 15727 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.744051 15727 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 16, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 16 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.745867 15727 catalog_manager.cc:5697] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 15 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 16 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.747376 15727 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 11, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 11 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.748648 15727 catalog_manager.cc:5697] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 17 to 19, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 19 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.750075 15727 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.756440 15727 catalog_manager.cc:5697] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 13 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:07.757979 15727 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
W20260709 12:26:07.761744 15732 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 277) took 43881 ms (client timeout 15000 ms). Trace:
I20260709 12:26:07.762215 15727 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 7 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 14 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.763890 15727 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:07.765820 15727 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:07.762164 15732 rpcz_store.cc:269] 0709 12:25:23.920457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.957105 (+ 36648us) service_pool.cc:224] Handling call
0709 12:26:07.761674 (+43804569us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:07.546943 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:07.547606 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:07.547645 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:26:07.547663 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:07.566148 (+ 18485us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:07.566233 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:07.566262 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:26:07.567038 (+   776us) tablet.cc:701] Row locks acquired
0709 12:26:07.567056 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:07.567211 (+   155us) write_op.cc:270] Start()
0709 12:26:07.567334 (+   123us) write_op.cc:276] Timestamp: P: 1783599967567162 usec, L: 0
0709 12:26:07.567353 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:26:07.568054 (+   701us) log.cc:844] Serialized 3661 byte log entry
0709 12:26:07.578230 (+ 10176us) op_driver.cc:464] REPLICATION: finished
0709 12:26:07.584318 (+  6088us) write_op.cc:301] APPLY: starting
0709 12:26:07.584412 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:07.589108 (+  4696us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:07.589190 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:07.615307 (+ 26117us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:07.615532 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:26:07.615580 (+    48us) write_op.cc:312] APPLY: finished
0709 12:26:07.615862 (+   282us) log.cc:844] Serialized 89 byte log entry
0709 12:26:07.621071 (+  5209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:07.621220 (+   149us) write_op.cc:454] Released schema lock
0709 12:26:07.621278 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:07.621701 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:07.621744 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":463554,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":5843,"apply.run_cpu_time_us":11856,"apply.run_wall_time_us":37335,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37494,"num_ops":9,"prepare.queue_time_us":8340,"prepare.run_cpu_time_us":4132,"prepare.run_wall_time_us":26271,"replication_time_us":10731,"thread_start_us":10627,"threads_started":1}]]}
I20260709 12:26:08.016104 21102 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.016654 21102 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.019134 21102 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:08.021481 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:08.021679 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:08.022214 15980 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:08.023590 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:08.024784 21059 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:08.025254 21059 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.025645 21059 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:08.044343 21059 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.046407 21059 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:08.048020 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:08.050488 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:08.051088 15982 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:08.077775 15982 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:08.079110 15879 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:08.081959 21315 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:08.083853 21315 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:08.084817 21315 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.094398 21398 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:08.095096 21398 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.099225 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:08.106222 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:08.107242 15982 raft_consensus.cc:2368] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15.
I20260709 12:26:08.108772 16460 leader_election.cc:400] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15.
I20260709 12:26:08.109225 16460 leader_election.cc:403] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:08.111572 21320 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:26:08.106274 21398 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:08.147114 21320 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871) with higher term. Message: Invalid argument: T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15.
I20260709 12:26:08.152915 15734 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 6 to 7, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 7 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.165592 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.215564 15906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:08.216207 15906 raft_consensus.cc:606] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Received request to transfer leadership
I20260709 12:26:08.222596 15911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:08.223233 15911 raft_consensus.cc:606] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Received request to transfer leadership
W20260709 12:26:08.225066 15720 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 3a4fafd7ec404ad9b05209ed0c8c1a19 already in progress [suppressed 14 similar messages]
I20260709 12:26:08.242857 15906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:08.243417 15906 raft_consensus.cc:606] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Received request to transfer leadership
W20260709 12:26:08.273157 15734 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 279) took 35844 ms (client timeout 15000 ms). Trace:
I20260709 12:26:08.273885 15729 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.284523 15729 catalog_manager.cc:5697] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:08.286752 15734 rpcz_store.cc:269] 0709 12:25:32.428642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.431796 (+  3154us) service_pool.cc:224] Handling call
0709 12:26:08.273073 (+35841277us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.181360 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.181859 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.181896 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:08.181912 (+    16us) tablet.cc:662] Decoding operations
0709 12:26:08.182290 (+   378us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.182348 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.182381 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:08.182587 (+   206us) tablet.cc:701] Row locks acquired
0709 12:26:08.182621 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:26:08.182790 (+   169us) write_op.cc:270] Start()
0709 12:26:08.182912 (+   122us) write_op.cc:276] Timestamp: P: 1783599968182724 usec, L: 0
0709 12:26:08.182934 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.183838 (+   904us) log.cc:844] Serialized 533 byte log entry
0709 12:26:08.186280 (+  2442us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.190367 (+  4087us) write_op.cc:301] APPLY: starting
0709 12:26:08.190442 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.191189 (+   747us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.191279 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.191946 (+   667us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.192130 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.192172 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:08.192350 (+   178us) log.cc:844] Serialized 25 byte log entry
0709 12:26:08.192508 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.192580 (+    72us) write_op.cc:454] Released schema lock
0709 12:26:08.192615 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.192998 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.193022 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49539,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":3745,"apply.run_cpu_time_us":2586,"apply.run_wall_time_us":2587,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4166,"num_ops":1,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":2722,"prepare.run_wall_time_us":3249,"replication_time_us":3189}]]}
I20260709 12:26:08.289589 15729 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 9 to 12, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 12 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.313591 15729 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 7 to 9, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.316488 21315 raft_consensus.cc:993] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:08.317607 21315 raft_consensus.cc:1081] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:08.319404 16486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:42798
I20260709 12:26:08.319970 16486 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.320372 16486 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:08.337646 16486 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.340947 16486 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:08.341313 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:08.342000 15831 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:08.342998 15729 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 12 to 14, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.346129 15729 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.349460 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:08.350102 15906 raft_consensus.cc:3055] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:08.350412 15906 raft_consensus.cc:740] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:08.351204 15906 consensus_queue.cc:260] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.352803 15906 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:08.354526 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:08.355100 15982 raft_consensus.cc:3060] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:08.363229 15906 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:08.364881 15831 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:08.366094 16457 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:08.370255 15982 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:08.368388 21402 raft_consensus.cc:2804] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:08.371047 21402 raft_consensus.cc:697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:08.372224 21402 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:08.424362 15783 auto_rebalancer.cc:893] Removing replace marker failed: Replica 761f08e40cdf4af396105d67949c0afc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:08.424856 15783 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 3a4fafd7ec404ad9b05209ed0c8c1a19 already in progress
W20260709 12:26:08.425213 15783 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3a4fafd7ec404ad9b05209ed0c8c1a19 already in progress
I20260709 12:26:08.459949 15728 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:08.471359 15729 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 278) took 20993 ms (client timeout 15000 ms). Trace:
I20260709 12:26:08.471112 15728 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:08.471858 15729 rpcz_store.cc:269] 0709 12:25:47.519507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.537710 (+ 18203us) service_pool.cc:224] Handling call
0709 12:26:08.471282 (+20933572us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.350678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.351232 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.351281 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:26:08.351298 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:08.352113 (+   815us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.352173 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.352208 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:26:08.352798 (+   590us) tablet.cc:701] Row locks acquired
0709 12:26:08.352818 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:08.352972 (+   154us) write_op.cc:270] Start()
0709 12:26:08.353113 (+   141us) write_op.cc:276] Timestamp: P: 1783599968352919 usec, L: 0
0709 12:26:08.353136 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.355605 (+  2469us) log.cc:844] Serialized 2434 byte log entry
0709 12:26:08.357432 (+  1827us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.357873 (+   441us) write_op.cc:301] APPLY: starting
0709 12:26:08.357950 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.361020 (+  3070us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.361129 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.370378 (+  9249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.370571 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.370615 (+    44us) write_op.cc:312] APPLY: finished
0709 12:26:08.371040 (+   425us) log.cc:844] Serialized 65 byte log entry
0709 12:26:08.382791 (+ 11751us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.382936 (+   145us) write_op.cc:454] Released schema lock
0709 12:26:08.382977 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.383414 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.383456 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4960,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":8144,"apply.run_wall_time_us":25467,"cfile_cache_hit":24,"cfile_cache_hit_bytes":24996,"num_ops":6,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":3449,"prepare.run_wall_time_us":6654,"replication_time_us":4162}]]}
I20260709 12:26:08.482432 15728 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 9 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.483987 15728 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.495625 21395 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.496258 21395 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.498677 21395 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:08.499595 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:08.500483 16486 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:26:08.502033 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:08.506609 21395 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.507089 21395 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.507566 21395 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.509402 15728 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 13 to 16, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.510969 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:08.511708 15906 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:26:08.529136 21395 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.532876 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:08.532987 15836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:08.533978 15836 raft_consensus.cc:606] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:08.534869 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:08.535434 15906 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.533562 16486 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.545142 21395 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:08.545797 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:08.546458 15980 raft_consensus.cc:606] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:08.548213 15906 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:08.549335 16486 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:08.549386 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:08.550105 15980 raft_consensus.cc:606] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:08.550729 15803 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:08.550475 15980 raft_consensus.cc:614] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:08.551680 21395 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:08.552433 21395 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:08.553341 21395 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:08.554033 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:08.554574 15980 raft_consensus.cc:606] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:08.557057 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db755710417246db916d8278741aaff0"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:08.557546 15980 raft_consensus.cc:606] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:08.558518 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:08.560431 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.564882 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.597904 15731 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 16 to 17, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 17 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.630350 15731 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 11 to 13, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.632936 15731 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 9 to 12, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 12 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.639226 15731 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 11 to 12, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 12 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.643678 15980 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:08.658565 21059 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:08.662223 15731 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 12 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:08.664166 15731 catalog_manager.cc:5697] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:08.674073 15728 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 280) took 14388 ms (client timeout 15000 ms). Trace:
W20260709 12:26:08.674508 15728 rpcz_store.cc:269] 0709 12:25:54.289258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.297191 (+  7933us) service_pool.cc:224] Handling call
0709 12:25:54.374935 (+ 77744us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5400002210. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c917eb71 00007f03c917f0b2 00007f03d20f8759 00007f03d2090a76 00007f03d2061d58 00007f03d216004e 00007f03d06212a4 00007f03d0621232 00007f03d0621161 00007f03d06210dc
0709 12:26:08.674011 (+14299076us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.527632 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.528122 (+   490us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.528157 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:26:08.528169 (+    12us) tablet.cc:662] Decoding operations
0709 12:26:08.528784 (+   615us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.528846 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.528895 (+    49us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:26:08.529420 (+   525us) tablet.cc:701] Row locks acquired
0709 12:26:08.529438 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:08.529583 (+   145us) write_op.cc:270] Start()
0709 12:26:08.529682 (+    99us) write_op.cc:276] Timestamp: P: 1783599968529540 usec, L: 0
0709 12:26:08.529701 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.530300 (+   599us) log.cc:844] Serialized 2054 byte log entry
0709 12:26:08.532460 (+  2160us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.532833 (+   373us) write_op.cc:301] APPLY: starting
0709 12:26:08.532909 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.535570 (+  2661us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.535674 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.538444 (+  2770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.538605 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.538644 (+    39us) write_op.cc:312] APPLY: finished
0709 12:26:08.538850 (+   206us) log.cc:844] Serialized 57 byte log entry
0709 12:26:08.539708 (+   858us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.539805 (+    97us) write_op.cc:454] Released schema lock
0709 12:26:08.539844 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.540151 (+   307us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.540176 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19145,"reported_tablets":49,"spinlock_wait_cycles":34694912,"child_traces":[["op",{"apply.queue_time_us":209,"apply.run_cpu_time_us":6583,"apply.run_wall_time_us":7290,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20830,"num_ops":5,"prepare.queue_time_us":1907,"prepare.run_cpu_time_us":2935,"prepare.run_wall_time_us":2935,"replication_time_us":2650}]]}
I20260709 12:26:08.683499 16486 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:08.687520 21292 raft_consensus.cc:993] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:08.696590 21292 raft_consensus.cc:1081] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:08.699432 21315 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:08.711391 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12b10f85daf040e1af9735597b9af404"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:08.712037 15906 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.715014 15906 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:08.726725 21279 raft_consensus.cc:993] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:08.727358 21279 raft_consensus.cc:1081] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:08.739573 15911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:08.742035 15911 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.742393 15911 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:08.764168 15729 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 13, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.773854 15906 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.797622 15906 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:09.798246 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:37350 (request call id 1882) took 1091 ms. Trace:
I20260709 12:26:09.802333 15906 rpcz_store.cc:276] 0709 12:26:08.706388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.711257 (+  4869us) service_pool.cc:224] Handling call
0709 12:26:09.798136 (+1086879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
I20260709 12:26:09.806017 16486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42798 (request call id 964) took 1104 ms. Trace:
I20260709 12:26:09.806388 16486 rpcz_store.cc:276] 0709 12:26:08.701903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.705130 (+  3227us) service_pool.cc:224] Handling call
0709 12:26:08.705431 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:08.705787 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:08.705819 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:08.706233 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:26:08.749271 (+ 43038us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:08.749315 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:08.749392 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:09.805820 (+1056428us) raft_consensus.cc:1685] finished
0709 12:26:09.805839 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:09.805964 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":938,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":42741,"threads_started":1,"wal-append.queue_time_us":42729}
W20260709 12:26:09.809131 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08002db8a0 after lost signal to thread 14652
I20260709 12:26:09.820286 21418 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.821120 21418 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.859885 21418 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:09.866868 21415 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.867498 21415 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:09.868722 15911 consensus_meta.cc:287] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Time spent flushing consensus metadata: real 1.126s	user 0.016s	sys 0.002s
I20260709 12:26:09.869153 15911 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:09.869639 21415 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:09.871029 15911 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:09.871505 15911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50336 (request call id 3375) took 1139 ms. Trace:
I20260709 12:26:09.871824 15911 rpcz_store.cc:276] 0709 12:26:08.731940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.739450 (+  7510us) service_pool.cc:224] Handling call
0709 12:26:09.871441 (+1131991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:09.882684 21414 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:09.883374 21414 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.885414 21414 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:09.890172 21414 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:09.890725 21414 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.892834 21414 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:09.893358 21414 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.893860 21414 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:09.900892 21414 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:09.903965 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:09.907137 21419 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.907822 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:09.911594 21420 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:09.912412 21420 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:09.916625 21420 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:09.918030 21331 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:09.918601 21331 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:09.918062 16457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.004s	sys 0.008s
W20260709 12:26:09.920619 16457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.004s	sys 0.008s
I20260709 12:26:09.922856 21331 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:09.923359 21402 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.924027 21315 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:09.924299 21402 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.924763 21315 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:09.926489 21402 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:09.927487 21315 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:09.910780 21419 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.949805 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:09.950659 21415 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.963393 21415 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:09.954908 21320 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.965046 21279 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:09.966065 21059 raft_consensus.cc:493] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:09.966496 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:09.968374 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:09.981703 15988 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:09.982129 15988 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:09.954406 21419 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:09.980072 21320 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.001624 21420 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.002244 21420 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.003283 21421 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.003804 21421 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.990748 15988 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.006325 15988 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:09.987061 21059 raft_consensus.cc:515] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:09.986047 21279 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.010048 21419 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.018121 21419 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.018800 21415 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.005190 21420 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.034369 21426 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.034924 21426 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.036983 21426 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.037550 21426 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.038091 21426 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.040452 21426 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.010782 21423 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.041595 21423 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.042479 21059 leader_election.cc:290] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.043258 21432 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.043745 21423 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.043805 21432 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.046576 21432 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.047020 21425 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.044418 21423 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.047513 21425 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.048035 21423 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.050201 21421 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.033206 21414 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.051074 21414 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.052160 21423 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.040990 15988 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:10.054399 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.055106 16486 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:10.056198 15953 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:10.059027 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:10.014849 21320 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.010874 21402 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.017494 21315 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.064076 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.062608 16486 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.033705 21415 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.060276 21423 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:10.053444 21331 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.056725 21426 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.072949 15911 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:10.075891 16486 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19.
I20260709 12:26:10.079005 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:10.079767 15911 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:26:10.082085 21430 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.067989 21413 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.082556 21430 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.082762 21413 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.084640 21430 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.085140 21430 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.085582 21430 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.089291 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.091526 21430 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.092319 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.086990 21413 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.068480 21315 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.132584 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:10.133737 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:10.134493 15906 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:10.087033 21279 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.066774 21402 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.086136 21421 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.137792 21436 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.138450 21433 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.069891 21320 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.071473 21423 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.077221 21432 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.093464 21425 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.167311 21320 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.186378 21420 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.187130 21420 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.188637 21320 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.168823 21433 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.132005 21430 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.169570 21436 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.142524 21413 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.146536 21421 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.168129 21423 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.189108 21431 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.135138 21059 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.077950 21331 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.078222 21426 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.071213 21415 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.189544 21428 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.280834 21279 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.299503 21436 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.190680 21414 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.339100 21444 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.299356 21420 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.348134 15911 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
W20260709 12:26:10.349011 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 218325us
I20260709 12:26:10.350275 21445 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.328387 21443 raft_consensus.cc:493] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.329412 21435 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.257799 21432 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.327529 21442 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.306270 21413 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.346488 21424 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.345887 21414 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.340442 21059 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.300619 21430 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.359514 21420 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.340991 21431 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.356583 21445 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.360658 21419 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.375725 21439 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.347424 21279 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.358175 21436 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.362526 21415 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.345053 21428 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.356457 21443 raft_consensus.cc:515] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.357365 21435 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.348505 21444 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.385181 21439 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.360860 21424 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:10.507148 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbc60 after lost signal to thread 15769
W20260709 12:26:10.632299 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800325c40 after lost signal to thread 15862
W20260709 12:26:10.632717 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800039f80 after lost signal to thread 15863
I20260709 12:26:10.379637 21402 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.403712 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:10.381392 21331 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.375969 21434 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:26:10.647174 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800064c60 after lost signal to thread 15937
I20260709 12:26:10.379498 21431 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:10.660693 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800064c40 after lost signal to thread 15938
W20260709 12:26:10.673839 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcfe0 after lost signal to thread 16012
I20260709 12:26:10.550280 21458 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.383697 21315 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.384388 21419 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.381803 21445 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.468294 21426 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.463850 21413 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.462749 21430 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.401027 21418 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.437297 21450 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.449723 21438 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.500696 21417 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.447170 21059 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.464699 21447 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.378010 21420 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.436403 21433 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.412510 21421 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.438552 21279 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.437525 21448 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.674867 21423 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.574954 21440 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.501075 21397 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.374735 21442 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.481835 21454 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.506249 21422 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.467202 21432 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.679539 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.436224 21441 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:26:10.681113 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800363100 after lost signal to thread 16521
I20260709 12:26:10.698174 15729 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 285) took 2076 ms. Trace:
W20260709 12:26:10.768316 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800402880 after lost signal to thread 16522
W20260709 12:26:10.768858 15766 debug-util.cc:398] Leaking SignalData structure 0x7b0800352a40 after lost signal to thread 21390
I20260709 12:26:10.363685 21414 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.441339 21437 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.550690 21395 raft_consensus.cc:493] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.658502 21415 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.679251 21431 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.802008 21431 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.804077 21465 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.466302 21449 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.214s
I20260709 12:26:10.804569 21437 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.804733 21465 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.641136 21436 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.806732 21437 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.756956 21421 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.807036 21436 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.757120 21433 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.806746 21465 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.807696 21433 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:10.750046 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 346385us
I20260709 12:26:10.809814 21433 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.775226 21059 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.706673 21402 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:10.811064 21059 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.811619 21402 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.812211 21402 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.768888 21397 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.471988 21425 raft_consensus.cc:493] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.815289 21397 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.815730 21425 raft_consensus.cc:515] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.679939 21315 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.816939 15879 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:10.817351 21315 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.820027 21315 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.757952 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.753660 21417 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:10.759289 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.758220 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.821447 16492 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 10.
I20260709 12:26:10.822204 21417 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.823634 21417 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.824106 21417 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.761533 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.676846 21434 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.825146 21395 raft_consensus.cc:515] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.825531 15879 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:10.826681 21425 leader_election.cc:290] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.827267 21434 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.761868 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.748430 21418 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.827514 21395 leader_election.cc:290] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.828444 21279 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.828956 21279 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.829334 21418 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.829798 21414 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.830411 21464 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.830925 21279 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.751066 21102 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.831105 21464 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.831683 21102 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.778986 21461 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.833747 21102 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.777405 21422 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.833633 21461 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.834233 21417 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.835755 21422 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.836325 21461 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.838349 21402 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:10.778421 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.778216 21415 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.778601 21423 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.751437 21450 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.843011 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.843849 21415 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.844316 21450 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.845077 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.845347 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.845952 15987 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:26:10.846232 21428 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.846418 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.807394 21421 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.847643 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.779235 21446 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.848212 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.848724 21421 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.776436 21440 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.784054 21443 leader_election.cc:290] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.785239 21435 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.722642 21419 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.711428 21458 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.779312 21441 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.791637 21444 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.792203 21463 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.752025 21438 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.755632 21447 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.793592 21462 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.797111 21453 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.913928 21462 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.914043 21453 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.798076 21442 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.798524 21430 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.916152 21462 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.916019 21430 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.799750 21451 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:26:10.800056 15730 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 178) took 18844 ms (client timeout 15000 ms). Trace:
I20260709 12:26:10.768399 15729 rpcz_store.cc:276] 0709 12:26:08.622232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.622364 (+   132us) service_pool.cc:224] Handling call
0709 12:26:10.698084 (+2075720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.768963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.769480 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.769520 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:26:08.769533 (+    13us) tablet.cc:662] Decoding operations
0709 12:26:08.769860 (+   327us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.769915 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.769956 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:08.770134 (+   178us) tablet.cc:701] Row locks acquired
0709 12:26:08.770147 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:26:08.770286 (+   139us) write_op.cc:270] Start()
0709 12:26:08.770395 (+   109us) write_op.cc:276] Timestamp: P: 1783599968770242 usec, L: 0
0709 12:26:08.770411 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.771008 (+   597us) log.cc:844] Serialized 533 byte log entry
0709 12:26:08.772626 (+  1618us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.773050 (+   424us) write_op.cc:301] APPLY: starting
0709 12:26:08.773130 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.773876 (+   746us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.773965 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.774710 (+   745us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.774857 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.774899 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:08.775050 (+   151us) log.cc:844] Serialized 25 byte log entry
0709 12:26:08.775192 (+   142us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.775266 (+    74us) write_op.cc:454] Released schema lock
0709 12:26:08.775304 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.775612 (+   308us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.775639 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1787456,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":2551,"apply.run_wall_time_us":2551,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4166,"num_ops":1,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":2307,"prepare.run_wall_time_us":2306,"replication_time_us":2111}]]}
W20260709 12:26:10.917595 15730 rpcz_store.cc:269] 0709 12:25:51.955780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.956838 (+  1058us) service_pool.cc:224] Handling call
0709 12:26:10.799851 (+18843013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354037,"reported_tablets":32}
I20260709 12:26:10.917603 21451 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.921833 21441 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.922343 21453 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.801335 21420 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.922868 21463 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.924115 21430 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.804163 21431 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.724324 15731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 179) took 3749 ms. Trace:
I20260709 12:26:10.820104 21426 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:10.926227 21458 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.926529 21426 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:10.927464 21426 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.928220 21447 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.839099 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:10.929271 16486 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.930019 21438 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.839461 16493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.840665 16488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.933914 21419 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.845139 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.907068 21425 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.780997 21439 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.779982 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.934719 21425 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.782203 21424 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.848729 21446 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.849931 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.936030 16487 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:10.936681 21425 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.937127 21446 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.851225 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.851516 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.938117 21440 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.851904 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.853303 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.854434 16494 raft_consensus.cc:2393] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 14: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:10.940124 21464 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.776549 21454 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.944639 21474 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.945210 21474 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.946132 21454 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.941447 21444 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:10.947026 21444 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.947301 21474 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.778070 21459 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.947983 21459 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:10.950093 21459 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.761395 21448 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.777633 21456 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.954957 21456 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:10.924930 15731 rpcz_store.cc:276] 0709 12:26:06.974895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.975130 (+   235us) service_pool.cc:224] Handling call
0709 12:26:07.036831 (+ 61701us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b540017c854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20d090 00007f03cc2abf3a 00007f03d2061e9c 00007f03d216004e 00007f03d06212a4 00007f03d0621232 00007f03d0621161 00007f03d06210dc 00007f03d0620392 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:10.724264 (+3687433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.690980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.691576 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.691627 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:26:08.691652 (+    25us) tablet.cc:662] Decoding operations
0709 12:26:08.692464 (+   812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.692515 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.692545 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:26:08.693140 (+   595us) tablet.cc:701] Row locks acquired
0709 12:26:08.693159 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:08.693302 (+   143us) write_op.cc:270] Start()
0709 12:26:08.693437 (+   135us) write_op.cc:276] Timestamp: P: 1783599968693257 usec, L: 0
0709 12:26:08.693462 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.694060 (+   598us) log.cc:844] Serialized 2434 byte log entry
0709 12:26:08.697491 (+  3431us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.697895 (+   404us) write_op.cc:301] APPLY: starting
0709 12:26:08.697983 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.700995 (+  3012us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.701099 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.704272 (+  3173us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.704459 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.704511 (+    52us) write_op.cc:312] APPLY: finished
0709 12:26:08.704746 (+   235us) log.cc:844] Serialized 65 byte log entry
0709 12:26:08.705524 (+   778us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.705631 (+   107us) write_op.cc:454] Released schema lock
0709 12:26:08.705673 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.706047 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.706076 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51376,"reported_tablets":32,"spinlock_wait_cycles":55080704,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":7462,"apply.run_wall_time_us":8066,"cfile_cache_hit":24,"cfile_cache_hit_bytes":24996,"num_ops":6,"prepare.queue_time_us":11729,"prepare.run_cpu_time_us":3348,"prepare.run_wall_time_us":3348,"replication_time_us":3913}]]}
I20260709 12:26:10.964206 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.965996 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.966352 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.967563 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.968734 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.971371 21463 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:10.972631 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.973266 15830 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:10.973555 16486 raft_consensus.cc:2468] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:10.974162 16494 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:10.974504 15836 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:10.976572 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:10.976881 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.985152 21456 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.985704 21444 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.986486 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.987883 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:10.994108 21451 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.966355 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.001829 15831 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:11.004521 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.008723 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.009107 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.009352 16494 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:26:11.009622 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.010182 15988 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:26:11.011023 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.012872 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.014098 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:26:10.881084 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 55607.7us
I20260709 12:26:11.018348 16489 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:10.882800 15953 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:10.892984 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:10.893909 21402 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:10.862720 21059 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:10.899417 21422 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:10.890317 21465 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:10.912127 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.034933 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:10.913381 21434 raft_consensus.cc:493] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:10.906083 21395 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:10.954468 21448 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.015650 15984 raft_consensus.cc:1240] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:11.019732 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 137026us
I20260709 12:26:11.021442 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.022125 16457 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.034016 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.034198 16495 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:11.046283 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.049503 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.055837 15988 raft_consensus.cc:2393] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 11: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:11.056221 15906 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:11.037298 21422 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.060698 21422 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:11.062063 21465 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:11.063257 21465 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.065186 21434 raft_consensus.cc:515] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.067909 21434 leader_election.cc:290] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.034781 21446 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:11.068755 21446 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:11.069255 21446 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:11.072407 15953 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:11.073129 21395 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.074555 15733 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 279) took 4166 ms. Trace:
I20260709 12:26:11.074927 15733 rpcz_store.cc:276] 0709 12:26:06.917276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.935404 (+ 18128us) service_pool.cc:224] Handling call
0709 12:26:11.074492 (+4139088us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5,"reported_tablets":50}
I20260709 12:26:11.075798 21395 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.048506 21431 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:11.076656 21431 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.077180 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.079314 21431 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:11.018072 21450 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:11.080475 21450 raft_consensus.cc:493] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:11.034420 21461 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:26:11.082844 21419 raft_consensus.cc:2804] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:11.083381 21419 raft_consensus.cc:697] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:11.083849 21441 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:11.084360 21441 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:11.084295 21419 consensus_queue.cc:237] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.084983 21441 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:11.080928 21450 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.094980 15909 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:11.096902 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.098559 15733 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 13 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.100976 15733 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:11.016080 21444 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:11.110885 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.112612 15905 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 17.
I20260709 12:26:11.127679 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.128813 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.129531 15910 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:11.130383 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.130478 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.135571 15911 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:26:11.138135 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.140995 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:26:11.149434 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 132291us
I20260709 12:26:11.150247 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.155800 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.158497 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.158546 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.159819 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.170979 15909 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:26:11.170143 15835 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:11.172413 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.181423 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.184046 16495 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:11.184855 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.186117 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.186441 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.187623 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.188309 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.194420 15981 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:11.145263 21444 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.201881 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.203316 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:11.205295 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.207337 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.210096 21467 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:11.210670 21467 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.214794 21444 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:11.219394 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db6493294254313a1e9687fd4ba9b08" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.220714 15909 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:11.220911 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.221750 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.222147 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.222314 15904 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:26:11.223555 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.224246 15911 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:26:11.228204 21450 raft_consensus.cc:515] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.230554 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.231133 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.231547 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.231721 15904 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:11.232643 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25191835faf945ef870143a9ce1b2127" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.232963 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.233382 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.233767 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.237725 15905 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:11.240644 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.242054 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.244480 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.212922 21467 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:11.245922 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.231170 15911 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:11.250569 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.251215 15836 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.252022 16494 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:11.247190 21450 leader_election.cc:290] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.257717 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.259977 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.264559 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.253798 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.266412 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.265349 15832 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:11.268620 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.269937 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.270730 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.272176 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.275779 15836 raft_consensus.cc:2468] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:26:11.281983 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.283380 16457 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.283533 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.286772 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.288158 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.289290 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.290650 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.271536 21465 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:11.291180 15988 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:11.292107 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.291203 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.295186 15907 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:26:11.296043 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.298352 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.300004 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.301131 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.282678 21431 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.301905 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.299371 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.304949 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.305264 15879 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:11.306493 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.290998 21467 raft_consensus.cc:2804] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:11.268728 21446 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.310330 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.311849 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.316210 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.314950 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.294272 21465 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:11.318162 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.320886 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.319522 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.318186 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.322515 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.325929 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.326318 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.326879 15834 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:11.326895 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.326341 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.321744 15984 raft_consensus.cc:2468] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
W20260709 12:26:11.365139 15720 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 761f08e40cdf4af396105d67949c0afc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:11.322453 21467 raft_consensus.cc:697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:11.390580 15836 raft_consensus.cc:1240] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:11.391511 15720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68091us
I20260709 12:26:11.391309 21467 consensus_queue.cc:237] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.318545 21315 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:11.316825 21462 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:11.400432 15832 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:11.401177 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.322348 21465 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:11.403654 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.321076 21437 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:11.401232 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.403023 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.402982 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.403012 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:11.401608 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74252.8us
I20260709 12:26:11.401249 15832 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:11.406477 15984 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:11.414278 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:11.407447 15834 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:11.415822 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.416952 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.311056 21431 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.415995 15832 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.420951 15832 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:11.421301 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.421773 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.398748 21462 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:11.402392 21442 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:11.424913 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.437400 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.438501 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.439688 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.420636 21435 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:11.416558 21413 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.442374 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.325477 21441 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.442957 15833 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:11.401099 21415 consensus_queue.cc:1059] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:26:11.448344 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.449591 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db7600d8ee247d0abddcf104708f152" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.437553 21462 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:11.455140 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:11.455238 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.418885 21461 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:26:11.456857 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.459373 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.440680 21435 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:11.461586 16495 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:11.461498 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.458371 21449 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:11.462987 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.463546 15952 leader_election.cc:304] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.463961 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.469412 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.472493 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a5ecf16d3543828d16fe27e061a42e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.462615 21402 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:11.462754 21435 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:11.504655 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.450997 21413 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.465830 21419 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.503379 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:11.462500 21449 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:11.508723 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.517793 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.519894 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.520737 21413 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.504876 21135 raft_consensus.cc:2749] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:11.521600 21431 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.521595 21448 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:11.521647 21443 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.506750 21419 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:11.522782 21443 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:11.523250 21419 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.523307 21443 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.526705 15952 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.529947 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.532922 15832 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19.
I20260709 12:26:11.533202 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.537549 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.543633 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.518426 21449 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:11.574890 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.576174 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.580399 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:26:11.576683 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 112937us
I20260709 12:26:11.582024 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.581318 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.582911 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.583379 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.584193 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.503561 21445 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:11.554608 21414 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:11.582522 16459 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.585258 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.594645 21413 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:11.591940 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.596344 21413 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:11.597011 21413 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.599339 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.600389 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.601133 15834 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:11.602411 16457 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.600422 15908 raft_consensus.cc:2410] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:26:11.603701 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.606953 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506492d6bd024ce682676a3ecdcf186f" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.607976 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.608517 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.608042 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.609308 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.609581 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.610785 15879 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.612342 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.612684 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.613651 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.608961 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.617750 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e83c2c4f9a0f4e5aa1398c0e1d5d3dba" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.620422 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:11.625183 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a3e78f7a344d43ab144f24c55a1e4b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.626915 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:11.633181 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.627955 21431 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:11.629619 21473 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:11.641651 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 50508.6us
I20260709 12:26:11.641988 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.634245 21447 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:11.640512 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 104579us
I20260709 12:26:11.644845 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.643121 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.619808 21445 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.649643 15802 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:26:11.641009 21482 log.cc:927] Time spent T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:26:11.661000 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.673225 21441 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:11.640187 21484 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.686743 21484 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:11.687228 21484 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.692230 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.692859 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.645736 21473 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:11.643671 21413 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.693513 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7571c77d7cc54b31955653214a4cee6c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.693607 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.705235 21102 raft_consensus.cc:3055] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:11.705758 21102 raft_consensus.cc:740] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:11.706808 21102 consensus_queue.cc:260] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.710035 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.711202 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.714536 21102 raft_consensus.cc:3060] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.736390 21446 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.737880 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.698977 21473 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:11.760306 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:11.762478 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:11.764222 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.764818 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.701164 21488 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:11.769626 21488 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:11.769788 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.770117 21488 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:11.651052 21447 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:11.764832 15980 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:11.775676 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.778586 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.793098 16492 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:26:11.785610 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:11.787115 15951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.794632 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.712277 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.789430 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:11.694383 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.791066 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:26:11.797850 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 103551us
W20260709 12:26:11.800480 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 147829us
W20260709 12:26:11.802088 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 145894us
I20260709 12:26:11.802798 15980 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:11.804503 16459 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:11.805522 15800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.805639 21443 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.807327 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.808043 21443 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.796456 21447 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.808491 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.810997 21489 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:11.812076 21489 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:11.812659 21489 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:11.814800 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.814999 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.817863 21494 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:11.820605 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.822152 16492 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:11.833539 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:26:11.838503 21485 log.cc:927] Time spent T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:11.831223 21414 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:26:11.844578 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.845003 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.815562 21450 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:11.849684 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.850860 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:26:11.851894 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 66212.8us
I20260709 12:26:11.853186 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.854710 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.803810 21435 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.839452 21449 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:11.869457 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.815932 21465 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.848875 21489 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:11.871328 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.832921 21462 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.878120 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.878335 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.878662 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.878836 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:26:11.879092 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.881634 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:11.901262 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.901429 15987 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:11.901754 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.885671 16486 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:11.855718 21413 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:11.848222 21426 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:26:11.906270 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.910357 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
W20260709 12:26:11.912804 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 91154.5us
I20260709 12:26:11.893656 21450 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:11.919020 21435 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.919097 21462 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:11.904923 21445 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.920002 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:11.924413 15831 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:11.921495 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.926589 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:11.927316 15980 raft_consensus.cc:606] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.927712 15980 raft_consensus.cc:614] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.910614 21471 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:11.929497 15802 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.935640 21497 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.936051 21497 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:11.936403 21497 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.893908 21491 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:26:11.940135 21449 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.913549 21487 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:11.943835 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.915988 21431 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:26:11.949746 15802 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.920740 21419 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:11.952522 15831 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:11.951622 15952 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
W20260709 12:26:11.960778 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 95365.2us
I20260709 12:26:11.961906 16460 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.964329 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.970419 15979 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:11.970782 21419 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:11.972162 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:11.973933 15904 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:11.964830 21446 raft_consensus.cc:2749] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:11.933740 21471 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:11.978135 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 165152us
I20260709 12:26:11.977341 21488 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.979959 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:11.980518 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.980594 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82df0e9104447ab3e50c2a6968cf7e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:11.982954 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.957140 21494 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.983498 15831 raft_consensus.cc:2376] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19. Re-sending same reply.
I20260709 12:26:11.983403 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.984925 15802 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.986534 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.987159 16460 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.965075 21442 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:11.988178 15952 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:11.989624 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.984926 21494 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:11.991937 21494 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.993763 15876 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:11.995014 21415 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:11.981949 21445 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.995543 15876 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.996244 21437 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:11.996011 21445 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:11.997340 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.998138 21445 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:11.979348 21471 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:11.998536 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:11.999696 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:12.001051 21442 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:12.004112 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b51295f13874e3492f0541da8a1f625" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:12.004532 15876 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.005122 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:12.005221 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:12.007462 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:11.987987 15802 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:11.958746 21484 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.009871 21500 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.010380 21500 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.011511 21484 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:12.012192 16494 raft_consensus.cc:1240] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:11.985664 21472 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:11.987530 21461 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.012377 21500 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
W20260709 12:26:12.014353 21502 log.cc:927] Time spent T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:26:12.012192 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d26e9d10514d43b1dc78bb348fede9" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:12.015455 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:12.008351 21449 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:12.016480 21449 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:12.016883 21449 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.018855 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:11.978086 21465 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:12.020897 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:12.020991 15876 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.020924 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:12.021862 15837 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:12.008944 21437 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.009323 21428 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.009409 21491 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.027005 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:11.984804 21402 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:26:12.023362 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.030875 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.024318 15831 raft_consensus.cc:1275] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:12.007743 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.026443 21414 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.033393 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.038543 15950 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.001902 21442 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.047637 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:12.048381 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60478.7us
I20260709 12:26:12.052604 15876 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.051110 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.051566 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.055367 15950 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.031544 21418 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.056936 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.050086 21402 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:12.116719 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61421.8us
I20260709 12:26:12.117542 15950 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:12.118528 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 61664.5us
I20260709 12:26:12.058571 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:12.113742 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 62036.9us
W20260709 12:26:12.121018 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 62791.5us
W20260709 12:26:12.114688 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 56606.2us
W20260709 12:26:12.115831 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 68715.5us
W20260709 12:26:12.122078 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 213037us
I20260709 12:26:12.045579 21430 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.119669 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.123521 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:12.145117 15876 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.023458 21447 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.054672 21487 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:12.056044 21135 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.048239 21505 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:12.054811 21492 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:12.147192 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:12.056953 21465 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.059300 21415 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:12.056347 21472 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.059612 21419 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.124310 21484 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.159420 15913 raft_consensus.cc:1240] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:12.123773 21491 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.116777 21402 raft_consensus.cc:493] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.050551 21500 consensus_queue.cc:1048] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:26:12.124047 21431 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.154311 21442 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.123917 21503 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.174760 21445 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:12.176087 21488 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:12.176898 21488 consensus_queue.cc:1059] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:12.153992 21505 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:12.178541 21505 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.178546 21402 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.152822 21487 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:12.155180 21492 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:12.153666 21450 consensus_queue.cc:1059] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:26:12.159375 21462 consensus_queue.cc:1059] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:26:12.159583 21451 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:12.213865 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 46266us
W20260709 12:26:12.222640 21504 log.cc:927] Time spent T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:26:12.224543 21447 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:12.157020 21428 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:26:12.233582 21473 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.236119 21473 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:12.238955 15907 raft_consensus.cc:1240] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:12.243604 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:12.244676 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:12.244750 15876 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.245972 15984 raft_consensus.cc:2393] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:12.215982 21487 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.246446 15982 raft_consensus.cc:2393] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 18: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:12.218710 21492 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.217681 21497 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:12.270008 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 213465us
I20260709 12:26:12.252059 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.283723 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.288045 15876 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.278493 21467 consensus_queue.cc:1059] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:26:12.291373 21444 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.297737 21418 raft_consensus.cc:3055] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.298151 21418 raft_consensus.cc:740] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:12.291585 21462 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.300653 21402 raft_consensus.cc:515] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.303633 21444 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.303905 21497 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:12.305433 15876 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.306322 21444 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.307612 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.308866 21444 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.309242 21472 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:12.309641 21472 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:12.310148 15876 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.310511 21472 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.311247 21462 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.308342 21402 leader_election.cc:290] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:26:12.311898 21472 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.312507 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:12.252269 21453 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.313572 16486 raft_consensus.cc:1240] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 20 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:26:12.316087 21487 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:12.293987 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 179595us
I20260709 12:26:12.320289 15876 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.326943 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:12.329104 15876 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.243484 21494 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.247720 21449 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:12.343390 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 61439.8us
I20260709 12:26:12.261911 21471 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.345309 15803 leader_election.cc:304] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.346697 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:12.346803 15876 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.347292 15837 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.322023 21447 consensus_queue.cc:1059] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:26:12.353708 21447 raft_consensus.cc:3055] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:12.354032 21447 raft_consensus.cc:740] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.354830 21447 consensus_queue.cc:260] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.355540 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b10f85daf040e1af9735597b9af404" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.355965 21447 raft_consensus.cc:3060] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:12.330416 21509 raft_consensus.cc:3055] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:12.376786 21509 raft_consensus.cc:740] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:12.377699 21509 consensus_queue.cc:260] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.378765 21509 raft_consensus.cc:3060] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.333880 21462 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.362664 21059 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.381297 21059 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.382125 21059 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.383430 21059 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.370452 21471 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:12.372558 16489 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:12.373919 21494 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:12.332579 21453 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.376333 21437 raft_consensus.cc:2749] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.391644 16495 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:12.394163 15733 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 180) took 1301 ms. Trace:
I20260709 12:26:12.396384 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:12.396934 16486 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:12.398021 21515 log.cc:927] Time spent T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:12.402163 21487 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:12.402732 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:12.404492 21395 raft_consensus.cc:2764] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:12.408998 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:26:12.404384 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 59156.8us
I20260709 12:26:12.412590 16486 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:12.370486 21418 consensus_queue.cc:260] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:12.416531 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 69837.9us
I20260709 12:26:12.418365 15837 raft_consensus.cc:2468] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 20.
I20260709 12:26:12.419364 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:12.421280 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 301662us
I20260709 12:26:12.422441 16457 leader_election.cc:304] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:12.424221 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:12.437709 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.438799 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.439802 15876 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.441478 21471 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.441833 21465 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.442106 21471 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.442484 21465 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:12.442839 21494 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:12.445125 21444 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.446141 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.394640 15733 rpcz_store.cc:276] 0709 12:26:11.092712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.092848 (+   136us) service_pool.cc:224] Handling call
0709 12:26:12.394080 (+1301232us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:11.398517 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:11.433367 (+ 34850us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:11.433400 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:26:11.433417 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:11.433837 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:11.433898 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:11.433932 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:26:11.434245 (+   313us) tablet.cc:701] Row locks acquired
0709 12:26:11.434266 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:26:11.434411 (+   145us) write_op.cc:270] Start()
0709 12:26:11.434538 (+   127us) write_op.cc:276] Timestamp: P: 1783599971434365 usec, L: 0
0709 12:26:11.434562 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:26:11.462118 (+ 27556us) log.cc:844] Serialized 975 byte log entry
0709 12:26:11.775309 (+313191us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b180031a8c0. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03d207eab1 00007f03d208b281 00007f03c91b63f3 00007f03c91b87c1 00007f03c91b8779 00007f03c91b8709 00007f03c91b86d1 00007f03c91b79cd 0000000000388634 0000000000388479 00007f03c919983a
0709 12:26:11.950361 (+175052us) op_driver.cc:464] REPLICATION: finished
0709 12:26:12.057339 (+106978us) write_op.cc:301] APPLY: starting
0709 12:26:12.067311 (+  9972us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:12.181793 (+114482us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b540017c854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2a032a 00007f03cc225f14 00007f03cc225ec3 00007f03cc225e38 00007f03cc225df3 00007f03cc2250dc 00007f03cc24ee16 00007f03cc236cbb 00007f03cc22139d 00007f03cc224d75
0709 12:26:12.251740 (+ 69947us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:12.251764 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:12.284493 (+ 32729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:12.325863 (+ 41370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:26:12.331894 (+  6031us) write_op.cc:312] APPLY: finished
0709 12:26:12.353104 (+ 21210us) log.cc:844] Serialized 33 byte log entry
0709 12:26:12.353275 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.353354 (+    79us) write_op.cc:454] Released schema lock
0709 12:26:12.353391 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:12.353757 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.353782 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":336768,"child_traces":[["op",{"apply.queue_time_us":82969,"apply.run_cpu_time_us":5055,"apply.run_wall_time_us":306355,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12459,"num_ops":2,"prepare.queue_time_us":221219,"prepare.run_cpu_time_us":48591,"prepare.run_wall_time_us":269933,"raft.queue_time_us":93786,"raft.run_cpu_time_us":10117,"raft.run_wall_time_us":243893,"replication_time_us":515642,"spinlock_wait_cycles":41018496,"thread_start_us":388500,"threads_started":4,"wal-append.queue_time_us":180652}]]}
I20260709 12:26:12.457504 21449 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:12.463968 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:12.466796 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 44456.9us
I20260709 12:26:12.484907 15950 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.486790 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.487536 15876 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.404472 21505 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.486045 21498 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:12.490492 21498 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.490984 15950 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.492076 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.493786 21520 raft_consensus.cc:2749] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.494793 21460 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.495468 21460 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.496069 21460 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.473174 21444 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:12.497390 21503 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:12.498078 15801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.502197 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:12.503901 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:12.504530 15907 raft_consensus.cc:2410] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:26:12.507079 21418 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.482813 21492 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.513589 21492 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:12.517306 15832 raft_consensus.cc:1240] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:12.458711 21488 consensus_queue.cc:1059] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:26:12.520092 21488 raft_consensus.cc:3055] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:12.520452 21488 raft_consensus.cc:740] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:12.521255 21488 consensus_queue.cc:260] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.522387 21488 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.527128 21505 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:12.477622 21484 raft_consensus.cc:2804] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:12.528275 21484 raft_consensus.cc:697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 20 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:12.529129 21484 consensus_queue.cc:237] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:12.539345 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51886us
W20260709 12:26:12.539587 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 257165us
I20260709 12:26:12.532555 15950 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.539659 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.545567 15879 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.546482 15876 leader_election.cc:304] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.492885 21498 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:12.558852 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:12.553318 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 122618us
I20260709 12:26:12.560909 15913 raft_consensus.cc:1240] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:12.562968 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.572486 15803 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.565382 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.566526 15906 raft_consensus.cc:1240] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:12.569628 15832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:12.574916 15832 raft_consensus.cc:606] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:12.570840 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.575394 15803 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.570492 15904 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:12.563922 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.580410 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.550454 21472 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.581563 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.583070 15950 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.559469 21469 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:12.548523 21430 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.591106 21469 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.593348 21523 raft_consensus.cc:2749] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:12.548631 21102 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:26:12.595407 21469 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.599248 16494 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:12.550311 21447 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:26:12.607473 15879 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.607813 21473 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:12.608217 21473 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.608521 21471 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:12.609056 21471 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.609951 21471 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.610426 21497 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.611467 21514 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.613286 15803 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.548308 21444 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.614355 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.609028 21473 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.618876 21518 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.619398 21466 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.618518 21473 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.560170 21507 raft_consensus.cc:2749] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:12.572579 21450 consensus_queue.cc:1059] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:26:12.625126 15832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:12.625679 15832 raft_consensus.cc:606] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.625733 21450 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.626209 21450 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:12.626682 15984 raft_consensus.cc:1240] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:12.654325 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:12.618041 21497 raft_consensus.cc:2749] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.657649 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:12.659407 15979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:12.660264 15979 raft_consensus.cc:606] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.660308 15832 raft_consensus.cc:1275] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:12.668380 15835 raft_consensus.cc:1240] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:12.656231 21135 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.675089 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.678759 15837 raft_consensus.cc:1240] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:12.679692 15803 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.666291 21492 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:12.681974 21497 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:12.682363 15979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:12.682978 15979 raft_consensus.cc:606] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.683583 15803 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.657996 21458 consensus_queue.cc:1059] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:26:12.685724 21513 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.686595 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:12.682607 21492 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:12.686853 15837 raft_consensus.cc:1240] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:12.688112 21524 raft_consensus.cc:2749] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.676577 21519 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:26:12.698774 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:12.695569 21509 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.698918 21492 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.706157 15837 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:26:12.714149 21519 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:12.714607 21519 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:12.715543 21519 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:12.717334 21510 consensus_queue.cc:1175] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 12:26:12.677068 21514 consensus_queue.cc:1059] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:26:12.724218 21514 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:12.724596 21514 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:12.725431 21514 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.726686 21514 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:12.727717 21507 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:12.728225 21507 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.649881 21450 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.730167 21450 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.737241 21507 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.738584 21507 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.742952 21444 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.718832 21519 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.751668 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.701185 15803 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:12.756911 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 55792us
I20260709 12:26:12.757920 15803 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.754473 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.774667 15803 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.777155 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.778208 15803 leader_election.cc:304] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.779253 15803 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.776161 21509 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.783953 15950 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.780082 21524 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.782856 21395 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.791563 21445 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.792043 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:12.792680 21445 consensus_queue.cc:1048] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:12.783815 15803 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.796918 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.793206 21503 consensus_queue.cc:1059] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:12.801342 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:12.802533 15803 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.776449 21488 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.813380 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.782858 21510 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.817939 21524 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.815213 21486 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.845683 21486 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:12.815146 21414 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:12.814245 21395 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.811564 21419 consensus_queue.cc:1059] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:26:12.833956 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:12.806468 21446 consensus_queue.cc:1059] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:26:12.837965 21492 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.783510 21523 raft_consensus.cc:2749] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.801703 21497 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:12.853546 21419 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:12.853808 21466 raft_consensus.cc:3055] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:12.853992 21419 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:12.854367 21466 raft_consensus.cc:740] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:12.854987 21419 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.855309 21466 consensus_queue.cc:260] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.846482 21486 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.849208 21414 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:12.856340 21419 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.856642 21414 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.812636 21519 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:12.857097 21527 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:26:12.856691 21466 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.856693 21486 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:12.871801 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 58489.9us
I20260709 12:26:12.873464 15803 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.862015 21448 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:26:12.878690 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 48778.1us
I20260709 12:26:12.878839 15837 raft_consensus.cc:1240] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:12.885071 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.888401 15911 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:26:12.893834 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.887164 21524 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.900049 21497 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:12.902066 21497 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:12.905189 21414 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.906183 21518 consensus_queue.cc:1059] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:12.907832 21414 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:12.905694 21524 raft_consensus.cc:993] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:12.909775 21524 raft_consensus.cc:1081] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:12.911693 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:12.901806 15803 leader_election.cc:304] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.912189 15906 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.912549 15906 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:12.913610 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:12.914338 15831 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.915452 15803 leader_election.cc:304] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:12.920979 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b991ff9e213435786d19248864c5cfc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:12.921169 21524 raft_consensus.cc:2749] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:12.922488 21492 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:12.923134 21523 consensus_queue.cc:1059] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:12.923851 21523 consensus_queue.cc:1243] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:26:12.924352 21523 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:12.924652 21523 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:12.925540 21523 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:12.926820 21523 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.928465 15906 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.932112 15906 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:12.932716 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:12.933306 15979 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:12.922621 15878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.950938 15984 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:12.952548 21469 consensus_queue.cc:1059] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:12.953293 21444 raft_consensus.cc:3055] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:12.953637 21444 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.954398 21444 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.955469 21444 raft_consensus.cc:3060] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.962916 21511 raft_consensus.cc:3055] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.963403 21511 raft_consensus.cc:740] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:12.964325 21511 consensus_queue.cc:260] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.966361 21511 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.978075 21466 raft_consensus.cc:993] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:12.978659 21466 raft_consensus.cc:1081] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:12.980224 15911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:12.980732 15911 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.981271 15911 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.990785 15979 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:26:12.991734 21491 raft_consensus.cc:993] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:12.991947 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:12.992306 21491 raft_consensus.cc:1081] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:12.992753 21473 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:12.993372 21473 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:12.994313 21473 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:12.995061 15904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:12.995572 15904 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.995886 15904 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:12.998358 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82974.7us
I20260709 12:26:12.999267 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:13.000398 15803 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:13.003136 15876 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:13.004281 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:13.004570 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.005179 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.008083 16494 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:13.005478 16495 raft_consensus.cc:1240] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:26:13.009559 15987 raft_consensus.cc:1240] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:13.012506 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.012904 15988 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:12.997682 21524 raft_consensus.cc:2749] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.013370 21462 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:13.014110 21462 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:13.013386 21492 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:13.015468 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.005371 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.019071 21497 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:13.021531 15979 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:26:13.026423 15984 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:13.032184 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:13.033974 15830 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:13.031500 15904 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.034303 15830 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.035331 15982 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 12.
I20260709 12:26:13.036633 15733 catalog_manager.cc:5697] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 18 to 20, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 20 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.006776 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:13.038580 15733 catalog_manager.cc:5697] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 12 to 13, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 13 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.040050 15733 catalog_manager.cc:5697] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 13 to 14, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:13.036741 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:13.042232 15837 raft_consensus.cc:2410] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:26:13.042500 15831 raft_consensus.cc:2468] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:13.043211 15832 raft_consensus.cc:1240] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:26:13.043299 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:13.045436 15950 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:13.035276 15830 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.046492 15830 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:13.047488 21492 consensus_queue.cc:1175] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" responder_term: 10 status { last_received { term: 9 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:13.059131 15830 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
I20260709 12:26:13.061841 15904 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:13.062184 16489 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:13.062899 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.067276 15980 raft_consensus.cc:3055] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:13.061601 15911 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.074160 15906 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:26:13.074580 15906 pending_rounds.cc:85] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 14
I20260709 12:26:13.074849 15906 pending_rounds.cc:107] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:26:13.067682 15980 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:13.076865 15803 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:13.077648 15980 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.078311 15906 raft_consensus.cc:2889] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:13.066807 21414 raft_consensus.cc:2804] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:13.083877 21520 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:13.084177 21414 raft_consensus.cc:697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:13.085160 15980 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.085290 21414 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.076759 21524 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:26:13.095970 21524 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:13.090798 21523 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:13.096323 21524 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.097348 16489 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:13.097213 21524 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.096791 21523 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.098332 21524 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:13.098783 21471 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:13.098896 21523 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.100412 15982 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:13.107815 15879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.109555 15837 raft_consensus.cc:1275] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 20 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:13.090502 15803 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:13.115200 15731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 281) took 2056 ms. Trace:
I20260709 12:26:13.121223 15731 rpcz_store.cc:276] 0709 12:26:11.059215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.104234 (+ 45019us) service_pool.cc:224] Handling call
0709 12:26:13.115111 (+2010877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147,"reported_tablets":49,"spinlock_wait_cycles":2432}
I20260709 12:26:13.128137 15803 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:13.129976 15980 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:13.131352 15879 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:13.136981 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:13.141407 15911 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:13.143215 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:13.143821 15980 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:13.144104 15980 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:13.113426 21450 consensus_queue.cc:1048] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:26:13.144742 15980 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.146091 15803 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:13.151788 15984 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:13.153883 15980 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:13.128882 21492 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:13.159005 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:13.167469 15830 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:13.135392 21514 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:13.160584 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:13.172658 15837 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.143332 21444 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:13.157259 21395 raft_consensus.cc:2749] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:13.244338 15980 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:13.249945 15830 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:13.153206 21497 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:26:13.165382 21473 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:26:13.180205 21444 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:13.257718 15986 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
W20260709 12:26:13.266227 21533 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:26:13.169785 21488 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:13.282577 15876 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:13.308933 21469 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:13.312427 21469 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:13.313422 21469 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.283974 21492 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.284895 21514 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.303684 15830 raft_consensus.cc:1240] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:13.309514 21444 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.316289 21492 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.316306 21514 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.317154 21541 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:13.317577 21541 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.318379 21541 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.291508 15837 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:13.339121 21541 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:13.351816 15803 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:13.353513 21488 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.361512 21509 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:26:13.375372 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 91459.2us
I20260709 12:26:13.395838 15831 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:26:13.396239 15831 pending_rounds.cc:85] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Aborting all ops after (but not including) 10
I20260709 12:26:13.396476 15831 pending_rounds.cc:107] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:26:13.396706 15831 raft_consensus.cc:2889] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:13.398384 21507 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:13.398957 21507 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.400616 21473 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:13.404187 21507 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:13.372996 21467 consensus_queue.cc:1059] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:26:13.406436 21467 raft_consensus.cc:3055] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:13.406786 21467 raft_consensus.cc:740] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:13.407619 21467 consensus_queue.cc:260] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.409358 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:13.413555 15835 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
W20260709 12:26:13.425484 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 70095.6us
I20260709 12:26:13.427142 16489 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:13.409008 21467 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:13.422924 21488 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.460865 15986 raft_consensus.cc:1240] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Rejecting Update request from peer 9fd62f0fa06a4561a0a7101b85942f86 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:13.463927 21519 consensus_queue.cc:1059] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:13.466522 21449 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.467011 21449 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.454190 21509 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.470002 21449 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:13.471081 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:13.471714 15837 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:13.472695 15906 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:13.472745 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:13.478533 15984 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:13.484422 21443 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:13.480945 21548 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:13.486687 21548 raft_consensus.cc:493] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.487011 21548 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.470731 21509 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.480772 21471 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:26:13.464920 21519 raft_consensus.cc:3055] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:13.497996 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:13.498442 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:13.498594 15984 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
W20260709 12:26:13.499771 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 143707us
I20260709 12:26:13.501816 16489 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:13.504710 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:13.505335 15904 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:13.502494 16495 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 18: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:13.496125 21519 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:13.523746 21519 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:13.537307 21519 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.544005 21548 raft_consensus.cc:515] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.546033 21548 leader_election.cc:290] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:13.593637 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 91834.1us
I20260709 12:26:13.596208 15879 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:13.602552 15830 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:13.606356 15835 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:13.610972 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:13.612339 15832 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.614773 16486 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:13.618178 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661598743dad4055844a0b0f97c07156" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:13.619066 15904 raft_consensus.cc:3060] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.639125 21462 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:13.679800 21511 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:13.690779 21446 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:13.636806 21564 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
W20260709 12:26:13.693410 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52963.7us
I20260709 12:26:13.658397 21462 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:13.710306 21462 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:13.726105 15982 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:13.735679 15906 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:13.741127 21554 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.743855 21446 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:13.744431 21554 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:13.751130 15832 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:26:13.754585 16457 leader_election.cc:304] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:13.756332 21428 raft_consensus.cc:2804] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:13.757063 21428 raft_consensus.cc:697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:13.758769 21428 consensus_queue.cc:237] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.764340 15904 raft_consensus.cc:2468] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:26:13.778206 15980 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:13.784435 21473 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:13.790903 21518 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 4 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:13.804541 15908 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 4 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:13.812674 15980 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:13.797181 21473 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.822039 21492 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.825310 15986 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:13.816871 21473 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:13.832123 15731 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.844841 15733 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 181) took 1063 ms. Trace:
I20260709 12:26:13.845394 15733 rpcz_store.cc:276] 0709 12:26:12.780714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.780962 (+   248us) service_pool.cc:224] Handling call
0709 12:26:13.844527 (+1063565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:13.268388 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:13.294797 (+ 26409us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:13.294831 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:26:13.294848 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:13.295348 (+   500us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:13.295420 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:13.295453 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:13.295748 (+   295us) tablet.cc:701] Row locks acquired
0709 12:26:13.295764 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:13.295894 (+   130us) write_op.cc:270] Start()
0709 12:26:13.295999 (+   105us) write_op.cc:276] Timestamp: P: 1783599973295846 usec, L: 0
0709 12:26:13.296017 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:26:13.296634 (+   617us) log.cc:844] Serialized 1289 byte log entry
0709 12:26:13.528188 (+231554us) op_driver.cc:464] REPLICATION: finished
0709 12:26:13.548623 (+ 20435us) write_op.cc:301] APPLY: starting
0709 12:26:13.548738 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:13.692950 (+144212us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:13.693164 (+   214us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:13.696119 (+  2955us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:13.696485 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:26:13.696585 (+   100us) write_op.cc:312] APPLY: finished
0709 12:26:13.709679 (+ 13094us) log.cc:844] Serialized 41 byte log entry
0709 12:26:13.769014 (+ 59335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:13.818149 (+ 49135us) write_op.cc:454] Released schema lock
0709 12:26:13.818236 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:13.819002 (+   766us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:13.819048 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64652,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":20143,"apply.run_cpu_time_us":9526,"apply.run_wall_time_us":270232,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16625,"num_ops":3,"prepare.queue_time_us":196777,"prepare.run_cpu_time_us":3008,"prepare.run_wall_time_us":29565,"replication_time_us":232008,"thread_start_us":115163,"threads_started":2}]]}
W20260709 12:26:13.870194 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 53011.5us
I20260709 12:26:13.874681 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:13.875674 15907 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:13.875898 16489 raft_consensus.cc:2393] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 15: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:26:13.879204 15906 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:13.879770 21451 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:13.880514 15909 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.883543 21492 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:26:13.906941 15906 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:13.914606 21450 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.915376 21450 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.917574 21486 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:13.918320 21486 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.929760 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:13.939349 16486 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:13.951167 15980 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:13.950999 21488 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:13.908838 21554 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.956662 21554 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:13.957084 21519 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:26:13.958945 21554 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:13.962363 15909 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:13.985364 15907 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:13.998822 15832 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:26:14.001341 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:13.976801 21462 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.001822 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.014868 15909 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 18.
I20260709 12:26:14.018201 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:13.989125 21488 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:26:14.029237 15908 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:14.031718 15879 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:14.042157 15830 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
W20260709 12:26:14.082939 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 51299.8us
I20260709 12:26:14.020121 21473 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:26:14.026635 16489 raft_consensus.cc:2955] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 4 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:14.093916 15906 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:14.098546 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 63567.4us
I20260709 12:26:14.103267 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.079170 21450 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.097911 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:14.087190 21486 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.111333 15906 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:26:14.115381 15836 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:14.115317 21509 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:26:14.115651 21466 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:14.116302 15987 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:26:14.116464 21466 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:14.117156 21576 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:14.117481 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:14.117687 21553 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:26:14.113852 16486 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:14.119546 21469 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.119596 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:14.120602 15985 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 18.
I20260709 12:26:14.121166 15834 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:26:14.124792 21570 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:26:14.124996 21462 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.118948 21466 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:14.137590 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:14.158408 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51978.7us
I20260709 12:26:14.166002 21518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43658 (request call id 93) took 1064 ms. Trace:
I20260709 12:26:14.166440 21518 rpcz_store.cc:276] 0709 12:26:13.092800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.093302 (+   502us) service_pool.cc:224] Handling call
0709 12:26:13.106240 (+ 12938us) log.cc:844] Serialized 494 byte log entry
0709 12:26:13.450524 (+344284us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b2c00013588. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cab9ca11 00007f03cababa0a 00007f03cabab693 00007f03cabab631 00007f03cc2dfb52 00007f03cc2dfcf5 00007f03cc21c691 00007f03cc1fceaa 00007f03cc203d53 00007f03cc203cd9 00007f03cc203c69
0709 12:26:13.468377 (+ 17853us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b180025c860. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20c571 00007f03cc2dfd01 00007f03cc21c691 00007f03cc1fceaa 00007f03cc203d53 00007f03cc203cd9 00007f03cc203c69 00007f03cc203c31 00007f03cc202dfd 0000000000388634 0000000000388479
0709 12:26:14.113386 (+645009us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3772,"raft.run_cpu_time_us":5153,"raft.run_wall_time_us":415181,"spinlock_wait_cycles":431687424,"thread_start_us":162648,"threads_started":1,"wal-append.queue_time_us":206211}
I20260709 12:26:14.169284 21443 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:14.170436 15984 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:26:14.170746 21443 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:14.171267 21443 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:14.167806 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 53298.9us
I20260709 12:26:14.174435 21507 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:14.174907 21507 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.175333 21507 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.177273 16460 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:14.179224 21574 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
W20260709 12:26:14.180984 21577 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:26:14.182129 21565 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.182237 21471 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:14.182905 15730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 286) took 1289 ms. Trace:
I20260709 12:26:14.182821 21565 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.183347 15730 rpcz_store.cc:276] 0709 12:26:12.893647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.893769 (+   122us) service_pool.cc:224] Handling call
0709 12:26:12.952926 (+ 59157us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b540017c854. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03cc20d090 00007f03cc2abf3a 00007f03d2061e9c 00007f03d216004e 00007f03d06212a4 00007f03d0621232 00007f03d0621161 00007f03d06210dc 00007f03d0620392 00007f03ca5de48c 00007f03ca5dd8c6
0709 12:26:14.182713 (+1229787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80149,"reported_tablets":3,"spinlock_wait_cycles":36715008}
I20260709 12:26:14.144068 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.189330 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:14.192549 16486 raft_consensus.cc:2393] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 18: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:14.189426 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.197504 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:14.192929 21473 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:26:14.218152 21467 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:14.218274 21568 log.cc:927] Time spent T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:26:14.218822 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7cbb40ff3a44403a8705489ecc556e3b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.222761 21541 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:26:14.224427 21579 log.cc:927] Time spent T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:26:14.234869 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.216334 15837 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:14.217684 21565 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.253628 21566 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.254169 21566 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.256385 21566 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:14.258380 21469 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:14.263963 21507 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.266194 21507 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.266713 15985 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:14.267526 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.261559 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.270574 15908 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 14: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:26:14.272853 21580 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:26:14.250201 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:14.276684 21443 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.293322 21443 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.297966 15837 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:26:14.305048 21469 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:14.314692 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 64575.7us
I20260709 12:26:14.316689 21466 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.317092 21466 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:14.317480 21466 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:14.324290 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 143333us
I20260709 12:26:14.338987 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:14.341004 21428 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:14.352741 21428 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.353157 21428 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.370465 15909 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:26:14.379678 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 186269us
I20260709 12:26:14.384366 15835 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:14.403429 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.417272 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:14.417946 15832 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.413872 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:14.436564 21596 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:14.437134 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:14.437714 16494 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.434331 15984 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
I20260709 12:26:14.449519 21395 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:26:14.434052 21519 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:14.461308 21519 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.464555 21467 raft_consensus.cc:493] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.465107 21467 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.469928 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:14.474363 16486 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:14.464828 21591 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:14.476007 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 54233.1us
I20260709 12:26:14.480470 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:14.491736 21591 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.498421 15832 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:14.503175 15879 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:14.465463 21428 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.512445 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:14.513327 16489 raft_consensus.cc:2393] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 13: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:14.594502 21428 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:14.607420 21497 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.608112 21497 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.609642 21585 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.610266 21497 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.610380 21585 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.618237 21510 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:14.618831 21510 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.512266 21565 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.635279 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:14.640343 15837 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:14.636217 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:14.620800 21510 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.645859 21591 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.646166 15904 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:14.647454 16494 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:14.655721 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:14.656234 15830 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.661630 15907 raft_consensus.cc:1275] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:14.586018 21596 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:14.644285 21565 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.677199 21466 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.679656 21596 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.663648 21519 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.692396 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.667707 21450 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.696589 21450 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.699329 21450 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.683662 21565 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.707700 21596 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.711885 21565 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.715729 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:14.716015 21565 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.716426 15832 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.717792 15909 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.732700 15830 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:14.733783 15832 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:14.739507 21466 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:14.742756 16457 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:14.754012 15952 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:14.767818 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:14.773392 15837 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:14.774659 15909 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:14.799752 15830 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:26:14.800088 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:14.800925 15876 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:14.831452 15876 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:14.834483 16494 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 16.
I20260709 12:26:14.834533 21449 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:14.835359 21449 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:14.778117 21591 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.838081 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:14.830624 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:14.841709 15876 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:14.846792 21444 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:14.847493 21444 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:14.848007 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:14.836532 21449 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.797624 21585 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:14.773828 21467 raft_consensus.cc:515] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.848831 15979 raft_consensus.cc:2393] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:14.840045 21473 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:14.852039 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.882737 15909 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
W20260709 12:26:14.850366 21600 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:14.889235 21467 leader_election.cc:290] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:14.856122 21507 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:14.890020 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.880594 21451 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.848752 21444 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.889847 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:14.853956 21491 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:14.844537 21599 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.909226 15907 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:14.914263 21419 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:14.914902 21419 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.841461 21591 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.853828 21590 consensus_queue.cc:1048] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:26:14.921134 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:14.896350 21473 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:14.929778 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.911098 21507 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:14.912910 21491 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:14.913151 21451 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:14.939842 21507 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.942370 21419 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:14.940898 15803 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
W20260709 12:26:14.943290 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 59805.8us
I20260709 12:26:14.944728 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.945379 15911 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 17.
I20260709 12:26:14.945427 21519 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:14.945950 21519 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.935768 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:14.946305 21519 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:14.949343 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:14.950819 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:14.951717 15980 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:14.953610 15911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:14.931468 21585 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:14.960844 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74374us
I20260709 12:26:14.965109 15908 raft_consensus.cc:2393] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 14: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:14.964977 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:14.965615 15985 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.972901 15803 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:15.013484 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:14.928386 21599 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:14.979224 21566 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.972585 21450 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.053700 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:14.967278 21585 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.060874 15986 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.047793 21541 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:15.046083 21444 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:26:15.094760 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 138179us
I20260709 12:26:15.042871 21509 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:26:15.046617 21497 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.058084 21566 raft_consensus.cc:493] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.066992 21585 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:15.099874 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.119206 15985 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:15.103340 21566 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.073992 21450 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:15.121224 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 74171.6us
I20260709 12:26:15.187915 16494 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:26:15.189567 21451 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.190815 21553 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:15.191406 21553 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.191671 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:15.195578 21553 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.108338 21497 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:15.201123 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 138960us
I20260709 12:26:15.206020 21497 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.209625 21599 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:15.189989 21602 log.cc:927] Time spent T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:26:15.102054 21491 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.103796 21473 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.121707 21444 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:15.275663 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 147861us
I20260709 12:26:15.280083 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:15.282846 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
W20260709 12:26:15.282943 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 150758us
I20260709 12:26:15.283507 15830 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:15.287264 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.287926 15981 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:15.278968 21450 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.280921 21553 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:15.287295 21613 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:15.338843 15830 raft_consensus.cc:2468] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:15.322057 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:15.350735 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:26:15.351511 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 71498.1us
I20260709 12:26:15.363415 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.363605 21505 raft_consensus.cc:493] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:15.364120 15988 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 10.
I20260709 12:26:15.364289 21505 raft_consensus.cc:515] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.366509 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.367009 21505 leader_election.cc:290] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:15.364326 21592 log.cc:927] Time spent T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.873s	user 0.011s	sys 0.011s
I20260709 12:26:15.368917 15906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 1961) took 1168 ms. Trace:
I20260709 12:26:15.369304 15906 rpcz_store.cc:276] 0709 12:26:14.202621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.207235 (+  4614us) service_pool.cc:224] Handling call
0709 12:26:14.207552 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:14.234742 (+ 27190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:14.234771 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:14.246550 (+ 11779us) log.cc:844] Serialized 26 byte log entry
0709 12:26:14.367535 (+120985us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:14.367576 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.367642 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:15.363633 (+995991us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b4400022b4c. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03c903edb1 00007f03c90dcc85 00007f03c90dd6a2 00007f03cbe4f1db 00007f03cbe4aaaf 00007f03cbe3e86e 00007f03cbe3dbb6 00007f03cbe3d7d8 00007f03cbe47221 00007f03cbe471d9 00007f03cbe47169
0709 12:26:15.368601 (+  4968us) raft_consensus.cc:1685] finished
0709 12:26:15.368633 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:15.368844 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100,"raft.queue_time_us":2455,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":289132416,"thread_start_us":82010,"threads_started":1,"wal-append.queue_time_us":161822}
I20260709 12:26:15.376001 21419 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.376721 16457 leader_election.cc:304] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:15.376533 21419 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.379984 15986 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:15.384354 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.391664 21557 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:15.392078 21557 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:15.392465 21557 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:15.361461 21591 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:15.384963 15988 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 10.
I20260709 12:26:15.354530 21444 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:15.411240 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 98778.6us
I20260709 12:26:15.406554 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:15.405648 21590 raft_consensus.cc:2804] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:15.423185 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.423794 15831 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
W20260709 12:26:15.430850 21609 log.cc:927] Time spent T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:26:15.440989 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.441654 15830 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 14.
I20260709 12:26:15.442807 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.443094 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.443488 15830 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:15.443722 15835 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:15.446969 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:15.447352 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.374305 21553 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.408483 21566 raft_consensus.cc:515] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.449383 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:15.419485 21519 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.452487 15835 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:26:15.465051 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 416692us
I20260709 12:26:15.454227 15876 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:15.457223 21565 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:15.470664 15802 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:15.460371 21566 leader_election.cc:290] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.462054 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:15.471585 15908 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.462641 21590 raft_consensus.cc:697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:15.472949 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:15.474598 21471 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:15.475064 21471 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.475517 21471 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:15.458076 21578 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:15.477378 21578 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.480000 21578 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.472476 21565 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.532702 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c971bd20d548a8a1dd8f98022a1f7e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:15.540145 21510 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:15.494078 21458 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:15.492532 21619 raft_consensus.cc:493] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
W20260709 12:26:15.549619 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 127775us
I20260709 12:26:15.464998 21585 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.550498 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.553856 15831 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:15.542626 21565 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:15.566748 15985 raft_consensus.cc:2393] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:15.554662 16457 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:15.550119 21458 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:15.581907 21458 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:15.582281 21519 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:15.583338 21419 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:15.584194 21626 log.cc:927] Time spent T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:26:15.553238 21471 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.587033 21471 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:15.587659 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.571492 21566 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:15.588907 21619 raft_consensus.cc:515] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.589576 21566 raft_consensus.cc:493] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.590019 21566 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:15.590809 21616 raft_consensus.cc:2749] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:15.578687 21585 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:15.540926 21510 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.591428 21619 leader_election.cc:290] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.602982 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:15.608671 21590 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.610153 21553 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.623448 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:15.622004 21557 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.626611 15984 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:15.628456 21557 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.628628 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.629678 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:15.630419 15980 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 11: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:15.631665 15981 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:15.634685 15833 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:15.638031 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.638304 21510 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:15.638916 15837 raft_consensus.cc:2393] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 11: Already voted for candidate 9fd62f0fa06a4561a0a7101b85942f86 in this term.
I20260709 12:26:15.643276 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79a04e9fda24da8a4ca30980a0ef796" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:15.644399 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:15.644956 15905 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 14.
I20260709 12:26:15.645816 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4fafd7ec404ad9b05209ed0c8c1a19" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:15.621294 21634 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:15.646492 21634 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.648674 21634 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.650041 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:15.650269 15904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:15.650559 15909 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:15.651927 21458 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.652885 15907 raft_consensus.cc:1240] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:15.654016 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:15.667666 15909 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 18.
I20260709 12:26:15.648428 15729 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 13 to 14, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 14 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:15.669157 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 56301.1us
I20260709 12:26:15.673445 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:15.675562 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.674568 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:15.674052 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:15.683403 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 329291us
I20260709 12:26:15.687801 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:15.688016 15908 raft_consensus.cc:2468] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:15.689435 16459 leader_election.cc:304] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:15.691030 15912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:15.691668 15912 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:15.697769 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b6f7dc34f48babcf3d91d76eecc59" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:15.698486 15838 raft_consensus.cc:3060] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:15.697796 15802 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:15.705750 15802 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:15.707298 21505 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:15.707823 21505 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:15.708359 21473 consensus_queue.cc:1059] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:15.708989 15838 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:15.709198 21613 raft_consensus.cc:3055] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:15.709789 21613 raft_consensus.cc:740] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:15.709890 21603 raft_consensus.cc:2764] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:26:15.709127 21505 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.710662 21613 consensus_queue.cc:260] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.711103 21473 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:15.712126 21613 raft_consensus.cc:3060] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:15.724088 21445 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:15.724614 21445 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:15.725521 21445 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.727962 21443 consensus_queue.cc:1059] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:15.729333 21585 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:15.729713 21585 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:15.730579 21585 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.731875 21585 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:15.732249 21565 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.734371 21633 raft_consensus.cc:2804] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:15.734937 21633 raft_consensus.cc:697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:15.735886 21633 consensus_queue.cc:237] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.738008 21566 raft_consensus.cc:515] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.740257 21566 leader_election.cc:290] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.740451 15803 leader_election.cc:304] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:15.742681 15912 raft_consensus.cc:2468] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:15.743968 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:15.720278 21599 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:15.746069 21599 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.748241 21599 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:15.744014 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:15.751432 16495 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:26:15.752684 15952 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:15.753585 21567 raft_consensus.cc:2804] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:15.754122 21567 raft_consensus.cc:697] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:15.755239 21567 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:15.759374 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879e5f4abbab45deb735e1ae9ae2d204" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.759670 21458 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.760815 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.761518 15907 raft_consensus.cc:1240] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:15.761722 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727a5c8856c46cba501e397d6c1fc7b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:15.779304 15985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:15.782879 15803 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:15.781306 15985 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:15.785677 15803 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:15.780396 16495 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 18.
I20260709 12:26:15.797560 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:15.800431 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7327c39306430dbeb82a9c27813987" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:15.801069 15836 raft_consensus.cc:3060] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:15.804775 21623 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:26:15.803649 21557 consensus_queue.cc:1059] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:26:15.812007 15835 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:26:15.803421 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:15.776523 21519 raft_consensus.cc:2749] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:15.815626 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:15.822708 15985 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:15.816054 16487 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:26:15.826270 15953 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:15.828179 21581 raft_consensus.cc:2764] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:26:15.827649 15953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.799361 21497 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:15.837930 15953 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:15.841892 16492 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:15.834139 21617 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:15.834319 21449 raft_consensus.cc:3055] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:15.801669 15984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:15.849251 15984 raft_consensus.cc:606] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:15.850746 21414 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:15.853904 21414 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.854328 21414 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:15.856417 21645 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:26:15.859923 21565 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:15.866731 21414 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.867385 21617 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:15.868685 21617 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.886276 15836 raft_consensus.cc:2468] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:15.850246 21449 raft_consensus.cc:740] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:15.897415 16460 leader_election.cc:304] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:15.892836 21488 raft_consensus.cc:2764] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:15.907073 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:15.905184 21632 raft_consensus.cc:2804] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:15.945307 21449 consensus_queue.cc:260] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:15.986128 21603 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:26:15.991617 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 72085us
I20260709 12:26:15.995662 21449 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:15.998062 21414 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:15.998793 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:15.999403 15837 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:16.004313 15984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:16.004931 15984 raft_consensus.cc:606] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:15.986783 21603 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.012131 15837 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:16.013489 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:15.918700 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 103908us
I20260709 12:26:16.015653 21414 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:16.016204 21414 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:16.019641 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:16.019495 21414 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:16.009301 21632 raft_consensus.cc:697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:16.029778 21632 consensus_queue.cc:237] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:16.033533 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 116777us
W20260709 12:26:16.036798 15876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.039227 15981 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:16.043502 21603 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:16.046677 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:16.058351 15908 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:16.062386 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47438.7us
I20260709 12:26:16.094907 15803 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.053347 21642 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:16.095974 15803 leader_election.cc:304] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.105733 21541 raft_consensus.cc:2749] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:16.107306 15835 raft_consensus.cc:1240] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Rejecting Update request from peer 761f08e40cdf4af396105d67949c0afc for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:16.108563 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:16.111171 15837 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:16.111776 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:16.097183 21603 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:16.110914 21642 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.163686 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:16.257567 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e271b9d1bc8403ba1c9d3e80c36917c"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:16.258311 15982 raft_consensus.cc:606] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:16.258699 15982 raft_consensus.cc:614] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:16.259895 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 111284us
I20260709 12:26:16.263410 16487 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:16.274751 16487 raft_consensus.cc:1240] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:16.265995 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:16.278172 21615 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:16.281737 21623 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:16.282213 21623 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:16.283125 21623 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.286832 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:16.290148 15982 raft_consensus.cc:606] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:16.338570 21581 consensus_queue.cc:1059] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:26:16.341810 21581 consensus_queue.cc:1243] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 2fa3925738bd485e912c7ac0e28b0265 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:26:16.342386 21581 raft_consensus.cc:3055] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:16.342756 21581 raft_consensus.cc:740] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:16.357954 15983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:16.358623 15983 raft_consensus.cc:606] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:16.359021 15983 raft_consensus.cc:614] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:16.367722 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:16.370033 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:16.371258 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:16.371765 15876 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.373263 15838 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:26:16.373606 16457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.373843 21614 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:16.374410 15837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:16.375974 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e7dbc561f4f4c5da63c0d84e92b9871" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:16.376703 15835 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:16.382547 15909 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:16.392088 15803 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.399971 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:16.396848 15835 raft_consensus.cc:2468] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:16.409837 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8f740585214d0fb73ad203c56cbaaf" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:16.415091 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:16.417676 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:16.355566 21639 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:26:16.388213 21581 consensus_queue.cc:260] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:16.429529 21581 raft_consensus.cc:3060] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.391260 21633 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:26:16.415367 21619 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:16.470955 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 97420.8us
I20260709 12:26:16.471812 15876 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:16.478618 15909 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:26:16.479024 15909 pending_rounds.cc:85] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Aborting all ops after (but not including) 12
I20260709 12:26:16.479251 15909 pending_rounds.cc:107] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:26:16.485703 15909 raft_consensus.cc:2889] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:16.490121 21472 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:16.497160 21564 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:16.497773 21564 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.498791 21623 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:16.500041 21564 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:16.512140 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:16.514432 15984 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:16.516963 21628 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:16.521979 15832 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:16.525373 15832 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:16.546375 15876 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.547605 21458 raft_consensus.cc:2804] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:16.548067 21458 raft_consensus.cc:697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:16.551697 15832 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:16.554709 15984 raft_consensus.cc:1275] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:26:16.555163 15984 pending_rounds.cc:85] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 10
I20260709 12:26:16.555383 15984 pending_rounds.cc:107] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:26:16.555608 15984 raft_consensus.cc:2889] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:16.561012 15906 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:16.548915 21458 consensus_queue.cc:237] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.561691 21628 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:26:16.548810 21623 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 12:26:16.614369 15950 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.629659 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:16.652249 15952 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:16.653265 15909 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:16.660575 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.561820 21566 consensus_queue.cc:1059] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:26:16.662984 21639 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:16.663630 16489 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:16.587836 21603 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:26:16.665547 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86" is_pre_election: true
I20260709 12:26:16.663908 21518 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:16.671821 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.562668 21581 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 12:26:16.677140 21583 raft_consensus.cc:993] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:16.697578 15986 raft_consensus.cc:1275] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:26:16.695811 21661 log.cc:927] Time spent T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:26:16.660960 21596 consensus_queue.cc:1048] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:26:16.690052 21488 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:16.689801 21642 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:16.723573 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 137702us
I20260709 12:26:16.713743 21583 raft_consensus.cc:1081] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:16.715873 15803 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.713536 21491 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:16.745158 21585 raft_consensus.cc:993] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:16.745690 21585 raft_consensus.cc:1081] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:16.756316 15907 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:16.762662 15876 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:16.766034 15986 raft_consensus.cc:1240] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Rejecting Update request from peer 2fa3925738bd485e912c7ac0e28b0265 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:16.749686 21619 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:16.765363 21565 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:16.768146 21628 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:16.775624 21628 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:16.775666 15830 raft_consensus.cc:1240] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:16.776659 21628 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:16.777842 21628 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:16.768100 21566 consensus_queue.cc:1048] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:16.765739 21488 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:26:16.785275 15913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:16.785974 15913 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.786298 15913 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:16.812705 21677 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:16.813532 21677 consensus_queue.cc:1243] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer 761f08e40cdf4af396105d67949c0afc log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:26:16.818022 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 47468.5us
I20260709 12:26:16.818883 15913 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:16.824143 15913 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:16.828660 15913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:16.829260 15913 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.833197 21675 consensus_queue.cc:1059] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:16.848160 15907 raft_consensus.cc:1240] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Rejecting Update request from peer b5f0a13b879f47dd804f8fc4b7b19a0a for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:16.849684 21486 consensus_queue.cc:1059] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:16.850689 21486 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:16.850840 21581 raft_consensus.cc:3055] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:16.851081 21486 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:16.851329 21581 raft_consensus.cc:740] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:16.852198 21581 consensus_queue.cc:260] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.856056 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:16.863435 15913 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:16.873991 15913 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:16.852082 21486 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:16.879285 15984 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:16.825620 21588 raft_consensus.cc:993] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:16.887800 21414 raft_consensus.cc:1081] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:16.891618 21581 raft_consensus.cc:3060] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:16.901283 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:16.901868 15838 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:16.904202 15835 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:16.906090 21486 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:16.911449 15835 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:16.914124 15838 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:16.915215 15913 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:16.927912 15876 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:16.929771 21564 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:16.931491 21564 raft_consensus.cc:2804] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:16.932350 21564 raft_consensus.cc:697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:16.938508 16492 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:26:16.939013 16492 pending_rounds.cc:85] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Aborting all ops after (but not including) 10
I20260709 12:26:16.939304 16492 pending_rounds.cc:107] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:26:16.939600 16492 raft_consensus.cc:2889] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:16.980744 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 101920us
I20260709 12:26:16.977579 21677 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:26:17.000398 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed21b81727749c4aa09fa4278bc8398" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:17.001004 15980 raft_consensus.cc:3055] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:17.003050 16492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:17.001297 15980 raft_consensus.cc:740] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:17.003782 16492 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:17.020269 15980 consensus_queue.cc:260] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:17.021564 15980 raft_consensus.cc:3060] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:17.024250 15909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:17.024799 15909 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.025169 15909 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:17.030251 15731 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 14 to 15, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.015255 21564 consensus_queue.cc:237] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:17.032964 15731 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 17 to 18, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 18 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.034463 15731 catalog_manager.cc:5697] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 13 to 15, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 15 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.026163 21618 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:17.037484 21618 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:17.040874 21689 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:26:17.042521 15729 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54804 (request call id 280) took 4059 ms. Trace:
I20260709 12:26:17.045449 21618 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:17.042867 15729 rpcz_store.cc:276] 0709 12:26:12.983329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.983455 (+   126us) service_pool.cc:224] Handling call
0709 12:26:17.042437 (+4058982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:15.869994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:15.970486 (+100492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:15.970530 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:26:15.970549 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:16.005837 (+ 35288us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:16.005947 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:16.005979 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:16.006285 (+   306us) tablet.cc:701] Row locks acquired
0709 12:26:16.006305 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:16.006533 (+   228us) write_op.cc:270] Start()
0709 12:26:16.006777 (+   244us) write_op.cc:276] Timestamp: P: 1783599976006463 usec, L: 0
0709 12:26:16.006804 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:26:16.007850 (+  1046us) log.cc:844] Serialized 533 byte log entry
0709 12:26:16.630375 (+622525us) op_driver.cc:464] REPLICATION: finished
0709 12:26:16.841538 (+211163us) write_op.cc:301] APPLY: starting
0709 12:26:16.841648 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:16.842806 (+  1158us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:16.842934 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:16.843792 (+   858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:16.844029 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:16.844095 (+    66us) write_op.cc:312] APPLY: finished
0709 12:26:16.844298 (+   203us) log.cc:844] Serialized 25 byte log entry
0709 12:26:16.844457 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:16.844579 (+   122us) write_op.cc:454] Released schema lock
0709 12:26:16.844631 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:16.857667 (+ 13036us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:16.865908 (+  8241us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47963,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":188525,"apply.run_cpu_time_us":3545,"apply.run_wall_time_us":3552,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8293,"num_ops":1,"prepare.queue_time_us":90570,"prepare.run_cpu_time_us":39119,"prepare.run_wall_time_us":266300,"raft.queue_time_us":179917,"raft.run_cpu_time_us":23324,"raft.run_wall_time_us":246489,"replication_time_us":572269,"thread_start_us":350996,"threads_started":4,"wal-append.queue_time_us":279082}]]}
I20260709 12:26:17.048513 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:17.049944 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:17.065744 15802 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:17.066814 21619 raft_consensus.cc:2749] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.094707 15979 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:17.100066 21612 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:17.115996 15833 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:17.124563 15980 raft_consensus.cc:2468] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:17.131889 15909 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.134084 21518 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:17.135922 15909 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:17.145321 16492 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:17.157915 15879 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
W20260709 12:26:17.164698 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 120922us
I20260709 12:26:17.171056 15980 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:26:17.171473 15980 pending_rounds.cc:85] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting all ops after (but not including) 8
I20260709 12:26:17.171715 15980 pending_rounds.cc:107] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:26:17.171931 15980 raft_consensus.cc:2889] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:17.171994 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:17.172845 15982 raft_consensus.cc:3055] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:17.173874 15982 raft_consensus.cc:740] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:17.182070 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:17.185796 21458 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:17.166345 21623 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:17.190800 21623 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:17.191778 21623 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.205413 15982 consensus_queue.cc:260] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.206753 15982 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:17.205467 15832 raft_consensus.cc:1275] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:26:17.219154 21695 log.cc:927] Time spent T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:26:17.233709 21639 consensus_queue.cc:1048] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:26:17.235138 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 51507.5us
I20260709 12:26:17.243899 15731 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34080 (request call id 182) took 3228 ms. Trace:
I20260709 12:26:17.279098 15982 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
W20260709 12:26:17.279526 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 74864.9us
I20260709 12:26:17.250082 15733 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 14 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.282797 15733 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 11 to 12, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.284161 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:17.284827 15733 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 13 to 14, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 14 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.284920 16487 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:17.286350 15879 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:17.294833 15733 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 9 to 10, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 10 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:17.311013 15733 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 14 to 15, leader changed from 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.313864 15733 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 14 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.312289 21564 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:17.244275 15731 rpcz_store.cc:276] 0709 12:26:14.030828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.037806 (+  6978us) service_pool.cc:224] Handling call
0709 12:26:17.243842 (+3206036us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:17.057146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:17.086634 (+ 29488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:17.086676 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:26:17.086694 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:17.087490 (+   796us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:17.087566 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:17.087593 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:17.087915 (+   322us) tablet.cc:701] Row locks acquired
0709 12:26:17.087933 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:17.088083 (+   150us) write_op.cc:270] Start()
0709 12:26:17.088196 (+   113us) write_op.cc:276] Timestamp: P: 1783599977088034 usec, L: 0
0709 12:26:17.088223 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:26:17.156712 (+ 68489us) log.cc:844] Serialized 1293 byte log entry
0709 12:26:17.176555 (+ 19843us) op_driver.cc:464] REPLICATION: finished
0709 12:26:17.177715 (+  1160us) write_op.cc:301] APPLY: starting
0709 12:26:17.177800 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:17.179608 (+  1808us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:17.179696 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:17.181406 (+  1710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:17.181568 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:26:17.183790 (+  2222us) write_op.cc:312] APPLY: finished
0709 12:26:17.185544 (+  1754us) log.cc:844] Serialized 41 byte log entry
0709 12:26:17.185718 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.185839 (+   121us) write_op.cc:454] Released schema lock
0709 12:26:17.185896 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:17.186260 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.186294 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116475,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":938,"apply.run_cpu_time_us":4822,"apply.run_wall_time_us":8481,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12498,"num_ops":3,"prepare.queue_time_us":18542,"prepare.run_cpu_time_us":3270,"prepare.run_wall_time_us":104967,"replication_time_us":88207,"thread_start_us":18374,"threads_started":1}]]}
I20260709 12:26:17.351982 21564 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:17.352947 21564 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.409611 16487 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:17.489841 15730 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 4 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 17 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:17.496256 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 52750.9us
I20260709 12:26:17.501155 21619 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:17.501721 21619 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.504961 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:17.505703 15909 raft_consensus.cc:2393] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:17.505872 21619 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:17.507822 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:17.508549 16489 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:17.526594 15733 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54792 (request call id 287) took 2598 ms. Trace:
I20260709 12:26:17.529592 15731 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.532603 15730 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54806 (request call id 283) took 2877 ms. Trace:
I20260709 12:26:17.533366 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cbb40ff3a44403a8705489ecc556e3b with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:42230
I20260709 12:26:17.548013 15833 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:26:17.546277 15730 rpcz_store.cc:276] 0709 12:26:14.654825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.655056 (+   231us) service_pool.cc:224] Handling call
0709 12:26:17.505144 (+2850088us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.505168 (+    24us) write_op.cc:454] Released schema lock
0709 12:26:17.532551 (+ 27383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:17.496967 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:17.497549 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:17.497591 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:26:17.497610 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:17.497969 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:17.498026 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:17.498059 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:17.498240 (+   181us) tablet.cc:701] Row locks acquired
0709 12:26:17.498261 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:26:17.498398 (+   137us) write_op.cc:270] Start()
0709 12:26:17.498517 (+   119us) write_op.cc:276] Timestamp: P: 1783599977498354 usec, L: 0
0709 12:26:17.498542 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:26:17.499141 (+   599us) log.cc:844] Serialized 533 byte log entry
0709 12:26:17.501104 (+  1963us) op_driver.cc:464] REPLICATION: finished
0709 12:26:17.501631 (+   527us) write_op.cc:301] APPLY: starting
0709 12:26:17.501708 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:17.502608 (+   900us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:17.502706 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:17.503379 (+   673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:17.503549 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:17.503602 (+    53us) write_op.cc:312] APPLY: finished
0709 12:26:17.503774 (+   172us) log.cc:844] Serialized 25 byte log entry
0709 12:26:17.504651 (+   877us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.504729 (+    78us) write_op.cc:454] Released schema lock
0709 12:26:17.504765 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":14195,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":2604,"apply.run_wall_time_us":3465,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4166,"num_ops":1,"prepare.queue_time_us":2801,"prepare.run_cpu_time_us":2500,"prepare.run_wall_time_us":7518,"replication_time_us":2396}]]}
I20260709 12:26:17.546836 15731 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 17 to 19, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 19 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.563314 15731 catalog_manager.cc:5697] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 12 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.567266 15731 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 10 to 12, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 12 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.571107 15731 catalog_manager.cc:5697] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.550053 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:17.578069 21603 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:17.578419 21603 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2fa3925738bd485e912c7ac0e28b0265)
I20260709 12:26:17.578764 21603 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:17.574878 15731 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.588289 21634 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:17.545876 15733 rpcz_store.cc:276] 0709 12:26:14.928136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.928269 (+   133us) service_pool.cc:224] Handling call
0709 12:26:17.526530 (+2598261us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:17.367483 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:17.368006 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:17.368045 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:26:17.368063 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:17.368793 (+   730us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:17.368842 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:17.368872 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:26:17.369412 (+   540us) tablet.cc:701] Row locks acquired
0709 12:26:17.369431 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:17.369562 (+   131us) write_op.cc:270] Start()
0709 12:26:17.369671 (+   109us) write_op.cc:276] Timestamp: P: 1783599977369521 usec, L: 0
0709 12:26:17.369693 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:17.373560 (+  3867us) log.cc:844] Serialized 2459 byte log entry
0709 12:26:17.427168 (+ 53608us) op_driver.cc:464] REPLICATION: finished
0709 12:26:17.427637 (+   469us) write_op.cc:301] APPLY: starting
0709 12:26:17.427715 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:17.431222 (+  3507us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:17.431314 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:17.454183 (+ 22869us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:17.454402 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:26:17.454466 (+    64us) write_op.cc:312] APPLY: finished
0709 12:26:17.454718 (+   252us) log.cc:844] Serialized 65 byte log entry
0709 12:26:17.455652 (+   934us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.455774 (+   122us) write_op.cc:454] Released schema lock
0709 12:26:17.455821 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:17.456162 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.456195 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33298,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":272,"apply.run_cpu_time_us":8950,"apply.run_wall_time_us":28466,"cfile_cache_hit":24,"cfile_cache_hit_bytes":24996,"num_ops":6,"prepare.queue_time_us":707,"prepare.run_cpu_time_us":7786,"prepare.run_wall_time_us":57311,"replication_time_us":54574}]]}
I20260709 12:26:17.609383 15980 raft_consensus.cc:1275] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:26:17.612368 21688 consensus_queue.cc:1048] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:26:17.619894 21708 tablet_replica.cc:333] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:17.625792 21708 raft_consensus.cc:2243] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.632305 21708 raft_consensus.cc:2272] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.628898 21603 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.654897 21708 ts_tablet_manager.cc:1916] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.655779 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:17.655740 15730 catalog_manager.cc:5697] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 16 to 17, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.656679 15909 raft_consensus.cc:2393] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fd62f0fa06a4561a0a7101b85942f86 in current term 13: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:17.666354 15730 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 16 to 17, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.667860 15730 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.669514 15730 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 17 to 18, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 18 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.672693 21603 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:17.673609 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:17.673872 16489 consensus_queue.cc:237] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.684414 16487 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:17.685600 15730 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 16 to 17, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.690752 15803 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:17.688194 15730 catalog_manager.cc:5697] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 13 to 15, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.692854 15730 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 13 to 14, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 14 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.694372 21670 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:17.700858 15909 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:17.700892 21670 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:17.705837 21697 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:17.707170 21670 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:17.709754 15833 raft_consensus.cc:1275] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:17.705451 15730 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 16 to 17, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.711226 15730 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 14 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } }
I20260709 12:26:17.737471 21697 consensus_queue.cc:1048] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:17.748252 21590 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 5 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.750579 15833 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 5 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.766400 15909 raft_consensus.cc:2955] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 5 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:17.799363 15980 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:17.810413 21687 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:17.822124 21708 ts_tablet_manager.cc:1929] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.10
I20260709 12:26:17.826520 16489 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:17.830955 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e271b9d1bc8403ba1c9d3e80c36917c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:17.824820 21708 log.cc:1199] T 7cbb40ff3a44403a8705489ecc556e3b P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/7cbb40ff3a44403a8705489ecc556e3b
I20260709 12:26:17.837376 21634 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:26:17.873867 15729 catalog_manager.cc:5697] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 5 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 19 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.880348 16487 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:17.882261 21614 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:17.940970 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 7cbb40ff3a44403a8705489ecc556e3b (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:17.945278 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e271b9d1bc8403ba1c9d3e80c36917c with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:43658
I20260709 12:26:17.957880 15979 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:17.962204 21634 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:18.016783 21715 tablet_replica.cc:333] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:18.018344 21715 raft_consensus.cc:2243] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.019188 21715 raft_consensus.cc:2272] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.032886 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.050737 21715 ts_tablet_manager.cc:1916] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:18.084574 15730 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.185528 21715 ts_tablet_manager.cc:1929] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 12:26:18.186118 21715 log.cc:1199] T 9e271b9d1bc8403ba1c9d3e80c36917c P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/9e271b9d1bc8403ba1c9d3e80c36917c
I20260709 12:26:18.193600 16487 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:18.194532 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet 9e271b9d1bc8403ba1c9d3e80c36917c (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:18.204083 21670 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:18.252466 15907 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:18.263844 21670 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:18.341233 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:18.341857 15909 raft_consensus.cc:606] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:18.345616 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:18.346215 15909 raft_consensus.cc:606] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:18.350169 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:18.350711 15907 raft_consensus.cc:606] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:18.353252 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:18.353785 15907 raft_consensus.cc:606] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:18.363128 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:18.363658 15907 raft_consensus.cc:606] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:18.370128 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:18.371913 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:18.372668 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.430245 21687 raft_consensus.cc:993] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:18.430783 21687 raft_consensus.cc:1081] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:18.432406 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:26:18.432960 15833 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.433355 15833 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.442427 15833 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.449999 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:18.450537 15907 raft_consensus.cc:3055] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:18.450847 15907 raft_consensus.cc:740] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:18.451517 15907 consensus_queue.cc:260] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.455240 15907 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.455950 21687 raft_consensus.cc:993] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:18.456485 21687 raft_consensus.cc:1081] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:18.459052 15979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:18.459582 15979 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.459908 15979 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:18.462224 15907 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:18.465281 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:18.470368 15802 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:18.471240 15980 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.471566 21619 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:18.472057 21619 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:18.472857 21619 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.463376 15833 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:18.469789 15979 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.480578 15979 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:18.483618 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:18.484181 15909 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:18.484463 15909 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:18.487643 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:18.488267 15836 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:18.488355 15909 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.489790 15909 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:18.496942 15980 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:18.506749 15836 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 18.
I20260709 12:26:18.509186 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:18.510058 21518 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:18.510567 21518 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:18.511492 21518 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.521963 15909 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 18.
I20260709 12:26:18.536068 15733 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 14 to 15, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.564230 21688 raft_consensus.cc:993] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:18.564759 21688 raft_consensus.cc:1081] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:18.578043 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:26:18.578562 15833 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.578912 15833 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.583695 15730 catalog_manager.cc:5697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 17 to 18, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 18 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.621701 21688 raft_consensus.cc:993] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:18.622176 21688 raft_consensus.cc:1081] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:18.624898 15833 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:18.626883 15833 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:18.627651 15913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:18.628288 15913 raft_consensus.cc:3055] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:18.628587 15913 raft_consensus.cc:740] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:18.629403 15913 consensus_queue.cc:260] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:18.629920 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:18.630574 16487 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.630738 15913 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.634249 15980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:18.634773 15980 raft_consensus.cc:493] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.635105 15980 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.641439 15980 raft_consensus.cc:515] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.643217 15980 leader_election.cc:290] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:18.644634 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:18.645417 15909 raft_consensus.cc:3055] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:18.645695 15909 raft_consensus.cc:740] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:18.646430 15909 consensus_queue.cc:260] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.647629 15909 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.650151 15913 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:18.651813 16487 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 15.
I20260709 12:26:18.644634 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa3e193f2f64a16b07bd7462017199d" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:18.653205 15833 raft_consensus.cc:3060] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.651296 15802 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:18.654347 15909 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:18.655015 21619 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:18.655484 15952 leader_election.cc:304] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:18.655524 21619 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:18.656373 21518 raft_consensus.cc:2804] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:18.656980 21518 raft_consensus.cc:697] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:18.657183 21619 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:18.657896 21518 consensus_queue.cc:237] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:18.683780 15733 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 14 to 15, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 15 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.684460 15730 catalog_manager.cc:5697] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 12 to 13, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.743299 15833 raft_consensus.cc:2468] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:18.818337 21687 raft_consensus.cc:993] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:18.818859 21687 raft_consensus.cc:1081] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:18.823108 15980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:18.823622 15980 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.823961 15980 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.831573 15980 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:18.842931 15980 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:18.843194 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:18.843808 15909 raft_consensus.cc:3055] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:18.844105 15909 raft_consensus.cc:740] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:18.844777 15909 consensus_queue.cc:260] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:18.846252 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf6eca653c94d5bba2406c3006ac72e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:18.846783 16489 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.848724 15909 raft_consensus.cc:3060] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.858960 16489 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:18.860154 15953 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:18.860332 15833 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:18.861969 21445 raft_consensus.cc:2804] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:18.862449 21445 raft_consensus.cc:697] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:18.863274 21445 consensus_queue.cc:237] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:18.864189 15909 raft_consensus.cc:2468] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:26:18.875975 15803 consensus_peers.cc:597] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5698e9ff3e90444081e6234a1cd5ce81. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.877666 15980 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:18.882756 21653 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:18.886024 15909 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:18.887307 21653 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:18.931500 21728 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:26:18.932875 21653 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:18.935405 15733 catalog_manager.cc:5697] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 12 to 13, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.944798 15909 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:18.946321 21670 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:18.958194 15986 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:18.982991 15913 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:19.002461 15986 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:19.005000 21670 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:19.014173 15730 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.080893 15913 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:19.092062 21738 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:19.117314 15913 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:19.133549 21619 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:19.155530 15833 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:19.165241 21518 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:19.193562 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 104548us
W20260709 12:26:19.201535 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 53242.1us
W20260709 12:26:19.236457 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 46007.1us
I20260709 12:26:19.307600 15907 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:19.321120 15832 raft_consensus.cc:1275] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:26:19.332691 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 130308us
I20260709 12:26:19.352285 21581 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:26:19.356069 21445 consensus_queue.cc:1048] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:26:19.412446 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 82395.9us
I20260709 12:26:19.418434 15913 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:19.419872 16487 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:19.421839 15982 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:19.461591 21670 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:19.458137 21738 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:26:19.509786 16489 raft_consensus.cc:1275] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:19.511785 21518 consensus_queue.cc:1048] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:19.537819 15832 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:26:19.538635 15953 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56d26e9d10514d43b1dc78bb348fede9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.539466 21760 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:19.564576 15907 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:19.591337 21752 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:19.607107 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:19.610893 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 152771us
I20260709 12:26:19.626366 16494 consensus_queue.cc:237] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:19.668591 21752 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:19.678315 15829 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:19.691207 15832 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:19.696818 21699 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:19.705646 21770 ts_tablet_manager.cc:933] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945)
I20260709 12:26:19.714725 15986 raft_consensus.cc:1275] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:19.717123 21617 consensus_queue.cc:1048] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:19.722162 15986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:19.723006 15986 raft_consensus.cc:606] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:19.729123 15906 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:19.750083 15832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db755710417246db916d8278741aaff0"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:19.756341 15832 raft_consensus.cc:606] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:19.769017 15733 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 19 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:19.780048 21617 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 4 to 11, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:19.788657 15833 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 4 to 11, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:19.803131 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:19.804857 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:19.805626 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.815213 15906 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:19.817663 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 12:26:19.818040 21770 tablet_copy_client.cc:323] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.65:38945
I20260709 12:26:19.821595 15847 tablet_copy_service.cc:140] P 9fd62f0fa06a4561a0a7101b85942f86: Received BeginTabletCopySession request for tablet 5698e9ff3e90444081e6234a1cd5ce81 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:59154)
I20260709 12:26:19.830909 21619 raft_consensus.cc:993] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:19.831375 21619 raft_consensus.cc:1081] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:19.835196 15847 tablet_copy_service.cc:161] P 9fd62f0fa06a4561a0a7101b85942f86: Beginning new tablet copy session on tablet 5698e9ff3e90444081e6234a1cd5ce81 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:59154: session id = 2fa3925738bd485e912c7ac0e28b0265-5698e9ff3e90444081e6234a1cd5ce81
I20260709 12:26:19.845557 15909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db755710417246db916d8278741aaff0"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:19.846143 15909 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.846506 15909 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:19.913141 15909 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:19.915926 15909 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:19.918526 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:19.919097 15982 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:19.919513 15913 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:19.924628 15847 tablet_copy_source_session.cc:215] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:19.917625 15986 raft_consensus.cc:2955] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 4 to 11, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:19.946657 15982 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:19.952642 15879 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:19.954716 21770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5698e9ff3e90444081e6234a1cd5ce81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:19.966605 21779 raft_consensus.cc:2804] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:19.967393 21779 raft_consensus.cc:697] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:19.968374 21779 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:19.990031 15731 catalog_manager.cc:5697] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 4 to 11, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:20.050956 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 62643.4us
I20260709 12:26:20.061472 16487 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:20.072928 21743 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:20.107664 21788 ts_tablet_manager.cc:933] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:20.120534 21739 raft_consensus.cc:993] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:20.121078 21518 raft_consensus.cc:1081] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:20.131932 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57462
I20260709 12:26:20.132472 15833 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:20.132822 15833 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:20.176527 15833 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:20.196600 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db755710417246db916d8278741aaff0" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:20.197239 15829 raft_consensus.cc:3055] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:20.197556 15829 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:20.204538 15833 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:20.203939 15829 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:20.207031 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:20.207584 15986 raft_consensus.cc:3055] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:20.207877 15986 raft_consensus.cc:740] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:20.207760 16487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:20.208564 16487 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:20.208591 15986 consensus_queue.cc:260] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:20.212301 15986 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:20.217204 15829 raft_consensus.cc:3060] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:20.237152 15729 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 15 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.254283 15986 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:20.255800 15803 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:20.256649 15829 raft_consensus.cc:2468] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:20.261117 16487 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 13.
I20260709 12:26:20.265082 21510 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:20.265751 21510 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:20.266902 21510 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:20.225548 21788 tablet_copy_client.cc:323] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:26:20.294871 21770 tablet_copy_client.cc:806] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:20.295670 21770 tablet_copy_client.cc:670] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:20.305517 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 56d26e9d10514d43b1dc78bb348fede9 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:26:20.306308 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 56d26e9d10514d43b1dc78bb348fede9 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-56d26e9d10514d43b1dc78bb348fede9
I20260709 12:26:20.312908 21770 tablet_copy_client.cc:538] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:20.355058 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 139103us
I20260709 12:26:20.364820 15998 tablet_copy_source_session.cc:215] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:20.370368 15986 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:20.382894 21788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d26e9d10514d43b1dc78bb348fede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:20.383045 15986 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:20.391827 21770 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:20.401155 15729 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 12 to 13, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 13 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.423843 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:20.429961 21743 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:20.462647 15833 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:26:20.443734 15879 consensus_peers.cc:597] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: baa957d5e1074b30a83ccaa548766896. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.469110 16494 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:20.474818 15832 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:20.489311 21748 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:26:20.493470 15729 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 4 to 10, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:20.508200 21797 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:20.522048 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e8af32d711469181861fb4a98feec9 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:42230
I20260709 12:26:20.528157 21770 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.531368 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21e8af32d711469181861fb4a98feec9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:26:20.532698 21770 tablet_bootstrap.cc:492] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:20.533520 21770 ts_tablet_manager.cc:1403] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.142s	user 0.026s	sys 0.030s
I20260709 12:26:20.538094 21788 tablet_copy_client.cc:806] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:20.538645 21788 tablet_copy_client.cc:670] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:20.539878 21748 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:20.542376 21800 tablet_replica.cc:333] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:20.536592 21770 raft_consensus.cc:359] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:20.546666 21770 raft_consensus.cc:740] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:20.550696 21770 consensus_queue.cc:260] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:20.553128 21788 tablet_copy_client.cc:538] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:20.564323 21800 raft_consensus.cc:2243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.567324 15986 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:20.572605 21800 raft_consensus.cc:2272] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.569382 21748 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:26:20.587298 15980 raft_consensus.cc:2955] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:20.584472 21770 ts_tablet_manager.cc:1434] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:26:20.610819 21788 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:20.609797 21779 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:20.594306 21797 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:20.620893 15847 tablet_copy_service.cc:342] P 9fd62f0fa06a4561a0a7101b85942f86: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-5698e9ff3e90444081e6234a1cd5ce81 received from {username='slave'} at 127.0.0.1:59154
I20260709 12:26:20.621433 15847 tablet_copy_service.cc:434] P 9fd62f0fa06a4561a0a7101b85942f86: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-5698e9ff3e90444081e6234a1cd5ce81 on tablet 5698e9ff3e90444081e6234a1cd5ce81 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:20.622938 15982 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:20.625970 21800 ts_tablet_manager.cc:1916] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.647251 15835 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:20.652644 21801 tablet_replica.cc:333] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:20.655977 21801 raft_consensus.cc:2243] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.656881 21801 raft_consensus.cc:2272] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.660511 16494 raft_consensus.cc:1217] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:26:20.682083 15980 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:20.683986 21670 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:20.689700 21801 ts_tablet_manager.cc:1916] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.706832 15982 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:20.710127 15729 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.748728 16494 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:20.757185 21750 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:20.813441 21800 ts_tablet_manager.cc:1929] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:26:20.825925 21770 ts_tablet_manager.cc:933] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:20.829941 15953 consensus_peers.cc:597] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a79a04e9fda24da8a4ca30980a0ef796. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.830276 21800 log.cc:1199] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/3a4fafd7ec404ad9b05209ed0c8c1a19
I20260709 12:26:20.853369 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 3a4fafd7ec404ad9b05209ed0c8c1a19 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:20.869206 15906 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:20.891417 21445 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:20.899655 21801 ts_tablet_manager.cc:1929] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 12:26:20.927031 21801 log.cc:1199] T 21e8af32d711469181861fb4a98feec9 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/21e8af32d711469181861fb4a98feec9
I20260709 12:26:20.930330 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 21e8af32d711469181861fb4a98feec9 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:20.942713 21770 tablet_copy_client.cc:323] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
I20260709 12:26:20.951468 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:20.952284 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet baa957d5e1074b30a83ccaa548766896 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:26:20.952862 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet baa957d5e1074b30a83ccaa548766896 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-baa957d5e1074b30a83ccaa548766896
I20260709 12:26:20.958679 21788 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.959690 21788 tablet_bootstrap.cc:492] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:20.960345 21788 ts_tablet_manager.cc:1403] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.350s	user 0.030s	sys 0.022s
I20260709 12:26:20.964166 21788 raft_consensus.cc:359] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:20.963640 21817 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:20.961021 15923 tablet_copy_source_session.cc:215] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:20.968501 21770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa957d5e1074b30a83ccaa548766896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:20.973992 15836 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:20.986418 21788 raft_consensus.cc:740] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:20.987372 21788 consensus_queue.cc:260] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:20.990855 21788 ts_tablet_manager.cc:1434] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.007s
I20260709 12:26:20.997861 21770 tablet_copy_client.cc:806] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:20.998767 21770 tablet_copy_client.cc:670] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:20.998937 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-56d26e9d10514d43b1dc78bb348fede9 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:26:20.999487 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-56d26e9d10514d43b1dc78bb348fede9 on tablet 56d26e9d10514d43b1dc78bb348fede9 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:21.000836 21760 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:21.008144 21770 tablet_copy_client.cc:538] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:21.032496 15836 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:21.083325 21770 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:21.088914 15913 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:26:21.091077 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 50629.6us
I20260709 12:26:21.123840 15729 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 9, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:21.198230 15906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:21.198812 15906 raft_consensus.cc:606] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:21.225802 16494 raft_consensus.cc:1217] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 12:26:21.227377 15835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:21.228018 15835 raft_consensus.cc:606] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:21.230849 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:21.232556 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:21.236869 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:21.288343 21788 ts_tablet_manager.cc:933] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:21.302194 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 146225us
I20260709 12:26:21.317678 21827 raft_consensus.cc:993] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:21.318236 21827 raft_consensus.cc:1081] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:21.322808 15906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:21.323308 15906 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.323616 15906 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.345204 15906 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:21.359861 15906 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:21.343776 21788 tablet_copy_client.cc:323] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:26:21.364171 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:21.366544 15980 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.373560 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:21.374143 15835 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:21.374413 15835 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:21.377969 15835 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:21.379154 15835 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.380533 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet a79a04e9fda24da8a4ca30980a0ef796 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:26:21.381282 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet a79a04e9fda24da8a4ca30980a0ef796 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-a79a04e9fda24da8a4ca30980a0ef796
I20260709 12:26:21.386101 15835 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:21.390662 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:21.400641 15980 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:21.399438 21783 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:21.430374 21510 raft_consensus.cc:1064] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:21.429251 21783 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:21.440771 21783 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:21.461789 15998 tablet_copy_source_session.cc:215] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:21.467060 21788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79a04e9fda24da8a4ca30980a0ef796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:21.473325 21510 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:21.531270 21743 raft_consensus.cc:993] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:21.531762 21743 raft_consensus.cc:1081] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:21.538475 15986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:21.539845 15986 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.540215 15986 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:21.551702 15986 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:21.560086 16494 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:21.560289 15980 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:21.563751 15906 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:21.571290 21788 tablet_copy_client.cc:806] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:21.574011 15986 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:21.575340 15909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:21.583600 15909 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:21.583890 15909 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:21.584167 16494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:21.584681 16494 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:21.584560 15909 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:21.585644 15909 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:21.585970 21827 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:21.596710 21788 tablet_copy_client.cc:670] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:21.588706 21510 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:21.619379 21770 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:21.625931 16494 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:21.626344 15909 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 14.
I20260709 12:26:21.627640 15952 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:21.610662 21510 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:26:21.639314 21788 tablet_copy_client.cc:538] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:21.642998 21770 tablet_bootstrap.cc:492] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:21.644754 21770 ts_tablet_manager.cc:1403] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.562s	user 0.037s	sys 0.028s
I20260709 12:26:21.643916 21834 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:21.653196 21834 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:21.654417 21834 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:21.662683 15733 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 14 to 15, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:21.683120 21837 log.cc:927] Time spent T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.010s
I20260709 12:26:21.713821 21770 raft_consensus.cc:359] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:21.728925 21827 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:21.731621 15909 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:21.738960 21770 raft_consensus.cc:740] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:21.757257 21788 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:21.754247 21770 consensus_queue.cc:260] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:21.770190 21518 raft_consensus.cc:1064] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:21.783553 15986 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:21.781219 15729 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.797698 21770 ts_tablet_manager.cc:1434] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.000s
I20260709 12:26:21.821627 16494 raft_consensus.cc:1217] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 12:26:21.833211 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-baa957d5e1074b30a83ccaa548766896 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:26:21.836692 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-baa957d5e1074b30a83ccaa548766896 on tablet baa957d5e1074b30a83ccaa548766896 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:21.795289 21518 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:21.896581 16487 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:21.931643 15979 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:21.939056 21783 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:26:21.982369 15836 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:21.988415 21830 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:22.060586 16487 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:22.072769 21817 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:22.079051 15835 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:22.080425 21817 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:22.090363 15730 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 13 to 14, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.107939 15906 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:22.127332 21752 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:26:22.203449 15908 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:22.238101 21817 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:22.240883 21851 log.cc:927] Time spent T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:26:22.244951 21518 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.246948 15835 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:22.253717 15832 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:22.287312 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 52231.3us
I20260709 12:26:22.291816 16494 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:22.299626 21818 raft_consensus.cc:1064] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:22.303228 15986 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:22.306990 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.303534 16487 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.318046 15730 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.302127 21818 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:22.336863 15909 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.362068 21750 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:26:22.368903 21670 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:22.387295 15986 consensus_queue.cc:237] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:22.389019 16495 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:22.391693 21518 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:22.405714 15833 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:22.410863 21752 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:22.413277 15980 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:22.416142 16494 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:22.418440 21830 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:22.422849 16494 raft_consensus.cc:1275] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:22.428551 21834 consensus_queue.cc:1048] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:22.420763 21830 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:26:22.432149 21827 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.438684 16489 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:22.448187 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 81073.3us
I20260709 12:26:22.454668 21788 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:22.455849 15833 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:22.487535 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "021499433bf04873a1ec6376aba69864"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:22.488348 15909 raft_consensus.cc:606] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:22.491938 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:22.492674 15909 raft_consensus.cc:606] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:22.496244 15980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:22.496886 15980 raft_consensus.cc:606] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:22.499377 21788 tablet_bootstrap.cc:492] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:22.500149 21788 ts_tablet_manager.cc:1403] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.743s	user 0.037s	sys 0.015s
I20260709 12:26:22.462662 21830 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:26:22.549016 21788 raft_consensus.cc:359] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:22.558836 21788 raft_consensus.cc:740] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:22.559712 21788 consensus_queue.cc:260] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:22.573088 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:22.575202 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:22.576103 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.584484 15833 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.619593 21788 ts_tablet_manager.cc:1434] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.001s
I20260709 12:26:22.620594 15980 raft_consensus.cc:2955] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.638480 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-a79a04e9fda24da8a4ca30980a0ef796 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:26:22.644692 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-a79a04e9fda24da8a4ca30980a0ef796 on tablet a79a04e9fda24da8a4ca30980a0ef796 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:22.509379 21581 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:22.724618 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 131513us
I20260709 12:26:22.737027 21797 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:22.747283 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 112803us
I20260709 12:26:22.749634 16494 raft_consensus.cc:2955] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.773640 21818 raft_consensus.cc:993] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:22.767179 15729 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 12 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.774171 21830 raft_consensus.cc:1081] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:22.778388 16489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "021499433bf04873a1ec6376aba69864"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:42798
I20260709 12:26:22.779053 16489 raft_consensus.cc:493] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.779421 16489 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.789089 15979 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.789064 16489 raft_consensus.cc:515] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:22.805148 21865 raft_consensus.cc:993] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:22.805660 21865 raft_consensus.cc:1081] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:22.811959 16492 raft_consensus.cc:1217] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:26:22.816781 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:22.817790 15908 raft_consensus.cc:3055] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:22.818158 15908 raft_consensus.cc:740] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:22.818929 15908 consensus_queue.cc:260] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:22.820133 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56d26e9d10514d43b1dc78bb348fede9 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:22.820178 15908 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.817279 15907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:22.832386 15907 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.832924 15907 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.833835 16489 leader_election.cc:290] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:22.845819 15908 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:22.847031 16459 leader_election.cc:304] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:26:22.870127 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 44276.2us
I20260709 12:26:22.872071 21859 raft_consensus.cc:2804] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:22.872574 21859 raft_consensus.cc:697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:22.876672 21859 consensus_queue.cc:237] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:22.882992 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "021499433bf04873a1ec6376aba69864" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:22.883543 15986 raft_consensus.cc:3060] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.895536 15986 raft_consensus.cc:2468] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:22.908406 21818 raft_consensus.cc:993] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:22.908948 21818 raft_consensus.cc:1081] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:22.919544 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 5698e9ff3e90444081e6234a1cd5ce81 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:22.926448 15730 catalog_manager.cc:5697] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 12 to 13, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 19 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.955786 21881 tablet_replica.cc:333] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:22.957077 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:26:22.957762 15833 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.958099 15833 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:22.958246 21881 raft_consensus.cc:2243] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.970072 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5698e9ff3e90444081e6234a1cd5ce81 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:22.970640 15907 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:22.981777 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 56d26e9d10514d43b1dc78bb348fede9 with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:22.995177 15835 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:22.998571 15907 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:23.003695 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:23.005306 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca952dcf3d340e9a816b8ba8f2beb8a" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:23.014397 15986 raft_consensus.cc:3055] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:23.014707 15986 raft_consensus.cc:740] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:23.015062 15836 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.015444 15986 consensus_queue.cc:260] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:23.016453 15986 raft_consensus.cc:3060] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.999996 15833 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:23.020568 21881 raft_consensus.cc:2272] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:23.025964 15730 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.025966 15986 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19.
I20260709 12:26:23.032187 15879 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:23.033900 21795 raft_consensus.cc:2804] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:23.034379 21795 raft_consensus.cc:697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:23.035171 21795 consensus_queue.cc:237] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:23.041590 16495 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.063537 21881 ts_tablet_manager.cc:1916] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:23.067678 15833 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:23.069958 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:23.071923 15907 raft_consensus.cc:3055] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:23.072249 15907 raft_consensus.cc:740] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:23.072924 15907 consensus_queue.cc:260] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:23.073943 15907 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.075431 15836 raft_consensus.cc:2468] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19.
I20260709 12:26:23.077400 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:23.077980 15979 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.085146 15979 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 18.
I20260709 12:26:23.086624 15803 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:23.104359 21877 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:23.104882 21877 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:23.105728 21877 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:23.124626 15907 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 18.
I20260709 12:26:23.133530 21881 ts_tablet_manager.cc:1929] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 12:26:23.134078 21881 log.cc:1199] T 5698e9ff3e90444081e6234a1cd5ce81 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/5698e9ff3e90444081e6234a1cd5ce81
I20260709 12:26:23.135754 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 5698e9ff3e90444081e6234a1cd5ce81 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:23.135854 21881 tablet_replica.cc:333] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:23.142148 21881 raft_consensus.cc:2243] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:23.143126 21881 raft_consensus.cc:2272] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:23.144042 15907 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:23.147888 21881 ts_tablet_manager.cc:1916] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:23.149546 15730 catalog_manager.cc:5697] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 18 to 19, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 19 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.165413 15986 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:23.170441 21863 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.176427 21881 ts_tablet_manager.cc:1929] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 12:26:23.177115 21881 log.cc:1199] T 56d26e9d10514d43b1dc78bb348fede9 P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/56d26e9d10514d43b1dc78bb348fede9
I20260709 12:26:23.179996 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 56d26e9d10514d43b1dc78bb348fede9 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:23.187736 16494 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:23.198179 21752 raft_consensus.cc:1064] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:23.209848 21828 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.211668 15986 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.228789 15731 catalog_manager.cc:5697] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 18 to 19, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 19 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.227423 16494 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.200862 21752 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:23.261694 21863 raft_consensus.cc:2955] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.268134 15729 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 17 to 18, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 18 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.275317 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet baa957d5e1074b30a83ccaa548766896 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:23.287019 15731 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 11 to 12, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.299328 15907 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:23.301828 16494 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:23.302294 21752 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:23.303452 21872 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:23.307087 15833 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:23.309803 21872 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:23.316174 15907 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:23.318660 21873 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:23.319585 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet baa957d5e1074b30a83ccaa548766896 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:42230
I20260709 12:26:23.379768 21886 tablet_replica.cc:333] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:23.422776 15833 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.437602 15836 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:23.443217 15986 raft_consensus.cc:1275] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:23.445183 21861 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.449180 21856 consensus_queue.cc:1048] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.459069 15730 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 9 to 10, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.470204 21886 raft_consensus.cc:2243] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:23.475767 21886 raft_consensus.cc:2272] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:23.479677 21886 ts_tablet_manager.cc:1916] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:23.415120 21581 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:23.486142 15982 raft_consensus.cc:1275] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:23.487370 21859 consensus_queue.cc:1048] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:23.625159 15907 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:23.725101 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 193972us
W20260709 12:26:23.757366 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 82922.2us
W20260709 12:26:23.791851 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 63824.7us
W20260709 12:26:23.796991 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 103543us
I20260709 12:26:23.793484 21886 ts_tablet_manager.cc:1929] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 12:26:23.813241 21886 log.cc:1199] T baa957d5e1074b30a83ccaa548766896 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/baa957d5e1074b30a83ccaa548766896
W20260709 12:26:23.845911 21892 log.cc:927] Time spent T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:26:23.911767 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:23.956547 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 114840us
I20260709 12:26:23.929582 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet baa957d5e1074b30a83ccaa548766896 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:23.952517 15907 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:26:24.116174 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 120819us
I20260709 12:26:24.114856 16495 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:24.153801 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 105374us
W20260709 12:26:24.186815 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 384903us
I20260709 12:26:24.239692 21877 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:24.364310 15986 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:24.431174 21916 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:24.529632 15982 consensus_queue.cc:237] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:24.543514 16495 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:24.545256 21921 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:24.554076 21872 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:24.574712 16495 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:24.575729 15907 raft_consensus.cc:1275] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:24.577620 21581 consensus_queue.cc:1048] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:24.588158 15907 raft_consensus.cc:2955] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:24.603257 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a79a04e9fda24da8a4ca30980a0ef796 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.620075 15729 catalog_manager.cc:5697] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 10 to 11, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:24.711028 15833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b9763772dd94e749d16fd361de18016"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:24.711833 15833 raft_consensus.cc:606] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:24.716013 15908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:24.716599 15908 raft_consensus.cc:606] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:24.718331 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:24.720116 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:24.729382 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.763276 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet a79a04e9fda24da8a4ca30980a0ef796 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:42230
I20260709 12:26:24.793102 21932 tablet_replica.cc:333] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:24.794337 21932 raft_consensus.cc:2243] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.798470 21932 raft_consensus.cc:2272] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.822736 21932 ts_tablet_manager.cc:1916] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:24.853904 21932 ts_tablet_manager.cc:1929] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:26:24.856705 21932 log.cc:1199] T a79a04e9fda24da8a4ca30980a0ef796 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/a79a04e9fda24da8a4ca30980a0ef796
I20260709 12:26:24.882704 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet a79a04e9fda24da8a4ca30980a0ef796 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:24.997859 21861 raft_consensus.cc:993] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:24.998420 21861 raft_consensus.cc:1081] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:25.001539 15984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:25.002146 15984 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.002468 15984 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:25.012193 15984 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:25.022028 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:25.022266 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:25.022697 15829 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:25.022861 15908 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:25.023267 15908 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:25.024153 15908 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:25.025333 15908 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:25.030426 15829 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:25.033445 15908 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:25.042233 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:25.033869 15984 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:25.043282 21581 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:25.044420 21581 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:25.045315 21581 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:25.074250 15731 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.253551 21916 raft_consensus.cc:993] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:25.254060 21916 raft_consensus.cc:1081] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:25.257202 15907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b9763772dd94e749d16fd361de18016"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:25.257738 15907 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.258098 15907 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.309407 15907 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:25.373132 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:25.373922 15829 raft_consensus.cc:3055] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:25.375634 15829 raft_consensus.cc:740] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:25.378836 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9763772dd94e749d16fd361de18016" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:25.379487 15982 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.386411 15907 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:25.389465 15982 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:25.391737 15879 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:25.385174 15829 consensus_queue.cc:260] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:25.393754 21861 raft_consensus.cc:2804] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:25.394290 21861 raft_consensus.cc:697] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:25.394353 15829 raft_consensus.cc:3060] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.395295 21861 consensus_queue.cc:237] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:25.414690 15829 raft_consensus.cc:2468] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:25.420145 15731 catalog_manager.cc:5697] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 14 to 15, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.468990 15907 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:25.470561 21921 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:25.538915 15829 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:25.540251 21921 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:25.822630 15829 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:25.822996 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.825796 21828 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:25.893956 15982 raft_consensus.cc:1275] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:25.897301 21867 consensus_queue.cc:1048] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:25.901500 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 71663.3us
I20260709 12:26:26.100438 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:26.101003 15982 raft_consensus.cc:606] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:26.104300 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:26.104871 15907 raft_consensus.cc:606] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:26.108397 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:26.110257 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.111007 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:26.360531 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 127139us
I20260709 12:26:26.388072 21828 raft_consensus.cc:993] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:26.389849 21947 raft_consensus.cc:1081] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:26.391539 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:26:26.392045 15833 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.392351 15833 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.409397 15907 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:26.404176 15833 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:26.418444 15879 consensus_peers.cc:597] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fee2b4c1781842208f03c61ac44ad821. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.424108 15984 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:26.424855 15832 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:26.426388 21949 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:26.427405 21828 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:26.446269 15833 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:26.451690 15984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:26.452297 15984 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.459837 15984 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:26:26.462339 15803 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:26.463191 21916 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:26.463691 21916 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:26.464562 21916 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:26.460513 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:26.468582 15907 raft_consensus.cc:3055] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:26.468897 15907 raft_consensus.cc:740] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:26.469791 15907 consensus_queue.cc:260] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:26.471074 15907 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.473081 21921 raft_consensus.cc:993] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:26.473603 21921 raft_consensus.cc:1081] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:26.477986 15908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:26.478376 15907 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 11.
I20260709 12:26:26.478497 15908 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.478932 15908 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.487854 15908 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:26.491278 15833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:26.491842 15833 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.500263 15908 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:26.500438 15982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0236e5de04f55852a74f344fb872b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:26.500993 15982 raft_consensus.cc:3055] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:26.501355 15982 raft_consensus.cc:740] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:26.502130 15982 consensus_queue.cc:260] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:26.503607 15982 raft_consensus.cc:3060] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:26.488842 21828 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.506740 15832 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.522570 15982 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:26.525596 15833 raft_consensus.cc:2468] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:26.528898 15876 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:26.530395 21949 raft_consensus.cc:2804] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:26.530901 21949 raft_consensus.cc:697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:26.531782 21949 consensus_queue.cc:237] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:26.550696 15980 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:26.596700 15833 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:26:26.597167 15953 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b991ff9e213435786d19248864c5cfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.598106 21872 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:26.603626 15908 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:26.607568 15731 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 10 to 11, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 11 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.609807 21944 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:26.628918 15982 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.646168 21944 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.657652 15729 catalog_manager.cc:5697] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 16 to 17, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 17 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.654845 15832 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.667145 15907 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.711506 15730 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 10, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 12 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.719570 15907 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:26:26.765177 15879 consensus_peers.cc:597] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db755710417246db916d8278741aaff0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.782435 15982 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:26.784529 15832 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:26.786482 21861 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:26.789623 21949 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:26.833786 21949 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.842932 15731 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.870935 15982 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.893446 15832 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.930478 15986 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:26.934235 21953 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:26:26.989938 15730 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:26.998519 15983 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:27.013497 21828 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:27.035290 21967 ts_tablet_manager.cc:933] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:27.069888 15907 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:27.072885 21953 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:27.069828 15983 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:27.085755 15832 raft_consensus.cc:1275] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:27.099136 21948 consensus_queue.cc:1048] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:26:27.103080 21967 tablet_copy_client.cc:323] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
W20260709 12:26:27.202834 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 43487.6us
I20260709 12:26:27.235347 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:27.259343 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 44031.3us
W20260709 12:26:27.268141 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61993.9us
W20260709 12:26:27.309679 21974 log.cc:927] Time spent T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:26:27.437279 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet fee2b4c1781842208f03c61ac44ad821 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:26:27.438071 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet fee2b4c1781842208f03c61ac44ad821 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-fee2b4c1781842208f03c61ac44ad821
I20260709 12:26:27.449615 15923 tablet_copy_source_session.cc:215] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.457087 15908 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:26:27.479938 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 99365us
W20260709 12:26:27.497009 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 88517.8us
I20260709 12:26:27.513192 21996 ts_tablet_manager.cc:933] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:27.534276 21996 tablet_copy_client.cc:323] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
W20260709 12:26:27.534704 21985 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:26:27.537153 15832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:27.537739 15832 raft_consensus.cc:606] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:27.550714 22006 ts_tablet_manager.cc:933] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:27.551144 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 2b991ff9e213435786d19248864c5cfc from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:26:27.551708 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 2b991ff9e213435786d19248864c5cfc from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-2b991ff9e213435786d19248864c5cfc
I20260709 12:26:27.578565 22004 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:26:27.579619 21967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee2b4c1781842208f03c61ac44ad821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.599139 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:27.601379 15907 raft_consensus.cc:606] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:27.645812 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 76802.6us
I20260709 12:26:27.658689 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:26:27.660250 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 60618.1us
I20260709 12:26:27.660526 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:27.661602 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.673353 15998 tablet_copy_source_session.cc:215] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.702806 21996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b991ff9e213435786d19248864c5cfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.721408 22004 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:26:27.733044 15953 consensus_peers.cc:597] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bcdf0d8639346d5b7f77aeac71a1eb7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.756659 15907 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:27.685997 22006 tablet_copy_client.cc:323] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.66:41469
W20260709 12:26:27.805363 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 222987us
W20260709 12:26:27.840447 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 182983us
I20260709 12:26:27.851572 15923 tablet_copy_service.cc:140] P 761f08e40cdf4af396105d67949c0afc: Received BeginTabletCopySession request for tablet db755710417246db916d8278741aaff0 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:41588)
I20260709 12:26:27.852173 15923 tablet_copy_service.cc:161] P 761f08e40cdf4af396105d67949c0afc: Beginning new tablet copy session on tablet db755710417246db916d8278741aaff0 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:41588: session id = 2fa3925738bd485e912c7ac0e28b0265-db755710417246db916d8278741aaff0
I20260709 12:26:27.862813 15923 tablet_copy_source_session.cc:215] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.879174 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db755710417246db916d8278741aaff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.880577 21996 tablet_copy_client.cc:806] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.881184 21996 tablet_copy_client.cc:670] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.893443 21996 tablet_copy_client.cc:538] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.898276 15731 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:27.900661 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 347141us
I20260709 12:26:27.914836 21947 raft_consensus.cc:993] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:27.915369 21947 raft_consensus.cc:1081] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:27.922693 15836 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:27.937651 15979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:27.938155 15979 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.938488 15979 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:27.957149 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 46383.8us
I20260709 12:26:27.959431 22004 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:27.963142 22021 ts_tablet_manager.cc:933] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:27.964953 21996 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:27.967521 21967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42798 (request call id 1231) took 1075 ms. Trace:
I20260709 12:26:27.981321 21967 rpcz_store.cc:276] 0709 12:26:26.891670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.891791 (+   121us) service_pool.cc:224] Handling call
0709 12:26:27.035671 (+143880us) ts_tablet_manager.cc:934] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
0709 12:26:27.329746 (+294075us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4c00186b00. stack: 00007f03c9184343 00007f03c9184240 00007f03c8b131d4 00007f03d2851304 00007f03d2851299 00007f03ca56fa20 00007f03ca580a29 00007f03ca58113f 00007f03ca5452ab 00007f03ca572f3c 00007f03ca573461 00007f03ca573768 00007f03d02f92eb 00007f03d121ed3b 00007f03d1219008 00007f03d1218405
0709 12:26:27.578349 (+248603us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:27.841254 (+262905us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:27.841397 (+   143us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:27.966729 (+125332us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:27.967018 (+   289us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:27.967296 (+   278us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:27.967438 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":31179,"spinlock_wait_cycles":6461184,"tablet-copy.queue_time_us":142830,"thread_start_us":162522,"threads_started":2}
I20260709 12:26:28.090408 21967 tablet_copy_client.cc:806] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
W20260709 12:26:28.072449 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 93621us
I20260709 12:26:28.091094 21967 tablet_copy_client.cc:670] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:28.075579 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 96591.9us
I20260709 12:26:28.096457 22006 tablet_copy_client.cc:806] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:28.100046 22006 tablet_copy_client.cc:670] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:28.081401 22021 tablet_copy_client.cc:323] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:26:28.103273 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:26:28.103924 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-0bcdf0d8639346d5b7f77aeac71a1eb7
I20260709 12:26:28.114876 15998 tablet_copy_source_session.cc:215] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:28.122490 22021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:28.141477 15979 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:28.144523 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:28.145119 16495 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.145625 22001 raft_consensus.cc:993] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:28.146109 22001 raft_consensus.cc:1081] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:28.146396 22006 tablet_copy_client.cc:538] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:28.156865 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b58d74f13f487eaa63ac4992bca77b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:28.157629 15907 raft_consensus.cc:3055] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:28.157913 15907 raft_consensus.cc:740] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:28.170801 16495 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:28.172655 15953 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:28.171339 15979 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:28.173583 22004 raft_consensus.cc:2804] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:28.181417 15907 consensus_queue.cc:260] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:28.196359 22004 raft_consensus.cc:697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:28.197554 22004 consensus_queue.cc:237] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:28.200613 15909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:28.201217 21967 tablet_copy_client.cc:538] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:28.201225 15909 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.201805 15909 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.209926 15909 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:28.213294 15907 raft_consensus.cc:3060] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.220014 22006 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:28.236683 15909 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:28.245440 15829 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:28.249806 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:28.250380 16495 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.252032 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350f530ddf734358bef3d1a96410b5f3" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:28.256130 15838 raft_consensus.cc:3055] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:28.256420 15838 raft_consensus.cc:740] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:28.266861 15838 consensus_queue.cc:260] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:28.282721 16495 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:28.293947 15838 raft_consensus.cc:3060] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.299100 15907 raft_consensus.cc:2468] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:28.298213 15879 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:28.308007 21949 raft_consensus.cc:2804] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:28.314903 21967 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:28.344209 21949 raft_consensus.cc:697] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:28.345471 21949 consensus_queue.cc:237] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:28.354282 15838 raft_consensus.cc:2468] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
W20260709 12:26:28.357137 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 96451.5us
W20260709 12:26:28.399078 21996 log.cc:927] Time spent T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:26:28.461722 22033 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:28.473347 22021 tablet_copy_client.cc:806] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:28.490914 22021 tablet_copy_client.cc:670] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:28.497064 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 45606.4us
I20260709 12:26:28.507701 21996 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:28.508821 21996 tablet_bootstrap.cc:492] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:28.510699 22021 tablet_copy_client.cc:538] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:28.520581 21996 ts_tablet_manager.cc:1403] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.556s	user 0.038s	sys 0.035s
I20260709 12:26:28.558065 22021 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:28.551292 21996 raft_consensus.cc:359] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:28.563406 21996 raft_consensus.cc:740] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:28.564154 21996 consensus_queue.cc:260] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:28.579308 15730 catalog_manager.cc:5697] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.585525 21996 ts_tablet_manager.cc:1434] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:26:28.587059 15729 catalog_manager.cc:5697] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 15 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.598667 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-2b991ff9e213435786d19248864c5cfc received from {username='slave'} at 127.0.0.1:58562
I20260709 12:26:28.599164 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-2b991ff9e213435786d19248864c5cfc on tablet 2b991ff9e213435786d19248864c5cfc with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:28.611617 22006 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:28.637722 22006 tablet_bootstrap.cc:492] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:28.655373 22006 ts_tablet_manager.cc:1403] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.464s	user 0.046s	sys 0.009s
I20260709 12:26:28.662627 22006 raft_consensus.cc:359] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:28.667285 22006 raft_consensus.cc:740] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:28.667938 22006 consensus_queue.cc:260] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:28.670917 22006 ts_tablet_manager.cc:1434] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:26:28.672610 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-db755710417246db916d8278741aaff0 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:26:28.673055 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-db755710417246db916d8278741aaff0 on tablet db755710417246db916d8278741aaff0 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:28.678323 15909 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:28.685688 22004 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:28.705391 16495 raft_consensus.cc:1217] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:26:28.724187 21967 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:28.751798 21967 tablet_bootstrap.cc:492] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:28.781478 21967 ts_tablet_manager.cc:1403] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.467s	user 0.030s	sys 0.025s
I20260709 12:26:28.810720 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.819001 16490 raft_consensus.cc:1275] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:28.835071 22004 consensus_queue.cc:1048] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:28.869645 21967 raft_consensus.cc:359] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:28.870510 21967 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:28.871176 21967 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:28.879715 15983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:28.880330 15983 raft_consensus.cc:606] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:28.883083 15907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:28.883587 15907 raft_consensus.cc:606] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Received request to transfer leadership to TS 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:28.892552 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:28.893764 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.894615 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.913862 15832 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:28.917316 21967 ts_tablet_manager.cc:1434] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.126s	user 0.004s	sys 0.003s
I20260709 12:26:28.918220 21949 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:28.921411 15923 tablet_copy_service.cc:342] P 761f08e40cdf4af396105d67949c0afc: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-fee2b4c1781842208f03c61ac44ad821 received from {username='slave'} at 127.0.0.1:41588
I20260709 12:26:28.921859 15923 tablet_copy_service.cc:434] P 761f08e40cdf4af396105d67949c0afc: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-fee2b4c1781842208f03c61ac44ad821 on tablet fee2b4c1781842208f03c61ac44ad821 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:28.928004 16490 raft_consensus.cc:1275] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:28.945268 21986 consensus_queue.cc:1048] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:28.957908 16486 raft_consensus.cc:1217] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:26:28.994930 22029 raft_consensus.cc:993] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:28.995471 22029 raft_consensus.cc:1081] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:28.997504 15907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e8af32d711469181861fb4a98feec9"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:28.998023 15907 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.998347 15907 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.056196 15907 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:29.062521 15907 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:29.063956 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:29.064555 15983 raft_consensus.cc:3055] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:29.064896 15983 raft_consensus.cc:740] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:29.065671 15983 consensus_queue.cc:260] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:29.063006 16490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:29.070636 16490 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.066757 15983 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:29.075172 22045 log.cc:927] Time spent T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:26:29.032735 22021 log.cc:927] Time spent T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 12:26:29.089841 16490 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:29.116297 15879 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:29.117359 21949 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:29.117971 21949 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:29.119071 21949 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:29.139943 15983 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
W20260709 12:26:29.141852 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 56488us
W20260709 12:26:29.240157 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 76415.2us
W20260709 12:26:29.263311 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 98033.2us
W20260709 12:26:29.324846 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 73882.6us
I20260709 12:26:29.363648 16487 raft_consensus.cc:1217] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:26:29.371174 22021 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:29.372229 22021 tablet_bootstrap.cc:492] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:29.373176 22021 ts_tablet_manager.cc:1403] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.815s	user 0.038s	sys 0.025s
I20260709 12:26:29.380316 22052 raft_consensus.cc:1064] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:29.383026 22052 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:29.394848 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61674.5us
W20260709 12:26:29.421185 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 62779.7us
W20260709 12:26:29.424443 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 67182.2us
W20260709 12:26:29.443437 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 106552us
W20260709 12:26:29.452963 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 144097us
I20260709 12:26:29.455145 22021 raft_consensus.cc:359] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:29.456017 22021 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:29.456703 22021 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:29.481959 22021 ts_tablet_manager.cc:1434] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 12:26:29.504837 16490 raft_consensus.cc:1217] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:26:29.518059 15731 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 14 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.535710 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-0bcdf0d8639346d5b7f77aeac71a1eb7 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:26:29.536521 15906 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:29.539007 22068 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:29.540190 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-0bcdf0d8639346d5b7f77aeac71a1eb7 on tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:29.542598 15832 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:29.545706 16487 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:29.550625 22068 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:26:29.560779 22064 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:29.579824 22080 raft_consensus.cc:1064] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
W20260709 12:26:29.598776 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 173569us
W20260709 12:26:29.913201 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 171174us
I20260709 12:26:29.929381 22080 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:29.942354 22031 raft_consensus.cc:993] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:29.942953 22051 raft_consensus.cc:1081] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Signalling peer 9fd62f0fa06a4561a0a7101b85942f86 to start an election
I20260709 12:26:29.962383 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:26:29.962900 15833 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.963222 15833 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:29.999884 15833 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:26:30.003813 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 103783us
I20260709 12:26:30.013895 15983 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:30.001431 16487 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.020704 15833 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:30.023789 22030 raft_consensus.cc:1064] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:30.036511 22031 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.025274 22082 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.027207 16489 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:30.041982 22030 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:30.048069 22049 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.050410 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:30.054945 15730 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.065490 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.067405 15906 raft_consensus.cc:3055] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:30.072542 15906 raft_consensus.cc:740] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:26:30.077893 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 68006.7us
I20260709 12:26:30.077728 15906 consensus_queue.cc:260] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:30.086681 15906 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:30.097744 21947 consensus_queue.cc:1175] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" responder_term: 16 status { last_received { term: 16 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 16 index: 11 } }
I20260709 12:26:30.118739 16489 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:30.097095 15907 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.123438 15983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "9fd62f0fa06a4561a0a7101b85942f86" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:30.124019 15983 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:30.131996 15983 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 17.
I20260709 12:26:30.146602 22031 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.150369 15838 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:30.151077 15981 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:30.152786 22080 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:30.162039 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 74654.6us
I20260709 12:26:30.173206 22080 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.179268 15803 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:30.180389 21916 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:30.188220 21916 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Becoming Leader. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:30.198784 15832 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.190243 21916 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:26:30.277935 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 46762.6us
I20260709 12:26:30.310451 15906 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fd62f0fa06a4561a0a7101b85942f86 in term 17.
W20260709 12:26:30.341228 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 109791us
W20260709 12:26:30.341249 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 126095us
I20260709 12:26:30.365612 15982 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:35452
I20260709 12:26:30.366254 15982 raft_consensus.cc:606] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:30.365684 22049 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.369415 15910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:30.370110 15910 raft_consensus.cc:606] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:30.377142 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:30.379277 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.380580 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.374447 16490 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:30.408135 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 49946.6us
I20260709 12:26:30.410909 16489 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:30.411057 15731 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: term changed from 16 to 17, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65). New cstate: current_term: 17 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.446501 15838 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:30.469928 15986 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:30.504812 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 57972.2us
W20260709 12:26:30.556888 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 72905.3us
I20260709 12:26:30.498733 22082 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 12:26:30.699004 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 182884us
W20260709 12:26:30.699697 15953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 182683us
I20260709 12:26:30.708326 15731 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.722489 22029 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:30.761106 16487 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Advancing to term 17
I20260709 12:26:30.774832 16487 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:30.774936 15838 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.778330 21979 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:30.828392 15986 consensus_queue.cc:237] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:30.886617 15906 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:30.888895 22067 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:26:30.916354 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 44866.5us
I20260709 12:26:30.921370 16487 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:30.922114 15836 raft_consensus.cc:1275] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:30.933740 22074 raft_consensus.cc:993] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:30.932276 22106 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:26:30.938949 22108 consensus_queue.cc:1048] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:30.942201 22092 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.943791 16487 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.946714 22074 raft_consensus.cc:1081] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:30.948570 15984 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:30.950906 16489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:42798
I20260709 12:26:30.951457 16489 raft_consensus.cc:493] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.951848 16489 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.951665 22105 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.954651 16486 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.979933 15731 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.983004 16489 raft_consensus.cc:515] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:30.985589 15836 raft_consensus.cc:2955] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:30.960574 21979 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:26:30.989971 22071 raft_consensus.cc:1064] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
W20260709 12:26:30.990406 22071 raft_consensus.cc:1068] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: Unable to promote non-voter 2fa3925738bd485e912c7ac0e28b0265: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:30.990520 16489 leader_election.cc:290] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:30.994546 15986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:31.007236 15986 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.022007 15721 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b991ff9e213435786d19248864c5cfc with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:31.027510 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbb40ff3a44403a8705489ecc556e3b" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:31.028118 15908 raft_consensus.cc:3055] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:31.028388 15908 raft_consensus.cc:740] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:31.030813 15909 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:31.044795 15908 consensus_queue.cc:260] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.056574 15908 raft_consensus.cc:3060] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.061455 22029 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:26:31.085628 15908 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:31.086292 15836 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.090296 15986 raft_consensus.cc:2468] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 19.
I20260709 12:26:31.116113 15729 catalog_manager.cc:5697] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 11 to 12, VOTER 761f08e40cdf4af396105d67949c0afc (127.14.78.66) evicted. New cstate: current_term: 12 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:31.130470 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 92504.2us
I20260709 12:26:31.131469 15906 consensus_queue.cc:237] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.135758 16459 leader_election.cc:304] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
W20260709 12:26:31.142864 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 82239.7us
I20260709 12:26:31.164086 22118 raft_consensus.cc:2804] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:31.184275 15901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b991ff9e213435786d19248864c5cfc with delete_type TABLET_DATA_TOMBSTONED (TS 761f08e40cdf4af396105d67949c0afc not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:37688
I20260709 12:26:31.186678 16489 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:26:31.205061 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 75846.7us
I20260709 12:26:31.212190 22079 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:26:31.208118 22118 raft_consensus.cc:697] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:31.222425 22118 consensus_queue.cc:237] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:31.226619 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 87335.8us
I20260709 12:26:31.236873 16486 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.245410 15906 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.237672 22074 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.265897 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db755710417246db916d8278741aaff0 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:31.278601 15730 catalog_manager.cc:5697] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 12 to 13, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:31.296331 16460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47013.3us
W20260709 12:26:31.305325 15802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 98210.8us
I20260709 12:26:31.312476 15838 raft_consensus.cc:1275] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:31.324735 22129 tablet_replica.cc:333] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:31.324906 22080 consensus_queue.cc:1048] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:31.325941 22129 raft_consensus.cc:2243] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:31.326818 22129 raft_consensus.cc:2272] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:31.329931 22129 ts_tablet_manager.cc:1916] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:31.350260 15833 raft_consensus.cc:2955] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.358007 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet db755710417246db916d8278741aaff0 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:43658
I20260709 12:26:31.359308 22029 raft_consensus.cc:993] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:31.359752 22029 raft_consensus.cc:1081] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:31.362591 15905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:26:31.363164 15905 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.363544 15905 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.393153 15905 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.412796 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:31.413390 15836 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.415762 15905 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:31.417640 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:31.418182 16486 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.417037 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:31.420028 15981 raft_consensus.cc:3055] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:31.420331 15981 raft_consensus.cc:740] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:31.421089 15981 consensus_queue.cc:260] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.437156 15981 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.443185 16486 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:31.444181 15836 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:31.448586 15876 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86; no voters: 
I20260709 12:26:31.471393 22079 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:31.473923 22079 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:31.474849 22079 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.532485 15981 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:31.541735 22132 tablet_replica.cc:333] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:31.549700 22126 raft_consensus.cc:1064] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:31.552491 22126 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.571802 15729 catalog_manager.cc:5697] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 18 to 19, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 19 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.570866 15730 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 14 to 15, leader changed from b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.577152 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.599532 22132 raft_consensus.cc:2243] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:31.600241 22132 raft_consensus.cc:2272] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:31.602869 22132 ts_tablet_manager.cc:1916] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:31.608332 15909 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:31.610733 21916 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:31.615535 16489 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEARNER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:31.617650 15981 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:31.621264 22072 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:31.635212 21916 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:31.647502 22072 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.655613 15905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:31.656208 15905 raft_consensus.cc:606] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Received request to transfer leadership to TS 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:31.659947 15833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c"
dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
mode: GRACEFUL
new_leader_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:56576
I20260709 12:26:31.660516 15833 raft_consensus.cc:606] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Received request to transfer leadership to TS 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:31.663329 15909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f567175d186f4342b604ea89474a493a"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
mode: GRACEFUL
new_leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:54596
I20260709 12:26:31.663867 15909 raft_consensus.cc:606] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Received request to transfer leadership to TS b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:31.665163 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:31.666790 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.667568 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.666561 16489 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.678390 22132 ts_tablet_manager.cc:1929] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:26:31.680536 22132 log.cc:1199] T db755710417246db916d8278741aaff0 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/db755710417246db916d8278741aaff0
I20260709 12:26:31.683331 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet db755710417246db916d8278741aaff0 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:31.666596 22129 ts_tablet_manager.cc:1929] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 12:26:31.694705 22129 log.cc:1199] T 2b991ff9e213435786d19248864c5cfc P 761f08e40cdf4af396105d67949c0afc: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/wals/2b991ff9e213435786d19248864c5cfc
I20260709 12:26:31.695102 15984 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.696588 15720 catalog_manager.cc:5028] TS 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): tablet 2b991ff9e213435786d19248864c5cfc (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:31.699473 22079 raft_consensus.cc:993] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: : Instructing follower b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:31.699971 22079 raft_consensus.cc:1081] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Signalling peer b5f0a13b879f47dd804f8fc4b7b19a0a to start an election
I20260709 12:26:31.701674 15981 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f567175d186f4342b604ea89474a493a"
dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
 from {username='slave'} at 127.0.0.1:43666
I20260709 12:26:31.702186 15981 raft_consensus.cc:493] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.702519 15981 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.708390 15981 raft_consensus.cc:515] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:31.712944 15909 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.716499 15730 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index 11 to 13, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } attrs { replace: true } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.728202 15981 leader_election.cc:290] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:31.730175 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:31.730782 15906 raft_consensus.cc:3055] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:31.731117 15906 raft_consensus.cc:740] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:31.731895 15906 consensus_queue.cc:260] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:31.733026 15906 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.749557 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f567175d186f4342b604ea89474a493a" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:31.750191 15836 raft_consensus.cc:3060] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.798018 15833 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.804684 16486 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:31.811053 15836 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:31.812633 15950 leader_election.cc:304] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:31.814402 22068 raft_consensus.cc:2804] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:31.815428 15905 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer 9fd62f0fa06a4561a0a7101b85942f86: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:31.815739 22068 raft_consensus.cc:697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:31.816624 22068 consensus_queue.cc:237] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:31.823485 22067 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:31.830066 22067 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:31.831528 21916 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.833370 15906 raft_consensus.cc:2468] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:31.835558 15909 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.844830 15718 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fee2b4c1781842208f03c61ac44ad821 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:31.846076 15981 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:31.847599 21972 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:31.849988 15905 raft_consensus.cc:1275] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:31.851601 22118 consensus_queue.cc:1048] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:31.869683 22067 raft_consensus.cc:993] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: : Instructing follower 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:31.870193 22072 raft_consensus.cc:1081] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Signalling peer 761f08e40cdf4af396105d67949c0afc to start an election
I20260709 12:26:31.872736 15910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c"
dest_uuid: "761f08e40cdf4af396105d67949c0afc"
 from {username='slave'} at 127.0.0.1:37350
I20260709 12:26:31.873390 15910 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.873829 15910 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.882215 15910 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.890517 15910 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:31.891574 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:31.892153 16486 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.886121 15730 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 reported cstate change: config changed from index 13 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New cstate: current_term: 17 leader_uuid: "9fd62f0fa06a4561a0a7101b85942f86" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.892561 15729 catalog_manager.cc:5697] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 14 to 15, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 15 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.900259 16486 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19.
I20260709 12:26:31.901473 15879 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:31.902731 22049 raft_consensus.cc:2804] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:31.903838 22049 raft_consensus.cc:697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:31.904683 22049 consensus_queue.cc:237] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.911971 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "636b8846a0e64d48a3b14ad3af01bb3c" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:31.912563 15838 raft_consensus.cc:3055] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:31.912847 15838 raft_consensus.cc:740] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9fd62f0fa06a4561a0a7101b85942f86, State: Running, Role: LEADER
I20260709 12:26:31.913697 15838 consensus_queue.cc:260] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:31.915035 15838 raft_consensus.cc:3060] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:31.925371 16486 raft_consensus.cc:2955] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:31.939455 15978 tablet_service.cc:1558] Processing DeleteTablet for tablet fee2b4c1781842208f03c61ac44ad821 with delete_type TABLET_DATA_TOMBSTONED (TS b5f0a13b879f47dd804f8fc4b7b19a0a not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:43658
I20260709 12:26:31.940486 22132 tablet_replica.cc:333] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:31.941632 22132 raft_consensus.cc:2243] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:31.941776 15838 raft_consensus.cc:2468] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 19.
I20260709 12:26:31.976487 22080 raft_consensus.cc:993] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: : Instructing follower 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:31.977109 22051 raft_consensus.cc:1081] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Signalling peer 2fa3925738bd485e912c7ac0e28b0265 to start an election
I20260709 12:26:32.028085 22132 raft_consensus.cc:2272] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.032222 15981 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:32.033818 22132 ts_tablet_manager.cc:1916] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:32.033886 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 89974us
I20260709 12:26:32.043968 16495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30"
dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
 from {username='slave'} at 127.0.0.1:42798
I20260709 12:26:32.044495 16495 raft_consensus.cc:493] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.044836 16495 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:32.058648 15838 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:32.083827 22132 ts_tablet_manager.cc:1929] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:26:32.056464 22031 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:26:32.120143 16495 raft_consensus.cc:515] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:32.121057 15803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 59472.1us
I20260709 12:26:32.136893 15838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "9fd62f0fa06a4561a0a7101b85942f86"
I20260709 12:26:32.144882 22079 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:32.149346 16495 leader_election.cc:290] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:32.137714 15838 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:32.151206 15910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb7213c7f6d42bc818fcdd60101ee30" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:32.151834 15910 raft_consensus.cc:3055] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:32.152119 15910 raft_consensus.cc:740] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:32.152832 15910 consensus_queue.cc:260] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:32.153931 15910 raft_consensus.cc:3060] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:32.126231 22132 log.cc:1199] T fee2b4c1781842208f03c61ac44ad821 P b5f0a13b879f47dd804f8fc4b7b19a0a: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/wals/fee2b4c1781842208f03c61ac44ad821
I20260709 12:26:32.169057 16490 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:32.172928 15910 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:32.181423 16459 leader_election.cc:304] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:32.186529 15838 raft_consensus.cc:2468] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:32.191643 15733 catalog_manager.cc:5697] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 18 to 19, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 19 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.198875 22079 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:32.191927 21972 raft_consensus.cc:2804] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:32.200637 21972 raft_consensus.cc:697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:32.203509 21972 consensus_queue.cc:237] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:32.216001 15721 catalog_manager.cc:5028] TS b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): tablet fee2b4c1781842208f03c61ac44ad821 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
W20260709 12:26:32.224961 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 92925.6us
I20260709 12:26:32.281507 15729 catalog_manager.cc:5697] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 16 to 17, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 17 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.342360 15910 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:32.345639 22120 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:32.365227 16495 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:32.374910 15833 raft_consensus.cc:1275] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:32.378535 22120 consensus_queue.cc:1048] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:32.404271 15838 raft_consensus.cc:1275] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:32.411402 22051 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:26:32.453377 22143 consensus_queue.cc:1048] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:32.523833 15908 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:32.542436 15981 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:26:32.551923 16490 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:26:32.588670 22051 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:32.593204 22143 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:32.642091 22049 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 12 to 14, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:32.688048 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:39871, user_credentials={real_user=slave}} blocked reactor thread for 47564.8us
I20260709 12:26:32.702059 15981 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 12 to 14, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:32.702302 15731 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 12 to 14, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New cstate: current_term: 15 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.712414 16489 raft_consensus.cc:2955] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 12 to 14, VOTER 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:32.713712 15720 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:32.718032 15818 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 with delete_type TABLET_DATA_TOMBSTONED (TS 9fd62f0fa06a4561a0a7101b85942f86 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:42230
I20260709 12:26:32.724196 15833 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:32.726269 22130 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:32.752640 22154 tablet_replica.cc:333] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:32.755663 22154 raft_consensus.cc:2243] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.756886 22154 raft_consensus.cc:2272] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.762606 22154 ts_tablet_manager.cc:1916] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:32.762950 15908 raft_consensus.cc:1275] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:32.765148 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:32.773182 22130 consensus_queue.cc:1048] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:32.792205 22154 ts_tablet_manager.cc:1929] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 12:26:32.792745 22154 log.cc:1199] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 9fd62f0fa06a4561a0a7101b85942f86: Deleting WAL directory at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/wals/0bcdf0d8639346d5b7f77aeac71a1eb7
I20260709 12:26:32.794556 15718 catalog_manager.cc:5028] TS 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): tablet 0bcdf0d8639346d5b7f77aeac71a1eb7 (table test-workload [id=4947ab1c8f1441c29eae400ebca10994]) successfully deleted
I20260709 12:26:32.904574 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:32.906241 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:32.906883 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.000061 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.100589 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
W20260709 12:26:33.115226 15950 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:26:33.149511 15950 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.163697 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.171417 15950 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.180193 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.192827 15876 consensus_peers.cc:597] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.193073 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.199973 15876 consensus_peers.cc:597] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.200567 15876 consensus_peers.cc:597] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.213802 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.215889 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.220670 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.241698 15876 consensus_peers.cc:597] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.243639 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.252370 15876 consensus_peers.cc:597] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.299577 15950 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.307047 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.313199 15950 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.332245 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:33.333699 15876 consensus_peers.cc:597] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.344674 14649 tablet_replica.cc:333] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.345953 14649 raft_consensus.cc:2243] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.346989 14649 raft_consensus.cc:2272] T 2b991ff9e213435786d19248864c5cfc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.352105 14649 tablet_replica.cc:333] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.354157 14649 raft_consensus.cc:2243] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.354688 14649 raft_consensus.cc:2272] T 17a5ecf16d3543828d16fe27e061a42e P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.355466 15876 consensus_peers.cc:597] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.357300 14649 tablet_replica.cc:333] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.358264 14649 raft_consensus.cc:2243] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.381368 14649 raft_consensus.cc:2272] T 506492d6bd024ce682676a3ecdcf186f P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.384156 14649 tablet_replica.cc:333] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.392808 14649 raft_consensus.cc:2243] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.394101 14649 raft_consensus.cc:2272] T 58dc18a7b4f448bd8d86eec830a0f612 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.396703 14649 tablet_replica.cc:333] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.397739 14649 raft_consensus.cc:2243] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.409680 14649 raft_consensus.cc:2272] T 766b6f7dc34f48babcf3d91d76eecc59 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.411264 15876 consensus_peers.cc:597] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.414098 14649 tablet_replica.cc:333] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
W20260709 12:26:33.423635 15950 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.431645 14649 raft_consensus.cc:2243] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.441282 14649 raft_consensus.cc:2272] T 636b8846a0e64d48a3b14ad3af01bb3c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.448738 14649 tablet_replica.cc:333] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.449676 14649 raft_consensus.cc:2243] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:33.452543 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.453739 14649 raft_consensus.cc:2272] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.457788 14649 tablet_replica.cc:333] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.466440 14649 raft_consensus.cc:2243] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.467067 14649 raft_consensus.cc:2272] T f567175d186f4342b604ea89474a493a P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.473549 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.481702 14649 tablet_replica.cc:333] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.482653 14649 raft_consensus.cc:2243] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.491605 14649 raft_consensus.cc:2272] T 98e0016561fa4f72935bc3bc36cda023 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.492982 15950 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.506250 14649 tablet_replica.cc:333] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.507160 14649 raft_consensus.cc:2243] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.508066 14649 raft_consensus.cc:2272] T b727a5c8856c46cba501e397d6c1fc7b P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.511889 14649 tablet_replica.cc:333] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.512780 14649 raft_consensus.cc:2243] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.522583 14649 raft_consensus.cc:2272] T 7c8f740585214d0fb73ad203c56cbaaf P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.526772 14649 tablet_replica.cc:333] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.528380 14649 raft_consensus.cc:2243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.529114 14649 raft_consensus.cc:2272] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 9fd62f0fa06a4561a0a7101b85942f86 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.531903 14649 tablet_replica.cc:333] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
W20260709 12:26:33.544421 15876 consensus_peers.cc:597] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.553180 14649 raft_consensus.cc:2243] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.558068 14649 raft_consensus.cc:2272] T 6b4a53aaee3c41c181784f0c39780d2b P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.561694 15950 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.567375 14649 tablet_replica.cc:333] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
W20260709 12:26:33.573880 15950 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.575073 14649 raft_consensus.cc:2243] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.575735 14649 raft_consensus.cc:2272] T ec82df0e9104447ab3e50c2a6968cf7e P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.585618 14649 tablet_replica.cc:333] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.586360 14649 raft_consensus.cc:2243] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:33.595971 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.605186 14649 raft_consensus.cc:2272] T db755710417246db916d8278741aaff0 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.608079 14649 tablet_replica.cc:333] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.608953 14649 raft_consensus.cc:2243] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.610023 14649 raft_consensus.cc:2272] T 1db7600d8ee247d0abddcf104708f152 P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.612988 14649 tablet_replica.cc:333] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.623652 14649 raft_consensus.cc:2243] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:33.628192 15950 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.629469 14649 raft_consensus.cc:2272] T 661598743dad4055844a0b0f97c07156 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.645133 14649 tablet_replica.cc:333] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.646194 14649 raft_consensus.cc:2243] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.647073 14649 raft_consensus.cc:2272] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.648762 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.653017 14649 tablet_replica.cc:333] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.654799 14649 raft_consensus.cc:2243] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.665892 14649 raft_consensus.cc:2272] T 5521db1dbeb94ad8ae63681494d5565d P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.671236 14649 tablet_replica.cc:333] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.687671 14649 raft_consensus.cc:2243] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.688712 14649 raft_consensus.cc:2272] T 114faa3c35e5416eaf96295ba51a61af P 9fd62f0fa06a4561a0a7101b85942f86 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.712015 14649 tablet_replica.cc:333] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.712941 14649 raft_consensus.cc:2243] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.713614 14649 raft_consensus.cc:2272] T 350f530ddf734358bef3d1a96410b5f3 P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.719034 14649 tablet_replica.cc:333] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.721946 14649 raft_consensus.cc:2243] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.726095 14649 raft_consensus.cc:2272] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.742167 14649 tablet_replica.cc:333] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.742951 14649 raft_consensus.cc:2243] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.743494 14649 raft_consensus.cc:2272] T 5de0236e5de04f55852a74f344fb872b P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.754208 14649 tablet_replica.cc:333] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.758621 14649 raft_consensus.cc:2243] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.769923 14649 raft_consensus.cc:2272] T 8772e3a5c1494ac0a3cda60be3150573 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.772984 14649 tablet_replica.cc:333] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.774055 14649 raft_consensus.cc:2243] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.775178 14649 raft_consensus.cc:2272] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.778007 14649 tablet_replica.cc:333] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.778795 14649 raft_consensus.cc:2243] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.779803 14649 raft_consensus.cc:2272] T 56d26e9d10514d43b1dc78bb348fede9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.784847 14649 tablet_replica.cc:333] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.793890 14649 raft_consensus.cc:2243] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.794545 14649 raft_consensus.cc:2272] T 9e271b9d1bc8403ba1c9d3e80c36917c P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.797294 14649 tablet_replica.cc:333] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.798018 14649 raft_consensus.cc:2243] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.798982 14649 raft_consensus.cc:2272] T 5698e9ff3e90444081e6234a1cd5ce81 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.802824 14649 tablet_replica.cc:333] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.809619 14649 raft_consensus.cc:2243] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.810182 14649 raft_consensus.cc:2272] T 0b9763772dd94e749d16fd361de18016 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.813158 14649 tablet_replica.cc:333] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.813930 14649 raft_consensus.cc:2243] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.814517 14649 raft_consensus.cc:2272] T 12b10f85daf040e1af9735597b9af404 P 9fd62f0fa06a4561a0a7101b85942f86 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.824529 14649 tablet_replica.cc:333] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.825268 14649 raft_consensus.cc:2243] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.826224 14649 raft_consensus.cc:2272] T 95a62357a0c84b929b49daf3efbf1e27 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.828562 14649 tablet_replica.cc:333] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.829339 14649 raft_consensus.cc:2243] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.833401 14649 raft_consensus.cc:2272] T 9aa3e193f2f64a16b07bd7462017199d P 9fd62f0fa06a4561a0a7101b85942f86 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.839793 14649 tablet_replica.cc:333] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.840543 14649 raft_consensus.cc:2243] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.844597 14649 raft_consensus.cc:2272] T 98db7b6a993347c8a1e39b15956132ce P 9fd62f0fa06a4561a0a7101b85942f86 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.847236 14649 tablet_replica.cc:333] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.850716 14649 raft_consensus.cc:2243] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.851347 14649 raft_consensus.cc:2272] T 5c7327c39306430dbeb82a9c27813987 P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.861447 14649 tablet_replica.cc:333] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.862274 14649 raft_consensus.cc:2243] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.863162 14649 raft_consensus.cc:2272] T fee2b4c1781842208f03c61ac44ad821 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.870132 14649 tablet_replica.cc:333] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.870872 14649 raft_consensus.cc:2243] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.871582 14649 raft_consensus.cc:2272] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 9fd62f0fa06a4561a0a7101b85942f86 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.875586 15783 auto_rebalancer.cc:629] Failed to schedule move for tablet 6b4a53aaee3c41c181784f0c39780d2b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:33.876150 14649 tablet_replica.cc:333] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.881059 14649 raft_consensus.cc:2243] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.880594 15981 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:33.881775 14649 raft_consensus.cc:2272] T 879e5f4abbab45deb735e1ae9ae2d204 P 9fd62f0fa06a4561a0a7101b85942f86 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.907572 14649 tablet_replica.cc:333] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.908385 14649 raft_consensus.cc:2243] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.910310 14649 raft_consensus.cc:2272] T 3e12395965994c48bc79f9b642be60ef P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.913865 14649 tablet_replica.cc:333] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
W20260709 12:26:33.915787 15953 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 766b6f7dc34f48babcf3d91d76eecc59. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.917095 15909 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:26:33.921355 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.932004 22068 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:33.951423 14649 raft_consensus.cc:2243] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.952095 14649 raft_consensus.cc:2272] T 4db6493294254313a1e9687fd4ba9b08 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.961236 14649 tablet_replica.cc:333] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.981302 14649 raft_consensus.cc:2243] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.980355 15909 raft_consensus.cc:2955] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:33.982105 14649 raft_consensus.cc:2272] T 1bb7213c7f6d42bc818fcdd60101ee30 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.984854 14649 tablet_replica.cc:333] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:33.985575 14649 raft_consensus.cc:2243] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.986099 14649 raft_consensus.cc:2272] T 8b51295f13874e3492f0541da8a1f625 P 9fd62f0fa06a4561a0a7101b85942f86 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.971906 22120 raft_consensus.cc:2955] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:34.006974 14649 tablet_replica.cc:333] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:34.007795 14649 raft_consensus.cc:2243] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.008841 14649 raft_consensus.cc:2272] T b792e6a0c581428bae7ae0020c5c6edc P 9fd62f0fa06a4561a0a7101b85942f86 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.017741 15729 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
W20260709 12:26:34.019892 15783 auto_rebalancer.cc:629] Failed to schedule move for tablet afc80a856f5e400285f41a5b49b603d9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:34.024370 15984 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:34.026063 14649 tablet_replica.cc:333] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:34.026889 14649 raft_consensus.cc:2243] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.027556 14649 raft_consensus.cc:2272] T 5ed21b81727749c4aa09fa4278bc8398 P 9fd62f0fa06a4561a0a7101b85942f86 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.030411 14649 tablet_replica.cc:333] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:34.031188 14649 raft_consensus.cc:2243] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.037369 14649 raft_consensus.cc:2272] T afc80a856f5e400285f41a5b49b603d9 P 9fd62f0fa06a4561a0a7101b85942f86 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.047390 14649 tablet_replica.cc:333] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86: stopping tablet replica
I20260709 12:26:34.050262 14649 raft_consensus.cc:2243] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.052721 14649 raft_consensus.cc:2272] T 83a3e78f7a344d43ab144f24c55a1e4b P 9fd62f0fa06a4561a0a7101b85942f86 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.162984 15909 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:26:34.165758 15953 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743): Couldn't send request to peer 2fa3925738bd485e912c7ac0e28b0265. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17a5ecf16d3543828d16fe27e061a42e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.166656 22029 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:34.191934 15950 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.266243 15909 raft_consensus.cc:2955] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:34.264191 22172 raft_consensus.cc:2955] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } } }
I20260709 12:26:34.318195 22174 ts_tablet_manager.cc:933] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:34.338766 15729 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: config changed from index -1 to 11, NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) added. New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.343225 22174 tablet_copy_client.cc:323] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:26:34.345496 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 766b6f7dc34f48babcf3d91d76eecc59 from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:26:34.346102 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 766b6f7dc34f48babcf3d91d76eecc59 from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-766b6f7dc34f48babcf3d91d76eecc59
I20260709 12:26:34.356226 15998 tablet_copy_source_session.cc:215] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:34.403359 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b6f7dc34f48babcf3d91d76eecc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.511059 22174 tablet_copy_client.cc:806] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:34.511806 22174 tablet_copy_client.cc:670] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:34.570170 22174 tablet_copy_client.cc:538] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:34.586234 22176 ts_tablet_manager.cc:933] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: Initiating tablet copy from peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:34.638446 22176 tablet_copy_client.cc:323] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Beginning tablet copy session from remote peer at address 127.14.78.67:39871
I20260709 12:26:34.672008 22174 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
W20260709 12:26:34.834357 15950 connection.cc:769] client connection to 127.14.78.65:38945 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:26:34.763001 22178 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.783010 22179 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.837500 22178 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:34.837603 22179 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:34.840035 22178 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:34.840155 22180 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.840741 22180 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:34.847157 15876 connection.cc:769] client connection to 127.14.78.65:38945 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:26:34.840322 22179 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:34.876055 22180 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:34.895061 22118 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.895660 22118 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:34.897291 21972 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.897931 21972 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:34.900128 21972 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:34.901422 22184 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.902139 22184 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:34.904302 22184 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:34.882573 22178 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.883265 22182 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.905337 22130 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.924875 22130 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:34.927027 22130 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:34.927457 22118 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:34.935703 22178 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:34.939208 22178 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:34.939759 22182 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:34.946094 15979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:34.946861 15979 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:34.952107 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:34.959337 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:34.962761 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:34.963374 15908 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 18.
I20260709 12:26:34.972795 22120 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.973436 22120 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:34.975713 22120 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:34.977160 15987 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:34.981302 22183 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.981904 22183 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:34.982455 22188 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.983018 22188 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:34.984099 22183 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:34.989997 22182 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:34.993633 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:34.994463 22180 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:34.994942 22180 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:34.995409 22180 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:35.002239 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.005685 22172 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:35.006085 22172 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.006454 22172 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:35.009243 16457 connection.cc:769] client connection to 127.14.78.65:38945 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:26:35.009809 22180 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.012419 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.012945 15908 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 11.
I20260709 12:26:35.015604 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.016872 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.020546 15998 tablet_copy_service.cc:140] P b5f0a13b879f47dd804f8fc4b7b19a0a: Received BeginTabletCopySession request for tablet 17a5ecf16d3543828d16fe27e061a42e from peer 2fa3925738bd485e912c7ac0e28b0265 ({username='slave'} at 127.0.0.1:58562)
I20260709 12:26:35.021147 15998 tablet_copy_service.cc:161] P b5f0a13b879f47dd804f8fc4b7b19a0a: Beginning new tablet copy session on tablet 17a5ecf16d3543828d16fe27e061a42e from peer 2fa3925738bd485e912c7ac0e28b0265 at {username='slave'} at 127.0.0.1:58562: session id = 2fa3925738bd485e912c7ac0e28b0265-17a5ecf16d3543828d16fe27e061a42e
I20260709 12:26:35.021260 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:35.019268 15950 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.022310 16489 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:26:35.014717 16459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 97958us
I20260709 12:26:35.026973 22029 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:35.031142 22029 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.031574 22029 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.019353 22178 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:26:35.032245 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 61458.6us
I20260709 12:26:35.025575 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.028296 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.034061 15988 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:26:35.028761 15953 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.029094 22185 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.039933 22185 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.042076 22185 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.032258 22178 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.044934 22178 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.030305 22192 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.039423 22068 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:35.045956 22068 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.046382 22068 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:35.052137 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.052690 22188 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.053824 22020 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:35.054224 22020 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.054548 22020 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:35.059326 22029 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:35.036731 15876 leader_election.cc:336] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.063433 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.064690 22159 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:35.065505 22159 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.065474 22192 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.066275 22159 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.067993 22192 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.075122 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:35.064729 15876 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.077205 15876 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.078300 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.078928 15988 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:35.080199 22180 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.081450 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.082043 15906 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 13.
I20260709 12:26:35.085343 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.087157 22068 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.087610 22172 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.089386 22068 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.091674 15998 tablet_copy_source_session.cc:215] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:26:35.092268 15950 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.091560 15876 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.090323 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:35.098372 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:35.099260 22189 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:35.099666 22189 raft_consensus.cc:493] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.100056 22189 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:35.101435 22029 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.102406 22172 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.107393 22189 raft_consensus.cc:515] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:35.121409 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 104617us
I20260709 12:26:35.122817 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.122411 22189 leader_election.cc:290] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.126919 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:35.127673 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:35.128243 15907 raft_consensus.cc:3060] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:35.128577 15905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:35.107914 22159 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.129338 15905 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 19: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:35.130475 15908 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 12: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
I20260709 12:26:35.130615 22159 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.109576 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.110056 22191 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.132339 22191 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.134614 22191 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.110116 22180 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.135833 15907 raft_consensus.cc:2468] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:35.114720 22176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a5ecf16d3543828d16fe27e061a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:35.137586 22184 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:35.137977 22184 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.138340 22184 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.141403 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
W20260709 12:26:35.115053 15876 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.115290 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e0016561fa4f72935bc3bc36cda023" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:35.143181 16486 raft_consensus.cc:2393] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 14: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:35.144523 22189 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.145221 22189 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.149607 22172 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:26:35.115824 15950 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.117093 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
W20260709 12:26:35.150708 15950 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.150900 15988 raft_consensus.cc:2393] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 19: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:35.150923 22185 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.150166 22172 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.151582 22185 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.135717 22180 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.152768 15906 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:35.153692 22172 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.158200 22185 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.158629 22189 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.102077 22020 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.169014 22171 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.169718 16489 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 14: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
I20260709 12:26:35.169590 22171 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.171708 22171 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.172592 22171 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.173569 22171 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.174654 22189 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.175274 22189 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.175751 22171 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:35.176540 15876 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.177670 22189 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:35.178537 15950 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.182986 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.147714 22184 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.183633 15987 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 11.
I20260709 12:26:35.184841 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.183091 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.185554 15987 raft_consensus.cc:2393] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 12: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:35.172986 22020 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.153764 22180 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.186628 22196 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.161092 16459 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:35.188271 22020 raft_consensus.cc:2804] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:35.188829 22020 raft_consensus.cc:697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:35.190918 22196 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.190972 22020 consensus_queue.cc:237] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.191619 22196 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.193919 22196 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.158738 15952 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.181988 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.194743 15988 raft_consensus.cc:2393] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa3925738bd485e912c7ac0e28b0265 in current term 14: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
W20260709 12:26:35.194789 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 44444.4us
I20260709 12:26:35.195242 22196 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.197674 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.199934 22196 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:35.200644 22196 raft_consensus.cc:493] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.201121 22196 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.160075 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.201822 15906 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:26:35.202188 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.202847 15987 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:35.185053 22184 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.201014 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.206993 22029 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.207794 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.207588 22029 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.208501 22189 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:35.208886 22189 raft_consensus.cc:493] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.209272 22189 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.211030 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:35.211165 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:35.211678 16486 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:35.211925 22191 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:35.212285 22191 raft_consensus.cc:493] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.212457 22029 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.212683 22191 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.213439 15953 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.214322 22029 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:35.214991 22029 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
W20260709 12:26:35.182402 15876 leader_election.cc:336] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.215485 22029 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:35.215867 15876 leader_election.cc:336] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.219730 22159 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.220340 22159 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.181520 15879 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:35.222024 22184 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:35.224676 15879 leader_election.cc:304] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.225445 22184 raft_consensus.cc:2749] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:35.227103 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.229161 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:35.229741 15906 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:35.229979 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a62357a0c84b929b49daf3efbf1e27" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.230604 15987 raft_consensus.cc:3060] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.231479 22159 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:35.231616 15950 leader_election.cc:336] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.233628 15879 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:35.234817 22184 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:26:35.235507 15950 leader_election.cc:336] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.241391 15950 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.242237 22068 raft_consensus.cc:2749] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:35.237234 22191 raft_consensus.cc:515] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.244459 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:35.245256 16489 raft_consensus.cc:2393] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 16: Already voted for candidate 2fa3925738bd485e912c7ac0e28b0265 in this term.
W20260709 12:26:35.244460 15950 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.246222 15950 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.246511 15987 raft_consensus.cc:2468] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:35.246897 22172 raft_consensus.cc:2749] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:26:35.247987 22174 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:26:35.247794 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5521db1dbeb94ad8ae63681494d5565d" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:35.249583 15906 raft_consensus.cc:3060] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.249660 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:35.250334 16489 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 10.
W20260709 12:26:35.251237 16457 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.251997 16457 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.253244 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.254045 22188 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:35.254395 22188 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.254736 22188 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.261014 22029 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.262890 15906 raft_consensus.cc:2468] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:26:35.263513 22192 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.264225 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.264093 22192 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.264410 16459 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 
I20260709 12:26:35.264973 22184 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:35.263057 22029 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.263291 22191 leader_election.cc:290] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.265276 22193 raft_consensus.cc:2804] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:35.240561 22189 raft_consensus.cc:515] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.265869 22193 raft_consensus.cc:697] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:35.266206 22192 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.267280 22189 leader_election.cc:290] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.266896 22193 consensus_queue.cc:237] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.269116 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e12395965994c48bc79f9b642be60ef" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.269534 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.269682 15980 raft_consensus.cc:3060] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.273057 22176 tablet_copy_client.cc:806] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:35.265398 22184 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.273957 22184 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.275156 15729 catalog_manager.cc:5697] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 13 to 14, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 14 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:35.275907 15980 raft_consensus.cc:2468] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 12.
I20260709 12:26:35.239028 22196 raft_consensus.cc:515] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.277583 16460 leader_election.cc:304] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.278685 15988 raft_consensus.cc:2393] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 13: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:35.280753 22020 raft_consensus.cc:2804] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:35.281359 22020 raft_consensus.cc:697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:35.282436 22020 consensus_queue.cc:237] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.286731 15879 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.287787 22180 raft_consensus.cc:2804] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:35.288112 15876 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.288422 22180 raft_consensus.cc:697] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
W20260709 12:26:35.288817 15876 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.289374 22180 consensus_queue.cc:237] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.252404 16457 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:35.300168 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5698e9ff3e90444081e6234a1cd5ce81" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:35.305400 16489 raft_consensus.cc:3060] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:35.301555 22174 log.cc:927] Time spent T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
W20260709 12:26:35.302037 15950 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.309417 15950 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.310138 22029 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:26:35.311239 15950 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.311728 15950 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.312412 22029 raft_consensus.cc:2749] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:26:35.313364 15950 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.313787 15950 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.314447 22029 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.321960 15879 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:35.326289 15950 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.302660 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 45979.7us
W20260709 12:26:35.328060 15876 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.328802 15876 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.329314 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b08a1f9a245453cafe7fbd2ad9f4b17" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:35.329859 15906 raft_consensus.cc:3060] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.278644 22196 leader_election.cc:290] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.337818 22176 tablet_copy_client.cc:670] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:35.348608 16489 raft_consensus.cc:2468] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:26:35.359484 15950 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.355297 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.362131 15988 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 12.
I20260709 12:26:35.358210 15906 raft_consensus.cc:2468] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
W20260709 12:26:35.354031 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 102050us
W20260709 12:26:35.363698 16457 leader_election.cc:336] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.353068 15953 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.380183 22029 raft_consensus.cc:2804] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:35.380663 22029 raft_consensus.cc:697] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:26:35.370582 16457 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.382279 16457 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.349202 22189 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.370049 22171 raft_consensus.cc:2749] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.386098 22193 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:35.352027 15733 catalog_manager.cc:5697] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 15 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.384737 15952 leader_election.cc:304] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.284976 22184 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.397534 22183 raft_consensus.cc:2804] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:35.398048 22183 raft_consensus.cc:697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:35.348987 22188 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.389266 22185 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.407230 22188 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:35.407017 22185 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.409965 22185 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:35.411295 15950 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.412051 15950 leader_election.cc:336] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.412492 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:35.413779 15879 leader_election.cc:304] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 2fa3925738bd485e912c7ac0e28b0265, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.414894 22174 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:35.415050 22185 raft_consensus.cc:2749] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.416564 22174 tablet_bootstrap.cc:492] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:35.413956 22029 consensus_queue.cc:237] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:35.418004 15876 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.417999 22174 ts_tablet_manager.cc:1403] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.746s	user 0.057s	sys 0.010s
I20260709 12:26:35.399049 22183 consensus_queue.cc:237] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.423305 15906 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b5f0a13b879f47dd804f8fc4b7b19a0a in current term 16: Already voted for candidate 761f08e40cdf4af396105d67949c0afc in this term.
W20260709 12:26:35.423277 16457 leader_election.cc:336] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.421795 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.434912 22181 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:35.435326 22181 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.435674 22181 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:35.438342 22182 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.439123 22182 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:35.446179 15950 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.446717 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:35.448313 22184 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:35.454196 15876 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.455590 22182 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.456887 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:35.457543 16495 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:35.458644 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:35.459475 22196 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:35.459880 22196 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.460289 22196 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.460218 22181 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.463995 22176 tablet_copy_client.cc:538] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:35.464869 15950 leader_election.cc:336] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.467725 15876 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.468293 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 46601us
W20260709 12:26:35.473726 16457 leader_election.cc:336] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.478408 22196 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.479580 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.481282 15981 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 16: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:35.482209 22176 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap starting.
I20260709 12:26:35.476361 22174 raft_consensus.cc:359] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:35.487617 22174 raft_consensus.cc:740] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:35.488700 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b792e6a0c581428bae7ae0020c5c6edc" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
W20260709 12:26:35.489645 15950 leader_election.cc:336] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.489959 16489 raft_consensus.cc:3060] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.490118 22174 consensus_queue.cc:260] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:35.492825 22196 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.493432 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.494027 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:35.474495 16457 leader_election.cc:336] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.494803 22196 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.495152 16457 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:35.495800 22159 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:35.497301 22159 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.497740 22159 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.498389 16489 raft_consensus.cc:2468] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:35.501019 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:35.505436 15953 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.506573 22188 raft_consensus.cc:2804] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:35.508271 22188 raft_consensus.cc:697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:35.509239 22188 consensus_queue.cc:237] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.514180 22191 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.515332 22171 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:26:35.515654 16457 leader_election.cc:336] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.517109 16457 leader_election.cc:336] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.519719 16457 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.520227 16457 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:35.523419 16457 leader_election.cc:336] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.523957 22020 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:35.525178 16457 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.525629 16457 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:35.535724 22189 raft_consensus.cc:2749] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:35.533121 22171 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.541442 22171 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.542342 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:35.542917 16489 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 17.
I20260709 12:26:35.543465 22171 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.550869 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:35.551473 15988 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 15.
I20260709 12:26:35.555140 22174 ts_tablet_manager.cc:1434] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.001s
I20260709 12:26:35.552848 15730 catalog_manager.cc:5697] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 12 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.557320 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-766b6f7dc34f48babcf3d91d76eecc59 received from {username='slave'} at 127.0.0.1:58562
I20260709 12:26:35.557976 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-766b6f7dc34f48babcf3d91d76eecc59 on tablet 766b6f7dc34f48babcf3d91d76eecc59 with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:35.567193 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98db7b6a993347c8a1e39b15956132ce" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:35.567977 16489 raft_consensus.cc:3060] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:35.570086 15876 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.574972 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.577183 22171 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:35.577597 22171 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.578023 22171 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.526446 22181 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:35.586678 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.587512 16489 raft_consensus.cc:2468] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 11.
I20260709 12:26:35.592654 22202 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:35.593731 22202 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9fd62f0fa06a4561a0a7101b85942f86)
I20260709 12:26:35.594111 22202 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:35.601194 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.604708 15950 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:35.610790 15879 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.611711 22159 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.615294 22179 raft_consensus.cc:2804] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:35.615856 22179 raft_consensus.cc:697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:35.618883 22179 consensus_queue.cc:237] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:35.622720 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.630411 15876 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.641398 16457 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.673413 22159 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.674429 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b583c4dfb6f45e9bd36c36a3f0dbff8" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.674999 15987 raft_consensus.cc:3060] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.673272 22202 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.680789 22202 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:35.682615 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5480 after lost signal to thread 14652
I20260709 12:26:35.683151 22171 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:35.683553 15876 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:35.683737 15766 debug-util.cc:398] Leaking SignalData structure 0x7b080015bb00 after lost signal to thread 15769
I20260709 12:26:35.687772 15987 raft_consensus.cc:2468] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 13.
W20260709 12:26:35.688196 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08002d85c0 after lost signal to thread 15862
W20260709 12:26:35.689126 15766 debug-util.cc:398] Leaking SignalData structure 0x7b080020e940 after lost signal to thread 15937
W20260709 12:26:35.690013 15766 debug-util.cc:398] Leaking SignalData structure 0x7b080032eaa0 after lost signal to thread 16012
I20260709 12:26:35.689920 15879 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.686610 16489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee2b4c1781842208f03c61ac44ad821" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:35.691226 16489 raft_consensus.cc:3060] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:35.691295 15766 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2ee0 after lost signal to thread 16521
I20260709 12:26:35.692972 22159 raft_consensus.cc:2804] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:35.693701 22159 raft_consensus.cc:697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:35.694918 22159 consensus_queue.cc:237] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:35.697732 15987 raft_consensus.cc:1275] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:35.699033 22202 consensus_queue.cc:1048] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:35.709350 16489 raft_consensus.cc:2468] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 18.
I20260709 12:26:35.711503 15879 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.714720 22202 raft_consensus.cc:2804] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:35.715219 22202 raft_consensus.cc:697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:35.716114 22202 consensus_queue.cc:237] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:35.716554 15907 raft_consensus.cc:1275] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:26:35.719017 15876 consensus_peers.cc:597] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.719048 22192 consensus_queue.cc:1048] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:26:35.726322 15876 consensus_peers.cc:597] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.739531 15876 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:35.760205 15730 catalog_manager.cc:5697] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 12 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:35.780380 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:35.785600 15730 catalog_manager.cc:5697] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 12 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:35.790750 14649 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:35.796494 15876 consensus_peers.cc:597] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.796504 16457 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.805392 15988 raft_consensus.cc:1275] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:35.806680 22171 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:35.814522 15988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc80a856f5e400285f41a5b49b603d9" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:35.815121 15988 raft_consensus.cc:3060] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.821247 16489 raft_consensus.cc:1275] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:35.822764 22029 consensus_queue.cc:1048] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:35.819296 22192 consensus_queue.cc:1048] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:35.847409 15729 catalog_manager.cc:5697] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 15 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 16 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:35.849272 15729 catalog_manager.cc:5697] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 11 to 12, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 12 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:35.852402 15733 catalog_manager.cc:5697] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 10 to 11, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 11 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.855289 15907 raft_consensus.cc:1275] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:35.856644 16495 raft_consensus.cc:1217] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:26:35.855149 15733 catalog_manager.cc:5697] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 12 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 13 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.858184 22191 consensus_queue.cc:1048] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:35.864550 16457 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.865414 15950 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.866079 15876 consensus_peers.cc:597] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.868676 15876 consensus_peers.cc:597] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:35.878266 15988 raft_consensus.cc:2468] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761f08e40cdf4af396105d67949c0afc in term 16.
I20260709 12:26:35.879374 15879 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:35.880539 22171 raft_consensus.cc:2804] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:35.881023 22171 raft_consensus.cc:697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Becoming Leader. State: Replica: 761f08e40cdf4af396105d67949c0afc, State: Running, Role: LEADER
I20260709 12:26:35.882002 22171 consensus_queue.cc:237] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:35.883898 15950 consensus_peers.cc:597] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.889343 22214 log.cc:927] Time spent T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:26:35.973212 15876 consensus_peers.cc:597] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.976138 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.982650 15876 consensus_peers.cc:597] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.999505 15950 consensus_peers.cc:597] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:36.000331 15950 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.000979 15950 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.042721 15950 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.051916 15733 catalog_manager.cc:5697] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 17 to 18, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 18 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.054816 15733 catalog_manager.cc:5697] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc reported cstate change: term changed from 15 to 16, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 761f08e40cdf4af396105d67949c0afc (127.14.78.66). New cstate: current_term: 16 leader_uuid: "761f08e40cdf4af396105d67949c0afc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.060057 15906 raft_consensus.cc:1275] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:36.067534 22176 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:36.071815 22182 consensus_queue.cc:1048] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:36.078188 22176 tablet_bootstrap.cc:492] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: Bootstrap complete.
I20260709 12:26:36.078953 22176 ts_tablet_manager.cc:1403] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: Time spent bootstrapping tablet: real 0.597s	user 0.034s	sys 0.035s
W20260709 12:26:36.030431 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.083722 16457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 53341.8us
I20260709 12:26:36.081924 22176 raft_consensus.cc:359] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
I20260709 12:26:36.086508 22176 raft_consensus.cc:740] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Initialized, Role: LEARNER
I20260709 12:26:36.087252 22176 consensus_queue.cc:260] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: NON_VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: true } }
W20260709 12:26:36.095391 15950 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.096199 15876 consensus_peers.cc:597] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.099833 22176 ts_tablet_manager.cc:1434] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:26:36.102433 16489 raft_consensus.cc:1217] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 12:26:36.107013 15998 tablet_copy_service.cc:342] P b5f0a13b879f47dd804f8fc4b7b19a0a: Request end of tablet copy session 2fa3925738bd485e912c7ac0e28b0265-17a5ecf16d3543828d16fe27e061a42e received from {username='slave'} at 127.0.0.1:58562
I20260709 12:26:36.107389 15998 tablet_copy_service.cc:434] P b5f0a13b879f47dd804f8fc4b7b19a0a: ending tablet copy session 2fa3925738bd485e912c7ac0e28b0265-17a5ecf16d3543828d16fe27e061a42e on tablet 17a5ecf16d3543828d16fe27e061a42e with peer 2fa3925738bd485e912c7ac0e28b0265
I20260709 12:26:36.130355 16489 raft_consensus.cc:1275] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:36.131821 22172 consensus_queue.cc:1048] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:26:36.132754 15876 consensus_peers.cc:597] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.165674 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.170025 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.172613 16489 raft_consensus.cc:1275] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:36.174955 22171 consensus_queue.cc:1048] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:36.178778 15876 consensus_peers.cc:597] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:36.180616 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.186892 15950 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.228438 15987 raft_consensus.cc:1275] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:36.232241 22181 consensus_queue.cc:1048] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:26:36.250533 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.259061 15876 consensus_peers.cc:597] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.286456 16489 raft_consensus.cc:1275] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:36.288275 22159 consensus_queue.cc:1048] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:26:36.289572 15876 consensus_peers.cc:597] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:36.310622 15876 consensus_peers.cc:597] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:36.329764 15950 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.343984 15987 raft_consensus.cc:1275] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 761f08e40cdf4af396105d67949c0afc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:36.346776 22159 consensus_queue.cc:1048] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:36.386260 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.430467 15876 consensus_peers.cc:597] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.475116 22172 raft_consensus.cc:1064] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:36.488827 22172 consensus_queue.cc:237] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:36.546746 15950 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.569602 16489 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:36.571650 22196 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.581683 15907 raft_consensus.cc:1275] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:36.583238 22196 consensus_queue.cc:1048] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.620694 22029 raft_consensus.cc:2955] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:36.642839 15907 raft_consensus.cc:2955] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:36.662416 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.664340 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.673605 16489 raft_consensus.cc:2955] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:36.679193 15730 catalog_manager.cc:5697] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc reported cstate change: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:36.723016 22235 raft_consensus.cc:1064] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: attempting to promote NON_VOTER 2fa3925738bd485e912c7ac0e28b0265 to VOTER
I20260709 12:26:36.732676 22235 consensus_queue.cc:237] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:36.793355 14649 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15859)
I20260709 12:26:36.795028 16489 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEARNER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:36.804666 22172 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.805441 15906 raft_consensus.cc:1275] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:26:36.807718 15950 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.811050 22172 consensus_queue.cc:1048] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.897189 22029 raft_consensus.cc:2955] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:36.904616 16489 raft_consensus.cc:2955] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:36.914630 22172 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.915196 22172 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:36.930954 15907 raft_consensus.cc:2955] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
W20260709 12:26:36.936244 15950 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:36.956571 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:36.960096 15906 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 19.
I20260709 12:26:36.950105 22172 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:36.963164 15733 catalog_manager.cc:5697] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: config changed from index 11 to 12, 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } } }
I20260709 12:26:36.964003 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:36.979091 22234 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:36.979513 22234 raft_consensus.cc:493] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.979846 22234 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:37.033188 22234 raft_consensus.cc:515] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:37.038975 15950 leader_election.cc:336] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.044931 22234 leader_election.cc:290] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:37.048974 15952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:41469, user_credentials={real_user=slave}} blocked reactor thread for 70880.4us
I20260709 12:26:37.054095 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114faa3c35e5416eaf96295ba51a61af" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:37.054646 15906 raft_consensus.cc:3060] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:37.065313 22243 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.065868 22243 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:37.068324 22243 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:37.068790 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:37.069411 15980 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 14.
I20260709 12:26:37.072244 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:37.080164 22242 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:37.080621 22242 raft_consensus.cc:493] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.080972 22242 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:37.089767 22242 raft_consensus.cc:515] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:37.090725 15906 raft_consensus.cc:2468] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 20.
W20260709 12:26:37.091200 16457 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.091948 15952 leader_election.cc:304] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:37.092976 22244 raft_consensus.cc:2804] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:37.093087 22242 leader_election.cc:290] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:37.093007 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58dc18a7b4f448bd8d86eec830a0f612" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:37.094108 15980 raft_consensus.cc:3060] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:37.095350 22244 raft_consensus.cc:697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 20 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:37.096328 22244 consensus_queue.cc:237] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.107400 15980 raft_consensus.cc:2468] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
W20260709 12:26:37.109093 16457 leader_election.cc:336] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.113898 16460 leader_election.cc:304] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:37.114689 22242 raft_consensus.cc:2804] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:37.115890 22242 raft_consensus.cc:697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:37.116780 22242 consensus_queue.cc:237] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:37.154929 15733 catalog_manager.cc:5697] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 13 to 15, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 15 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.168845 15730 catalog_manager.cc:5697] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 18 to 20, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 20 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.216744 22244 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.217296 22244 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.219520 22244 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:37.223651 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:37.224305 15907 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 12.
I20260709 12:26:37.233292 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:37.234081 22244 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:37.234535 22244 raft_consensus.cc:493] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.234858 22244 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:37.244786 15950 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.248095 22244 raft_consensus.cc:515] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:37.268249 15950 leader_election.cc:336] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.275235 22244 leader_election.cc:290] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:37.275174 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b4a53aaee3c41c181784f0c39780d2b" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
I20260709 12:26:37.276193 15906 raft_consensus.cc:3060] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:37.290050 15906 raft_consensus.cc:2468] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 13.
I20260709 12:26:37.291152 15952 leader_election.cc:304] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:37.292191 22244 raft_consensus.cc:2804] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:37.292675 22244 raft_consensus.cc:697] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:37.293639 22244 consensus_queue.cc:237] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.312580 15733 catalog_manager.cc:5697] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 11 to 13, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 13 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.383244 22244 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.383744 22244 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.480098 22244 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:37.492146 15950 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:37.495002 15879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43743, user_credentials={real_user=slave}} blocked reactor thread for 110155us
I20260709 12:26:37.498608 22202 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.499116 22202 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.500437 15906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc" is_pre_election: true
I20260709 12:26:37.501072 15906 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:37.501118 22202 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:37.480768 15876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 95946.3us
I20260709 12:26:37.506814 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:37.525128 22172 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:37.531401 22172 raft_consensus.cc:493] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.535192 22172 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:37.535322 15906 raft_consensus.cc:1275] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:37.549865 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "761f08e40cdf4af396105d67949c0afc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:26:37.564056 15876 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.572211 22244 consensus_queue.cc:1048] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:37.574030 15950 consensus_peers.cc:597] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.622140 22172 raft_consensus.cc:515] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.623701 15981 raft_consensus.cc:2393] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 761f08e40cdf4af396105d67949c0afc in current term 17: Already voted for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in this term.
I20260709 12:26:37.626621 15879 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:37.627769 22202 raft_consensus.cc:3060] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:37.628890 15907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8772e3a5c1494ac0a3cda60be3150573" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "761f08e40cdf4af396105d67949c0afc"
W20260709 12:26:37.633303 15950 leader_election.cc:336] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:37.624727 22172 leader_election.cc:290] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Requested vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:37.637507 22202 raft_consensus.cc:2749] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:37.644098 15907 raft_consensus.cc:2468] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:37.664917 15952 leader_election.cc:304] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:37.668488 22172 raft_consensus.cc:2804] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:37.669046 22172 raft_consensus.cc:697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:37.669968 22172 consensus_queue.cc:237] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:37.702436 15733 catalog_manager.cc:5697] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 15 to 17, leader changed from 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 17 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.708767 15988 raft_consensus.cc:1275] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:37.710307 22242 consensus_queue.cc:1048] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:37.721246 16457 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.744462 15908 raft_consensus.cc:1275] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:37.748700 22172 consensus_queue.cc:1048] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:37.776991 15876 consensus_peers.cc:597] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.793851 14649 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:37.832528 15950 consensus_peers.cc:597] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.858235 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.971449 15950 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:38.082790 15907 raft_consensus.cc:1275] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:38.087774 22172 consensus_queue.cc:1048] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:38.122464 15876 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111) [suppressed 405 similar messages]
W20260709 12:26:38.133848 15876 consensus_peers.cc:597] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.160048 15950 consensus_peers.cc:597] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:38.170907 15876 consensus_peers.cc:597] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.222532 16457 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.270409 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.278709 15950 consensus_peers.cc:597] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.361694 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.372588 15950 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.373726 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.380050 16457 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.401556 15950 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.414003 16457 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.431051 15876 consensus_peers.cc:597] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.438514 15876 consensus_peers.cc:597] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.447211 15876 consensus_peers.cc:597] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.456240 15876 consensus_peers.cc:597] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.475051 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.478240 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.480791 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.490291 15876 consensus_peers.cc:597] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.496073 15950 consensus_peers.cc:597] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.545214 15950 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.560412 15950 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.575556 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.691193 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.713464 15950 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.775187 15876 consensus_peers.cc:597] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.787889 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.794317 14649 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:38.821696 15950 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.835753 15876 consensus_peers.cc:597] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:38.876713 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 55068.4us
W20260709 12:26:38.890844 15876 consensus_peers.cc:597] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.899296 15876 consensus_peers.cc:597] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:38.943770 15950 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:39.044754 15876 consensus_peers.cc:597] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:39.052642 15876 consensus_peers.cc:597] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:39.081470 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:39.217950 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:39.323705 15950 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:39.349076 15950 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:39.794754 14649 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:39.950580 15950 consensus_peers.cc:597] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.112217 16457 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.135380 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.186268 15950 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.370180 15876 consensus_peers.cc:597] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.417215 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.534650 15950 consensus_peers.cc:597] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.596412 16457 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:40.612128 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.689576 15950 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.719184 15876 consensus_peers.cc:597] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.728518 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.795258 14649 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:40.801225 15950 consensus_peers.cc:597] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.806203 15876 consensus_peers.cc:597] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:40.881050 15950 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:40.916774 15876 consensus_peers.cc:597] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.929144 16457 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:40.974874 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.986752 16457 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:40.989725 15876 consensus_peers.cc:597] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:40.990367 15876 consensus_peers.cc:597] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.003120 15950 consensus_peers.cc:597] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.033200 15876 consensus_peers.cc:597] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.057603 15950 consensus_peers.cc:597] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.079047 15876 consensus_peers.cc:597] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.079623 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.133188 15876 consensus_peers.cc:597] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.180017 15950 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.180503 15950 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.202484 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.203117 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.245019 15950 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.249888 15876 consensus_peers.cc:597] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.263738 15876 consensus_peers.cc:597] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.314735 15876 consensus_peers.cc:597] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.322587 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.357856 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.383896 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.486394 15950 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.654110 15876 consensus_peers.cc:597] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.704619 15950 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.707970 15876 consensus_peers.cc:597] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.712725 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:41.795727 14649 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:41.864338 15950 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:41.890991 15950 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:42.466462 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:42.511519 15950 consensus_peers.cc:597] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:42.540233 15950 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:42.676643 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:42.777784 15876 consensus_peers.cc:597] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:42.796188 14649 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15859)
W20260709 12:26:43.039911 16457 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:43.043797 16457 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.116484 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.139226 15950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111) [suppressed 450 similar messages]
W20260709 12:26:43.220891 15876 consensus_peers.cc:597] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.247179 15950 consensus_peers.cc:597] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:43.262033 15950 consensus_peers.cc:597] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:43.278023 15876 consensus_peers.cc:597] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:43.327405 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
W20260709 12:26:43.340829 16457 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.378404 15950 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.378983 15950 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.395982 15876 consensus_peers.cc:597] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.421948 15950 consensus_peers.cc:597] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.440862 15876 consensus_peers.cc:597] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.441987 15950 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.445639 15950 consensus_peers.cc:597] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.499888 16457 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.530591 15876 consensus_peers.cc:597] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.544790 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.545822 15876 consensus_peers.cc:597] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.561760 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.591220 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:43.674957 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
W20260709 12:26:43.688122 15952 consensus_peers.cc:597] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.688707 15952 consensus_peers.cc:597] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.698530 16459 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.699596 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.704263 16459 consensus_peers.cc:597] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.706014 15876 consensus_peers.cc:597] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.731086 15952 consensus_peers.cc:597] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.741376 15950 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.744719 15950 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.755460 15952 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.757925 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.765657 15952 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.771129 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.777824 15876 consensus_peers.cc:597] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:43.801424 16459 consensus_peers.cc:597] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.802655 16459 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.812171 15876 consensus_peers.cc:597] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.827946 16459 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.835606 15952 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.866848 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:43.872227 15952 consensus_peers.cc:597] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.874085 14649 tablet_replica.cc:333] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:43.875208 14649 raft_consensus.cc:2243] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:43.875931 14649 raft_consensus.cc:2272] T 766b6f7dc34f48babcf3d91d76eecc59 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:43.880049 14649 tablet_replica.cc:333] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
W20260709 12:26:43.886014 16459 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.890758 14649 raft_consensus.cc:2243] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:43.891778 14649 raft_consensus.cc:2272] T 17a5ecf16d3543828d16fe27e061a42e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:43.906834 16459 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.907430 16459 consensus_peers.cc:597] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.908669 15952 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.912035 14649 tablet_replica.cc:333] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:43.912981 14649 raft_consensus.cc:2243] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:43.915937 14649 raft_consensus.cc:2272] T 25191835faf945ef870143a9ce1b2127 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:43.919302 15876 consensus_peers.cc:597] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:43.920397 14649 tablet_replica.cc:333] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:43.921370 14649 raft_consensus.cc:2243] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:43.922565 14649 raft_consensus.cc:2272] T 636b8846a0e64d48a3b14ad3af01bb3c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:43.944059 14649 tablet_replica.cc:333] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:43.944974 14649 raft_consensus.cc:2243] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:43.945616 14649 raft_consensus.cc:2272] T 83a3e78f7a344d43ab144f24c55a1e4b P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:43.950601 15876 consensus_peers.cc:597] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:43.950831 14649 tablet_replica.cc:333] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
W20260709 12:26:43.961889 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:43.962150 14649 raft_consensus.cc:2243] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:43.962790 14649 raft_consensus.cc:2272] T 98e0016561fa4f72935bc3bc36cda023 P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:43.980497 15952 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:43.981854 15950 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:43.984454 15952 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.006301 14649 tablet_replica.cc:333] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.007234 14649 raft_consensus.cc:2243] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.008224 14649 raft_consensus.cc:2272] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.010943 14649 tablet_replica.cc:333] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.011747 14649 raft_consensus.cc:2243] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.012683 14649 raft_consensus.cc:2272] T 6e7dbc561f4f4c5da63c0d84e92b9871 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.015199 14649 tablet_replica.cc:333] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.016007 14649 raft_consensus.cc:2243] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.016575 14649 raft_consensus.cc:2272] T f567175d186f4342b604ea89474a493a P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.020228 14649 tablet_replica.cc:333] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.021019 14649 raft_consensus.cc:2243] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.022078 14649 raft_consensus.cc:2272] T baa957d5e1074b30a83ccaa548766896 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.023068 15876 consensus_peers.cc:597] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:44.024922 14649 tablet_replica.cc:333] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.025837 14649 raft_consensus.cc:2243] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.026429 14649 raft_consensus.cc:2272] T b727a5c8856c46cba501e397d6c1fc7b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.028975 14649 tablet_replica.cc:333] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.029830 14649 raft_consensus.cc:2243] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.030426 14649 raft_consensus.cc:2272] T a79a04e9fda24da8a4ca30980a0ef796 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.033741 14649 tablet_replica.cc:333] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.034426 14649 raft_consensus.cc:2243] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.034986 14649 raft_consensus.cc:2272] T ec82df0e9104447ab3e50c2a6968cf7e P 761f08e40cdf4af396105d67949c0afc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.037634 14649 tablet_replica.cc:333] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.038350 14649 raft_consensus.cc:2243] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.039721 14649 raft_consensus.cc:2272] T db755710417246db916d8278741aaff0 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.042320 14649 tablet_replica.cc:333] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.043078 14649 raft_consensus.cc:2243] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.043591 14649 raft_consensus.cc:2272] T 1db7600d8ee247d0abddcf104708f152 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.045226 16459 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.046373 14649 tablet_replica.cc:333] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.047395 14649 raft_consensus.cc:2243] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.048189 14649 raft_consensus.cc:2272] T 661598743dad4055844a0b0f97c07156 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.050715 14649 tablet_replica.cc:333] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.051462 14649 raft_consensus.cc:2243] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.151329 14649 raft_consensus.cc:2272] T 7cbb40ff3a44403a8705489ecc556e3b P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.154117 14649 tablet_replica.cc:333] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.154891 14649 raft_consensus.cc:2243] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.155439 14649 raft_consensus.cc:2272] T 6b4a53aaee3c41c181784f0c39780d2b P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.162736 15876 consensus_peers.cc:597] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:44.174865 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:44.192837 16459 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.218502 16459 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.267829 14649 tablet_replica.cc:333] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.272121 14649 raft_consensus.cc:2243] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.273797 14649 raft_consensus.cc:2272] T 7bf6eca653c94d5bba2406c3006ac72e P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.279121 14649 tablet_replica.cc:333] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.281000 14649 raft_consensus.cc:2243] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.282405 14649 raft_consensus.cc:2272] T 7571c77d7cc54b31955653214a4cee6c P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.285553 15950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:38945, user_credentials={real_user=slave}} blocked reactor thread for 53990.9us
I20260709 12:26:44.297442 14649 tablet_replica.cc:333] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
W20260709 12:26:44.306226 15950 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:44.309247 15952 consensus_peers.cc:597] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.310647 15952 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.328910 15952 consensus_peers.cc:597] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.367578 15952 consensus_peers.cc:597] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.374752 16459 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:44.379135 15950 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:44.383527 14649 raft_consensus.cc:2243] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.388255 14649 raft_consensus.cc:2272] T 1b3c37964b604d879b4e5a45e6154d8e P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.391582 14649 tablet_replica.cc:333] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.397583 14649 raft_consensus.cc:2243] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.399240 14649 raft_consensus.cc:2272] T 5ca952dcf3d340e9a816b8ba8f2beb8a P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.407524 15950 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:44.418226 14649 tablet_replica.cc:333] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.424378 14649 raft_consensus.cc:2243] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.433727 14649 raft_consensus.cc:2272] T 5521db1dbeb94ad8ae63681494d5565d P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.436085 15950 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:44.470273 14649 tablet_replica.cc:333] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.482026 14649 raft_consensus.cc:2243] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.483794 14649 raft_consensus.cc:2272] T 114faa3c35e5416eaf96295ba51a61af P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.498925 14649 tablet_replica.cc:333] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.510993 14649 raft_consensus.cc:2243] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.517638 14649 raft_consensus.cc:2272] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.531689 14649 tablet_replica.cc:333] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.538169 14649 raft_consensus.cc:2243] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.553546 14649 raft_consensus.cc:2272] T 9e271b9d1bc8403ba1c9d3e80c36917c P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.567720 14649 tablet_replica.cc:333] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.578647 14649 raft_consensus.cc:2243] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.581822 14649 raft_consensus.cc:2272] T 5ed21b81727749c4aa09fa4278bc8398 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.584873 14649 tablet_replica.cc:333] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.585811 14649 raft_consensus.cc:2243] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.586990 14649 raft_consensus.cc:2272] T 12b10f85daf040e1af9735597b9af404 P 761f08e40cdf4af396105d67949c0afc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.590293 14649 tablet_replica.cc:333] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.591100 14649 raft_consensus.cc:2243] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.592991 14649 raft_consensus.cc:2272] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.596202 14649 tablet_replica.cc:333] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.597065 14649 raft_consensus.cc:2243] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.598500 14649 raft_consensus.cc:2272] T 5de0236e5de04f55852a74f344fb872b P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.601502 14649 tablet_replica.cc:333] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.602458 14649 raft_consensus.cc:2243] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.603209 14649 raft_consensus.cc:2272] T 43b58d74f13f487eaa63ac4992bca77b P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.609644 14649 tablet_replica.cc:333] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.610558 14649 raft_consensus.cc:2243] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.613235 14649 raft_consensus.cc:2272] T 21e8af32d711469181861fb4a98feec9 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.617350 14649 tablet_replica.cc:333] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.618193 14649 raft_consensus.cc:2243] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.619019 14649 raft_consensus.cc:2272] T 8772e3a5c1494ac0a3cda60be3150573 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.621908 14649 tablet_replica.cc:333] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.623108 14649 raft_consensus.cc:2243] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.624652 14649 raft_consensus.cc:2272] T 0b9763772dd94e749d16fd361de18016 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.628355 14649 tablet_replica.cc:333] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.629309 14649 raft_consensus.cc:2243] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.630038 14649 raft_consensus.cc:2272] T 21c971bd20d548a8a1dd8f98022a1f7e P 761f08e40cdf4af396105d67949c0afc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.633589 14649 tablet_replica.cc:333] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.634370 14649 raft_consensus.cc:2243] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.635910 14649 raft_consensus.cc:2272] T 350f530ddf734358bef3d1a96410b5f3 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.639161 14649 tablet_replica.cc:333] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.640031 14649 raft_consensus.cc:2243] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.642318 14649 raft_consensus.cc:2272] T 4db6493294254313a1e9687fd4ba9b08 P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.645730 14649 tablet_replica.cc:333] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.646649 14649 raft_consensus.cc:2243] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.647910 14649 raft_consensus.cc:2272] T afd0e40a445b47b68759b884aff8da86 P 761f08e40cdf4af396105d67949c0afc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.651167 14649 tablet_replica.cc:333] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.652164 14649 raft_consensus.cc:2243] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.653700 14649 raft_consensus.cc:2272] T 98db7b6a993347c8a1e39b15956132ce P 761f08e40cdf4af396105d67949c0afc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.656392 14649 tablet_replica.cc:333] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.657141 14649 raft_consensus.cc:2243] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.659011 14649 raft_consensus.cc:2272] T fee2b4c1781842208f03c61ac44ad821 P 761f08e40cdf4af396105d67949c0afc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.662134 14649 tablet_replica.cc:333] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.662930 14649 raft_consensus.cc:2243] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.663621 14649 raft_consensus.cc:2272] T 9aa3e193f2f64a16b07bd7462017199d P 761f08e40cdf4af396105d67949c0afc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.666239 14649 tablet_replica.cc:333] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.667023 14649 raft_consensus.cc:2243] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.668802 14649 raft_consensus.cc:2272] T 95a62357a0c84b929b49daf3efbf1e27 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.671903 14649 tablet_replica.cc:333] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.672657 14649 raft_consensus.cc:2243] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.673430 14649 raft_consensus.cc:2272] T 021499433bf04873a1ec6376aba69864 P 761f08e40cdf4af396105d67949c0afc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.676540 14649 tablet_replica.cc:333] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.677304 14649 raft_consensus.cc:2243] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:44.678108 14649 raft_consensus.cc:2272] T 1bb7213c7f6d42bc818fcdd60101ee30 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.681190 14649 tablet_replica.cc:333] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.681913 14649 raft_consensus.cc:2243] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.683137 14649 raft_consensus.cc:2272] T a5852b04bfec4fa5b2fee780cfb44ce2 P 761f08e40cdf4af396105d67949c0afc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:44.686335 14649 tablet_replica.cc:333] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc: stopping tablet replica
I20260709 12:26:44.686986 14649 raft_consensus.cc:2243] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:44.688268 14649 raft_consensus.cc:2272] T afc80a856f5e400285f41a5b49b603d9 P 761f08e40cdf4af396105d67949c0afc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:44.774614 15950 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:44.930922 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:45.059137 22281 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.059810 22281 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.065901 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:45.069574 15952 leader_election.cc:336] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.070035 15952 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:45.070986 22234 raft_consensus.cc:2749] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:45.071723 22281 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:45.226177 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:45.274876 22234 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.275388 22234 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:45.286804 15950 consensus_peers.cc:597] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:45.287674 22234 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:45.289383 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:45.307116 15952 leader_election.cc:336] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.307575 15952 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:45.310467 22234 raft_consensus.cc:2749] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:45.354516 16457 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:45.362033 22273 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.362737 22273 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:45.371883 16459 leader_election.cc:336] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.374258 16457 leader_election.cc:336] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.374722 16457 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.375763 22276 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:45.378204 22273 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.399489 22276 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.400068 22276 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.402278 22276 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.407159 22276 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.407691 22276 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.411100 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:45.411700 15987 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 17.
I20260709 12:26:45.413077 16460 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:45.413815 22265 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:45.414172 22265 raft_consensus.cc:493] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.414530 22265 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:45.426177 22276 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:45.442497 22273 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.443085 22273 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.455915 22265 raft_consensus.cc:515] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:45.458424 16457 leader_election.cc:336] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.463626 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:45.465237 22273 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:45.470332 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa957d5e1074b30a83ccaa548766896" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:45.470854 15987 raft_consensus.cc:3060] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:45.477999 22288 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.478681 22288 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.479327 15987 raft_consensus.cc:2468] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 18.
I20260709 12:26:45.480599 16460 leader_election.cc:304] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:45.481065 22288 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:45.482384 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:45.483059 15980 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:26:45.484277 16460 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:45.485283 22234 raft_consensus.cc:493] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.485803 22234 raft_consensus.cc:515] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.487810 22234 leader_election.cc:290] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.481710 22288 raft_consensus.cc:2804] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:45.493253 15952 leader_election.cc:336] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.497726 16459 leader_election.cc:336] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.498999 16459 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.504149 22290 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.504629 22290 raft_consensus.cc:493] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.505055 22290 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.506263 22289 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:45.495623 22265 leader_election.cc:290] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:45.528986 16459 leader_election.cc:336] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.529613 22288 raft_consensus.cc:697] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:45.534377 22288 consensus_queue.cc:237] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.532788 22290 raft_consensus.cc:515] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.537653 22290 leader_election.cc:290] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:45.542326 15950 leader_election.cc:336] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.542825 15950 leader_election.cc:304] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.546972 22263 raft_consensus.cc:2749] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:45.552366 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcdf0d8639346d5b7f77aeac71a1eb7" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:45.552980 15980 raft_consensus.cc:3060] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.561204 15980 raft_consensus.cc:2468] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:26:45.565419 16460 leader_election.cc:304] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:45.567304 22293 raft_consensus.cc:2804] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:45.567886 22293 raft_consensus.cc:697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:45.569223 22293 consensus_queue.cc:237] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:45.572672 16459 leader_election.cc:336] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.573215 16459 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:45.574458 22276 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:45.594049 16459 leader_election.cc:336] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.595748 16459 leader_election.cc:336] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.594082 16457 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:45.597322 15733 catalog_manager.cc:5697] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 17 to 18, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 18 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:45.599839 16459 leader_election.cc:336] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.663489 15733 catalog_manager.cc:5697] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 16 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:45.704725 15950 consensus_peers.cc:597] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:45.711727 16457 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:45.712891 22234 raft_consensus.cc:493] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.713522 22234 raft_consensus.cc:515] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.714082 22293 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.714635 22293 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.716382 22279 raft_consensus.cc:493] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.716938 22279 raft_consensus.cc:515] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.717564 22293 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.720239 22293 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.720876 22293 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.721241 22281 raft_consensus.cc:493] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.722347 22281 raft_consensus.cc:515] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.724186 22281 leader_election.cc:290] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.721679 22263 raft_consensus.cc:493] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.724848 22263 raft_consensus.cc:515] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.726068 22279 leader_election.cc:290] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:45.727679 16459 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.728731 22263 leader_election.cc:290] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.729666 22234 leader_election.cc:290] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:45.730183 16457 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:45.730611 15952 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.730613 16457 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:45.737413 15950 leader_election.cc:336] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.737892 15950 leader_election.cc:304] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:45.737970 15952 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.738580 15952 leader_election.cc:336] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.743587 15980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:26:45.743039 16459 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.745371 22293 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:45.745312 16460 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:45.746160 22276 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:45.747182 22276 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:45.748090 15952 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.750694 15950 leader_election.cc:336] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.751160 15950 leader_election.cc:304] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
W20260709 12:26:45.755424 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:45.752977 22301 raft_consensus.cc:2749] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:45.757091 15950 leader_election.cc:336] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.759768 15950 leader_election.cc:304] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.757506 22301 raft_consensus.cc:2749] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:45.760946 22234 raft_consensus.cc:2749] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:45.762036 15950 leader_election.cc:336] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.762501 15950 leader_election.cc:304] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.763480 22301 raft_consensus.cc:2749] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:45.803063 15950 consensus_peers.cc:597] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:45.817592 22263 raft_consensus.cc:493] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.818174 22263 raft_consensus.cc:515] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
W20260709 12:26:45.826304 15952 leader_election.cc:336] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.829574 22263 leader_election.cc:290] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:45.830193 15950 leader_election.cc:336] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.831590 15950 leader_election.cc:304] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.831125 22263 raft_consensus.cc:493] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.832487 22301 raft_consensus.cc:2749] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:45.832993 22263 raft_consensus.cc:515] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.835294 22263 leader_election.cc:290] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:45.845010 15952 leader_election.cc:336] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.848762 22263 raft_consensus.cc:493] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:26:45.848924 15950 leader_election.cc:336] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.849537 15950 leader_election.cc:304] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.849977 22301 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.853229 22281 raft_consensus.cc:2749] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:45.853014 22301 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.855088 22301 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:45.856555 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:45.857170 16495 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:45.858412 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:45.859354 22301 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.859709 22301 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:26:45.859870 15952 leader_election.cc:336] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.860069 22301 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:45.862638 15950 consensus_peers.cc:597] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:45.849285 22263 raft_consensus.cc:515] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:45.867127 22263 leader_election.cc:290] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:45.875002 22301 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:45.875602 15952 leader_election.cc:336] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:45.879750 15950 leader_election.cc:336] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.881592 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b3c37964b604d879b4e5a45e6154d8e" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:45.882125 16495 raft_consensus.cc:3060] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.880165 15950 leader_election.cc:304] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.885720 22281 raft_consensus.cc:2749] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:45.889289 16495 raft_consensus.cc:2468] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:45.890394 15953 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:45.891172 22263 raft_consensus.cc:2804] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:45.891443 15952 leader_election.cc:336] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.892421 22263 raft_consensus.cc:697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:45.893440 22263 consensus_queue.cc:237] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.898267 22301 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:45.902360 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:45.904235 15950 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:45.924387 22276 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.924960 22276 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:45.940317 16457 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:45.941409 22276 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:45.953382 16459 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.953922 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:45.954944 22294 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:45.954749 15733 catalog_manager.cc:5697] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.958838 22263 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.959352 22263 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.961382 22263 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:45.962942 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
W20260709 12:26:45.965771 15952 leader_election.cc:336] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.966220 15952 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 2fa3925738bd485e912c7ac0e28b0265, 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:45.966892 22263 raft_consensus.cc:2749] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:45.990675 22294 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:45.991171 22294 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:45.993515 22294 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:45.994833 15987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
W20260709 12:26:45.997584 16459 leader_election.cc:336] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:45.997985 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:45.999048 22294 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:46.009186 15950 consensus_peers.cc:597] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:46.009884 16459 consensus_peers.cc:597] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.015125 22263 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
W20260709 12:26:46.015678 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:46.015692 22263 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.018880 22294 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.019354 22294 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.021304 22294 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
I20260709 12:26:46.021905 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:46.022528 16495 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 17.
I20260709 12:26:46.023797 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:46.024544 22281 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:46.024931 22281 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.025311 22281 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.029479 22263 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
W20260709 12:26:46.034343 15952 leader_election.cc:336] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:46.035394 22263 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.035893 22263 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:46.036903 16459 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:46.037869 16457 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:46.038337 16457 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:46.041337 15987 raft_consensus.cc:1275] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:26:46.042850 22294 consensus_queue.cc:1048] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:46.046496 22294 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:46.052244 15950 consensus_peers.cc:597] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:46.062738 22281 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.063246 15980 raft_consensus.cc:1275] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Refusing update from remote peer 2fa3925738bd485e912c7ac0e28b0265: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:46.064772 22294 consensus_queue.cc:1048] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:46.068426 22294 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.068949 22294 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:46.075091 16459 leader_election.cc:336] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:46.075213 15952 leader_election.cc:336] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:46.075793 15952 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:46.076035 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" is_pre_election: true
I20260709 12:26:46.076634 15981 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 15.
I20260709 12:26:46.077689 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:46.078375 22276 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:46.078516 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:46.078738 22276 raft_consensus.cc:493] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.079120 22276 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.087231 22263 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:46.087453 22294 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:46.089452 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265" is_pre_election: true
I20260709 12:26:46.090149 16486 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 15.
I20260709 12:26:46.091420 15953 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:46.092489 22263 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:46.092842 22263 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.093245 22263 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.095296 22281 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:46.088963 16495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5852b04bfec4fa5b2fee780cfb44ce2" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:46.101831 16495 raft_consensus.cc:3060] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.088553 22276 raft_consensus.cc:515] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.108310 22276 leader_election.cc:290] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:46.112053 16459 leader_election.cc:336] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:46.112605 16459 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:46.114796 15981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd0e40a445b47b68759b884aff8da86" candidate_uuid: "2fa3925738bd485e912c7ac0e28b0265" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a"
I20260709 12:26:46.115363 15981 raft_consensus.cc:3060] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.117993 22263 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.120663 16486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e8af32d711469181861fb4a98feec9" candidate_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2fa3925738bd485e912c7ac0e28b0265"
I20260709 12:26:46.121214 16486 raft_consensus.cc:3060] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.122924 16495 raft_consensus.cc:2468] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 18.
I20260709 12:26:46.128517 15981 raft_consensus.cc:2468] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa3925738bd485e912c7ac0e28b0265 in term 16.
I20260709 12:26:46.134087 15953 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:46.134925 16460 leader_election.cc:304] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc
I20260709 12:26:46.135164 22301 raft_consensus.cc:2804] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:46.135674 22301 raft_consensus.cc:697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
I20260709 12:26:46.136425 22276 raft_consensus.cc:2804] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:46.136958 22276 raft_consensus.cc:697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Becoming Leader. State: Replica: 2fa3925738bd485e912c7ac0e28b0265, State: Running, Role: LEADER
I20260709 12:26:46.136600 22301 consensus_queue.cc:237] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.138465 22276 consensus_queue.cc:237] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:46.129140 16486 raft_consensus.cc:2468] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f0a13b879f47dd804f8fc4b7b19a0a in term 16.
I20260709 12:26:46.142657 15953 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265, b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 
I20260709 12:26:46.146682 22281 raft_consensus.cc:2804] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:46.147522 22281 raft_consensus.cc:697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Becoming Leader. State: Replica: b5f0a13b879f47dd804f8fc4b7b19a0a, State: Running, Role: LEADER
W20260709 12:26:46.147683 16459 consensus_peers.cc:597] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.148499 22281 consensus_queue.cc:237] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:46.162848 15950 consensus_peers.cc:597] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.173650 16459 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:46.178821 15733 catalog_manager.cc:5697] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68). New cstate: current_term: 16 leader_uuid: "2fa3925738bd485e912c7ac0e28b0265" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.185400 22279 raft_consensus.cc:493] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:46.186046 22263 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: Requested vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), 2fa3925738bd485e912c7ac0e28b0265 (127.14.78.68:43743)
I20260709 12:26:46.185966 22279 raft_consensus.cc:515] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } }
I20260709 12:26:46.188128 22279 leader_election.cc:290] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:46.192962 15952 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:46.198123 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.199167 15952 consensus_peers.cc:597] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.204533 15950 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:46.209816 15952 consensus_peers.cc:597] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.210354 15952 leader_election.cc:336] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:46.210774 15952 leader_election.cc:304] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5f0a13b879f47dd804f8fc4b7b19a0a; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:46.213231 22281 raft_consensus.cc:2749] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:46.216027 16459 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.218066 16457 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:46.219434 15733 catalog_manager.cc:5697] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 17 to 18, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 18 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.221285 15733 catalog_manager.cc:5697] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a reported cstate change: term changed from 15 to 16, leader changed from 761f08e40cdf4af396105d67949c0afc (127.14.78.66) to b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67). New cstate: current_term: 16 leader_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.277318 16486 raft_consensus.cc:1275] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:46.279012 22281 consensus_queue.cc:1048] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:46.290329 15952 consensus_peers.cc:597] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.296885 16459 consensus_peers.cc:597] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.303267 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.313848 16459 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.324604 15952 consensus_peers.cc:597] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.348747 15952 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.355123 15952 consensus_peers.cc:597] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.355633 15952 consensus_peers.cc:597] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.356063 15952 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.362457 15950 consensus_peers.cc:597] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.422425 16459 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.439240 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.446767 16459 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:46.455097 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
W20260709 12:26:46.467132 16459 consensus_peers.cc:597] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.470489 16459 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.471241 15952 consensus_peers.cc:597] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.476971 15952 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.481382 15950 consensus_peers.cc:597] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.506565 15950 consensus_peers.cc:597] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:46.534976 16486 raft_consensus.cc:1275] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:46.536670 22301 consensus_queue.cc:1048] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:46.546195 15952 consensus_peers.cc:597] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.594808 15952 consensus_peers.cc:597] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.596692 15950 consensus_peers.cc:597] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.612017 15952 consensus_peers.cc:597] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.616679 15952 consensus_peers.cc:597] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.617224 15952 consensus_peers.cc:597] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.620500 16459 consensus_peers.cc:597] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.654072 16459 consensus_peers.cc:597] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:46.665488 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
W20260709 12:26:46.683539 16460 consensus_peers.cc:597] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.702816 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.711724 16460 consensus_peers.cc:597] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.714382 16460 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.718885 16460 consensus_peers.cc:597] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.747102 16486 raft_consensus.cc:1275] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Refusing update from remote peer b5f0a13b879f47dd804f8fc4b7b19a0a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:46.750823 22301 consensus_queue.cc:1048] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:46.789168 16460 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.794054 16460 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.825953 16460 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.835961 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:46.837267 15952 consensus_peers.cc:597] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.844278 16459 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:46.848137 15950 consensus_peers.cc:597] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:46.858635 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:46.862262 14649 tablet_replica.cc:333] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.863317 14649 raft_consensus.cc:2243] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.864965 14649 raft_consensus.cc:2272] T 766b6f7dc34f48babcf3d91d76eecc59 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.868794 14649 tablet_replica.cc:333] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.869735 14649 raft_consensus.cc:2243] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.876075 14649 raft_consensus.cc:2272] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.879209 14649 tablet_replica.cc:333] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.880193 14649 raft_consensus.cc:2243] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:46.889753 16460 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.890913 14649 raft_consensus.cc:2272] T 506492d6bd024ce682676a3ecdcf186f P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.893832 14649 tablet_replica.cc:333] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.894659 14649 raft_consensus.cc:2243] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.896211 14649 raft_consensus.cc:2272] T 17a5ecf16d3543828d16fe27e061a42e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.898895 14649 tablet_replica.cc:333] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.918016 14649 raft_consensus.cc:2243] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.918799 14649 raft_consensus.cc:2272] T 25191835faf945ef870143a9ce1b2127 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.921671 14649 tablet_replica.cc:333] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.922533 14649 raft_consensus.cc:2243] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.923784 14649 raft_consensus.cc:2272] T 2b991ff9e213435786d19248864c5cfc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.926545 14649 tablet_replica.cc:333] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.927472 14649 raft_consensus.cc:2243] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.928567 14649 raft_consensus.cc:2272] T baa957d5e1074b30a83ccaa548766896 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.931514 14649 tablet_replica.cc:333] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.932443 14649 raft_consensus.cc:2243] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.933189 14649 raft_consensus.cc:2272] T 6e7dbc561f4f4c5da63c0d84e92b9871 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.936249 14649 tablet_replica.cc:333] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.937076 14649 raft_consensus.cc:2243] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.938282 14649 raft_consensus.cc:2272] T b727a5c8856c46cba501e397d6c1fc7b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.941113 14649 tablet_replica.cc:333] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.941922 14649 raft_consensus.cc:2243] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.943197 14649 raft_consensus.cc:2272] T a79a04e9fda24da8a4ca30980a0ef796 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.945850 14649 tablet_replica.cc:333] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.946753 14649 raft_consensus.cc:2243] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.947889 14649 raft_consensus.cc:2272] T 7c8f740585214d0fb73ad203c56cbaaf P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.950404 14649 tablet_replica.cc:333] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.951232 14649 raft_consensus.cc:2243] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.952325 14649 raft_consensus.cc:2272] T f567175d186f4342b604ea89474a493a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.955044 14649 tablet_replica.cc:333] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.955893 14649 raft_consensus.cc:2243] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.957358 14649 raft_consensus.cc:2272] T 6b4a53aaee3c41c181784f0c39780d2b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.960239 14649 tablet_replica.cc:333] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.961117 14649 raft_consensus.cc:2243] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.962160 14649 raft_consensus.cc:2272] T 7bf6eca653c94d5bba2406c3006ac72e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.964825 14649 tablet_replica.cc:333] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.965626 14649 raft_consensus.cc:2243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.967265 14649 raft_consensus.cc:2272] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.969947 14649 tablet_replica.cc:333] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.970695 14649 raft_consensus.cc:2243] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:46.977226 14649 raft_consensus.cc:2272] T 5ca952dcf3d340e9a816b8ba8f2beb8a P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.980104 14649 tablet_replica.cc:333] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.981206 14649 raft_consensus.cc:2243] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.982398 14649 raft_consensus.cc:2272] T 114faa3c35e5416eaf96295ba51a61af P b5f0a13b879f47dd804f8fc4b7b19a0a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:46.985098 14649 tablet_replica.cc:333] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:46.985934 14649 raft_consensus.cc:2243] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:46.987435 14649 raft_consensus.cc:2272] T 6b08a1f9a245453cafe7fbd2ad9f4b17 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.001991 22276 raft_consensus.cc:493] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:47.002554 22276 raft_consensus.cc:515] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:47.004622 22276 leader_election.cc:290] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:47.011560 16457 leader_election.cc:336] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:47.017194 16459 leader_election.cc:336] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:47.020298 16459 leader_election.cc:304] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:47.023859 22276 raft_consensus.cc:2749] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:47.027392 16460 consensus_peers.cc:597] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:47.031945 16460 consensus_peers.cc:597] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.990209 14649 tablet_replica.cc:333] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.038152 14649 raft_consensus.cc:2243] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.039335 14649 raft_consensus.cc:2272] T 56d26e9d10514d43b1dc78bb348fede9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.042106 14649 tablet_replica.cc:333] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.042879 14649 raft_consensus.cc:2243] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.043504 14649 raft_consensus.cc:2272] T 5ed21b81727749c4aa09fa4278bc8398 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.046036 14649 tablet_replica.cc:333] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.046855 14649 raft_consensus.cc:2243] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.048079 14649 raft_consensus.cc:2272] T 7571c77d7cc54b31955653214a4cee6c P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.050648 14649 tablet_replica.cc:333] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.056988 14649 raft_consensus.cc:2243] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.058625 14649 raft_consensus.cc:2272] T 5698e9ff3e90444081e6234a1cd5ce81 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.061250 14649 tablet_replica.cc:333] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.062040 14649 raft_consensus.cc:2243] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.063455 14649 raft_consensus.cc:2272] T 1b3c37964b604d879b4e5a45e6154d8e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:47.067746 16460 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.070410 14649 tablet_replica.cc:333] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
W20260709 12:26:47.070957 15950 consensus_peers.cc:597] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:47.071298 14649 raft_consensus.cc:2243] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.072144 14649 raft_consensus.cc:2272] T 8b583c4dfb6f45e9bd36c36a3f0dbff8 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.079679 14649 tablet_replica.cc:333] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.080680 14649 raft_consensus.cc:2243] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.081425 14649 raft_consensus.cc:2272] T 5de0236e5de04f55852a74f344fb872b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.083954 14649 tablet_replica.cc:333] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.084766 14649 raft_consensus.cc:2243] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.085880 14649 raft_consensus.cc:2272] T 43b58d74f13f487eaa63ac4992bca77b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.088364 14649 tablet_replica.cc:333] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.089172 14649 raft_consensus.cc:2243] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.090292 14649 raft_consensus.cc:2272] T 879e5f4abbab45deb735e1ae9ae2d204 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.092885 14649 tablet_replica.cc:333] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.093673 14649 raft_consensus.cc:2243] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:26:47.098474 16460 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.099735 14649 raft_consensus.cc:2272] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.102293 14649 tablet_replica.cc:333] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.103046 14649 raft_consensus.cc:2243] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.103869 14649 raft_consensus.cc:2272] T 21c971bd20d548a8a1dd8f98022a1f7e P b5f0a13b879f47dd804f8fc4b7b19a0a [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:47.135058 16460 consensus_peers.cc:597] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:47.136744 16459 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:47.138397 14649 tablet_replica.cc:333] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.139240 14649 raft_consensus.cc:2243] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.139827 14649 raft_consensus.cc:2272] T 0b9763772dd94e749d16fd361de18016 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.142503 14649 tablet_replica.cc:333] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.143283 14649 raft_consensus.cc:2243] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.144515 14649 raft_consensus.cc:2272] T afd0e40a445b47b68759b884aff8da86 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.146963 14649 tablet_replica.cc:333] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.147697 14649 raft_consensus.cc:2243] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.148810 14649 raft_consensus.cc:2272] T 9aa3e193f2f64a16b07bd7462017199d P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.151474 14649 tablet_replica.cc:333] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.152254 14649 raft_consensus.cc:2243] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.152938 14649 raft_consensus.cc:2272] T 95a62357a0c84b929b49daf3efbf1e27 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.155375 14649 tablet_replica.cc:333] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.156145 14649 raft_consensus.cc:2243] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.177821 14649 raft_consensus.cc:2272] T 5c7327c39306430dbeb82a9c27813987 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.183761 14649 tablet_replica.cc:333] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.184329 14649 raft_consensus.cc:2243] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.189430 14649 raft_consensus.cc:2272] T 83a3e78f7a344d43ab144f24c55a1e4b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.192540 14649 tablet_replica.cc:333] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.193308 14649 raft_consensus.cc:2243] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.194289 14649 raft_consensus.cc:2272] T 21e8af32d711469181861fb4a98feec9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.197124 14649 tablet_replica.cc:333] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.197862 14649 raft_consensus.cc:2243] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.199002 14649 raft_consensus.cc:2272] T 8772e3a5c1494ac0a3cda60be3150573 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.201470 14649 tablet_replica.cc:333] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.218954 14649 raft_consensus.cc:2243] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.219686 14649 raft_consensus.cc:2272] T 58dc18a7b4f448bd8d86eec830a0f612 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.222316 14649 tablet_replica.cc:333] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.223069 14649 raft_consensus.cc:2243] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.223702 14649 raft_consensus.cc:2272] T afc80a856f5e400285f41a5b49b603d9 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.231583 14649 tablet_replica.cc:333] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.232307 14649 raft_consensus.cc:2243] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.238152 14649 raft_consensus.cc:2272] T 7cbb40ff3a44403a8705489ecc556e3b P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.240387 14649 tablet_replica.cc:333] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.241143 14649 raft_consensus.cc:2243] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.241837 14649 raft_consensus.cc:2272] T 021499433bf04873a1ec6376aba69864 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.244364 14649 tablet_replica.cc:333] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.245201 14649 raft_consensus.cc:2243] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.246243 14649 raft_consensus.cc:2272] T a5852b04bfec4fa5b2fee780cfb44ce2 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.249228 14649 tablet_replica.cc:333] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.249926 14649 raft_consensus.cc:2243] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.250562 14649 raft_consensus.cc:2272] T 8b51295f13874e3492f0541da8a1f625 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.305181 14649 tablet_replica.cc:333] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.305984 14649 raft_consensus.cc:2243] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:47.308092 14649 raft_consensus.cc:2272] T b792e6a0c581428bae7ae0020c5c6edc P b5f0a13b879f47dd804f8fc4b7b19a0a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.310849 14649 tablet_replica.cc:333] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.311578 14649 raft_consensus.cc:2243] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.312341 14649 raft_consensus.cc:2272] T 4db6493294254313a1e9687fd4ba9b08 P b5f0a13b879f47dd804f8fc4b7b19a0a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.314805 14649 tablet_replica.cc:333] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a: stopping tablet replica
I20260709 12:26:47.315450 14649 raft_consensus.cc:2243] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.316166 14649 raft_consensus.cc:2272] T 3e12395965994c48bc79f9b642be60ef P b5f0a13b879f47dd804f8fc4b7b19a0a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.416533 22288 raft_consensus.cc:493] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:47.417079 22288 raft_consensus.cc:515] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:47.419066 22288 leader_election.cc:290] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:47.427809 16459 leader_election.cc:336] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:47.428733 16457 leader_election.cc:336] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:47.429145 16457 leader_election.cc:304] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:47.430276 22288 raft_consensus.cc:2749] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:47.662340 22314 raft_consensus.cc:493] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:47.662912 22314 raft_consensus.cc:515] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:47.664914 22314 leader_election.cc:290] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:47.672519 16459 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:47.695879 16457 leader_election.cc:336] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:47.696584 16457 leader_election.cc:304] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:47.698464 22288 raft_consensus.cc:2749] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:47.742744 16457 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:47.788476 16457 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:47.856777 22315 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:47.857344 22315 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:47.861630 22315 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:47.868393 16459 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:47.872330 16460 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:47.872819 16460 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:47.873960 22315 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:47.938099 22315 raft_consensus.cc:493] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:47.938599 22315 raft_consensus.cc:515] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:47.947497 22315 leader_election.cc:290] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:47.955272 16457 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:47.955740 22315 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:47.956614 22315 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:47.963973 16460 leader_election.cc:336] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
W20260709 12:26:47.967329 16457 leader_election.cc:336] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:47.967819 16457 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:47.968298 22315 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:47.969115 22288 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:47.974466 16459 leader_election.cc:336] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:47.974943 16459 leader_election.cc:304] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:47.975666 22315 raft_consensus.cc:2749] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:47.989066 22315 raft_consensus.cc:493] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 761f08e40cdf4af396105d67949c0afc)
I20260709 12:26:47.989619 22315 raft_consensus.cc:515] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:47.995559 16457 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:47.996626 22315 leader_election.cc:290] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469)
W20260709 12:26:48.001196 16459 leader_election.cc:336] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:48.001655 16459 leader_election.cc:304] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:48.002379 22315 raft_consensus.cc:2749] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:48.151124 16460 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111) [suppressed 620 similar messages]
I20260709 12:26:48.182830 22315 raft_consensus.cc:493] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.183418 22315 raft_consensus.cc:515] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:48.193949 16457 leader_election.cc:336] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:48.199883 22288 raft_consensus.cc:493] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.200457 22288 raft_consensus.cc:515] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.203203 22288 leader_election.cc:290] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:48.205935 22315 leader_election.cc:290] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.211807 16457 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:48.222551 22288 raft_consensus.cc:493] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.223081 22288 raft_consensus.cc:515] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.226132 22288 leader_election.cc:290] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.231384 16457 leader_election.cc:336] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:48.239533 16459 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:48.241379 16459 leader_election.cc:304] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:48.243742 22288 raft_consensus.cc:2749] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:48.245198 16460 leader_election.cc:336] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
W20260709 12:26:48.242204 16457 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:48.248687 16460 leader_election.cc:336] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.264658 16460 leader_election.cc:304] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.265707 22288 raft_consensus.cc:2749] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:48.269724 16460 leader_election.cc:336] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.270161 16460 leader_election.cc:304] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.270862 22288 raft_consensus.cc:2749] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:48.276270 22288 raft_consensus.cc:493] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.276775 22288 raft_consensus.cc:515] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.290927 22288 leader_election.cc:290] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.301961 16459 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:48.304306 16457 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:48.317597 22288 raft_consensus.cc:493] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.318179 22288 raft_consensus.cc:515] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.326176 22315 raft_consensus.cc:493] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.326735 22315 raft_consensus.cc:515] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.328846 22315 leader_election.cc:290] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:48.320178 22288 leader_election.cc:290] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:48.341709 22315 raft_consensus.cc:493] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.342308 22315 raft_consensus.cc:515] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } attrs { replace: true } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.344699 22315 leader_election.cc:290] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.349401 16460 leader_election.cc:336] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.351142 16460 leader_election.cc:304] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.354677 22315 raft_consensus.cc:2749] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:48.347319 16457 leader_election.cc:336] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:48.353021 16459 leader_election.cc:336] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:48.367321 16459 leader_election.cc:336] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:48.370208 16457 leader_election.cc:336] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:48.372134 16457 leader_election.cc:304] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, 9fd62f0fa06a4561a0a7101b85942f86
I20260709 12:26:48.373230 22315 raft_consensus.cc:2749] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:48.371668 16460 leader_election.cc:336] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.374136 16460 leader_election.cc:304] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:48.375018 16460 leader_election.cc:336] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.377084 16460 leader_election.cc:304] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.375463 22315 raft_consensus.cc:2749] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:48.379514 22288 raft_consensus.cc:2749] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:48.383273 22315 raft_consensus.cc:493] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.383803 22315 raft_consensus.cc:515] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.385898 22315 leader_election.cc:290] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.395349 16460 leader_election.cc:336] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
W20260709 12:26:48.403373 16457 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:48.405227 22315 raft_consensus.cc:493] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.405730 22315 raft_consensus.cc:515] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:48.412184 16459 leader_election.cc:336] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:48.413233 22315 leader_election.cc:290] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.419028 16457 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:48.419490 22288 raft_consensus.cc:493] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.421187 22288 raft_consensus.cc:515] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.423432 22288 leader_election.cc:290] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:48.419893 22315 raft_consensus.cc:493] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.424126 22315 raft_consensus.cc:515] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:48.431497 16459 leader_election.cc:336] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:48.420611 16460 leader_election.cc:336] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.432312 16460 leader_election.cc:304] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.434420 22288 raft_consensus.cc:2749] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:48.435911 22315 leader_election.cc:290] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.443172 16457 leader_election.cc:336] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
I20260709 12:26:48.446256 22288 raft_consensus.cc:493] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.446743 22288 raft_consensus.cc:515] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.448666 22288 leader_election.cc:290] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:48.450883 22288 raft_consensus.cc:493] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.451494 22288 raft_consensus.cc:515] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:48.453527 22288 leader_election.cc:290] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.454984 16460 leader_election.cc:336] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.456852 16460 leader_election.cc:304] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.460927 22316 raft_consensus.cc:2749] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:48.463049 16459 leader_election.cc:336] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:48.463616 16459 consensus_peers.cc:597] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:48.470002 16457 leader_election.cc:336] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:48.470917 16460 leader_election.cc:336] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.471410 16460 leader_election.cc:304] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.472113 22316 raft_consensus.cc:2749] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:48.472286 16460 leader_election.cc:336] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.472886 16460 leader_election.cc:304] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.473639 22316 raft_consensus.cc:2749] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:48.477113 16460 leader_election.cc:336] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.477540 16460 leader_election.cc:304] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.478246 22316 raft_consensus.cc:2749] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:48.478411 16460 leader_election.cc:336] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.479038 16460 leader_election.cc:304] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:48.479700 22316 raft_consensus.cc:2749] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:48.522692 16457 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:48.537959 16459 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:48.564936 16457 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:48.584022 16459 consensus_peers.cc:597] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:48.627367 22315 raft_consensus.cc:493] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:48.627954 22315 raft_consensus.cc:515] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
W20260709 12:26:48.638173 16460 leader_election.cc:336] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:48.642712 22315 leader_election.cc:290] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:48.646709 16459 leader_election.cc:336] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
I20260709 12:26:48.647163 16459 leader_election.cc:304] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
W20260709 12:26:48.648025 16459 consensus_peers.cc:597] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:48.648674 22315 raft_consensus.cc:2749] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:48.667341 16457 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:48.716065 16457 consensus_peers.cc:597] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:48.776477 16459 consensus_peers.cc:597] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:48.784914 16459 consensus_peers.cc:597] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:48.796715 16459 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:48.907042 16457 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:48.931955 16459 consensus_peers.cc:597] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:48.936358 16457 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:48.968634 16459 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:48.978091 16459 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:48.984509 16457 consensus_peers.cc:597] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:49.084239 16459 consensus_peers.cc:597] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:49.125749 16460 consensus_peers.cc:597] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.128326 16460 consensus_peers.cc:597] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.139755 16460 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.198760 16460 consensus_peers.cc:597] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.213465 16459 consensus_peers.cc:597] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.257227 16460 consensus_peers.cc:597] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.257771 16460 consensus_peers.cc:597] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.264679 16459 consensus_peers.cc:597] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:49.292584 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
W20260709 12:26:49.293731 16457 consensus_peers.cc:597] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:49.377305 22316 raft_consensus.cc:493] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:49.377907 22316 raft_consensus.cc:515] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "761f08e40cdf4af396105d67949c0afc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 41469 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:49.380410 22316 leader_election.cc:290] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
W20260709 12:26:49.392148 16459 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111)
W20260709 12:26:49.394395 16460 leader_election.cc:336] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:49.394860 16460 leader_election.cc:304] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 761f08e40cdf4af396105d67949c0afc, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:49.395768 22315 raft_consensus.cc:2749] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:49.410375 16460 consensus_peers.cc:597] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:49.450788 14649 tablet_server.cc:179] TabletServer@127.14.78.68:0 shutting down...
W20260709 12:26:49.460394 16460 consensus_peers.cc:597] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:49.469985 16457 consensus_peers.cc:597] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Couldn't send request to peer 9fd62f0fa06a4561a0a7101b85942f86. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:49.472569 16460 consensus_peers.cc:597] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:49.514964 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:49.518774 14649 tablet_replica.cc:333] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.519786 14649 raft_consensus.cc:2243] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.520911 14649 raft_consensus.cc:2272] T 0bcdf0d8639346d5b7f77aeac71a1eb7 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:49.521721 16459 consensus_peers.cc:597] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:49.523876 14649 tablet_replica.cc:333] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.524848 14649 raft_consensus.cc:2243] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.525660 14649 raft_consensus.cc:2272] T db755710417246db916d8278741aaff0 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.528648 14649 tablet_replica.cc:333] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.529459 14649 raft_consensus.cc:2243] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.530512 14649 raft_consensus.cc:2272] T baa957d5e1074b30a83ccaa548766896 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.533349 14649 tablet_replica.cc:333] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.534176 14649 raft_consensus.cc:2243] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.534792 14649 raft_consensus.cc:2272] T a79a04e9fda24da8a4ca30980a0ef796 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.537653 14649 tablet_replica.cc:333] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.538484 14649 raft_consensus.cc:2243] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.539455 14649 raft_consensus.cc:2272] T 3a4fafd7ec404ad9b05209ed0c8c1a19 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:49.539952 16460 consensus_peers.cc:597] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:49.542096 14649 tablet_replica.cc:333] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.542903 14649 raft_consensus.cc:2243] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:26:49.543228 16460 consensus_peers.cc:597] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:49.543903 14649 raft_consensus.cc:2272] T 1bb7213c7f6d42bc818fcdd60101ee30 P 2fa3925738bd485e912c7ac0e28b0265 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.546656 14649 tablet_replica.cc:333] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.547470 14649 raft_consensus.cc:2243] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.548240 14649 raft_consensus.cc:2272] T 56d26e9d10514d43b1dc78bb348fede9 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.551086 14649 tablet_replica.cc:333] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.551829 14649 raft_consensus.cc:2243] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.552703 14649 pending_rounds.cc:70] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Trying to abort 1 pending ops.
I20260709 12:26:49.552946 14649 pending_rounds.cc:77] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305625625152077824 op_type: NO_OP noop_request { }
I20260709 12:26:49.553375 14649 raft_consensus.cc:2889] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:49.553673 14649 raft_consensus.cc:2272] T afd0e40a445b47b68759b884aff8da86 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.556190 14649 tablet_replica.cc:333] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.556962 14649 raft_consensus.cc:2243] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.557977 14649 raft_consensus.cc:2272] T 5c7327c39306430dbeb82a9c27813987 P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.560542 14649 tablet_replica.cc:333] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.561318 14649 raft_consensus.cc:2243] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.561851 14649 raft_consensus.cc:2272] T 636b8846a0e64d48a3b14ad3af01bb3c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.564479 14649 tablet_replica.cc:333] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.565198 14649 raft_consensus.cc:2243] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.565789 14649 raft_consensus.cc:2272] T 7bf6eca653c94d5bba2406c3006ac72e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.568327 14649 tablet_replica.cc:333] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.569026 14649 raft_consensus.cc:2243] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.570009 14649 raft_consensus.cc:2272] T 021499433bf04873a1ec6376aba69864 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:49.571557 16460 consensus_peers.cc:597] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 -> Peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Couldn't send request to peer b5f0a13b879f47dd804f8fc4b7b19a0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:49.572619 14649 tablet_replica.cc:333] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.573523 14649 raft_consensus.cc:2243] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.574175 14649 raft_consensus.cc:2272] T 766b6f7dc34f48babcf3d91d76eecc59 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.577013 14649 tablet_replica.cc:333] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.577807 14649 raft_consensus.cc:2243] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.578616 14649 raft_consensus.cc:2272] T fee2b4c1781842208f03c61ac44ad821 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:49.581329 16459 consensus_peers.cc:597] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 -> Peer 761f08e40cdf4af396105d67949c0afc (127.14.78.66:41469): Couldn't send request to peer 761f08e40cdf4af396105d67949c0afc. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:41469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:49.581527 14649 tablet_replica.cc:333] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.582460 14649 raft_consensus.cc:2243] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.583194 14649 raft_consensus.cc:2272] T 98db7b6a993347c8a1e39b15956132ce P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.585801 14649 tablet_replica.cc:333] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.586532 14649 raft_consensus.cc:2243] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.587489 14649 raft_consensus.cc:2272] T 21c971bd20d548a8a1dd8f98022a1f7e P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.589994 14649 tablet_replica.cc:333] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.590713 14649 raft_consensus.cc:2243] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.591372 14649 raft_consensus.cc:2272] T e83c2c4f9a0f4e5aa1398c0e1d5d3dba P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.593926 14649 tablet_replica.cc:333] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.594645 14649 raft_consensus.cc:2243] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.595633 14649 raft_consensus.cc:2272] T 3e12395965994c48bc79f9b642be60ef P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.598032 14649 tablet_replica.cc:333] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.598716 14649 raft_consensus.cc:2243] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.599649 14649 raft_consensus.cc:2272] T 506492d6bd024ce682676a3ecdcf186f P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.601922 14649 tablet_replica.cc:333] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.602654 14649 raft_consensus.cc:2243] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.603184 14649 raft_consensus.cc:2272] T 879e5f4abbab45deb735e1ae9ae2d204 P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.605844 14649 tablet_replica.cc:333] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.606562 14649 raft_consensus.cc:2243] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.607492 14649 raft_consensus.cc:2272] T 25191835faf945ef870143a9ce1b2127 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.610040 14649 tablet_replica.cc:333] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.610769 14649 raft_consensus.cc:2243] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.611783 14649 raft_consensus.cc:2272] T 98e0016561fa4f72935bc3bc36cda023 P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.614236 14649 tablet_replica.cc:333] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.614884 14649 raft_consensus.cc:2243] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.615404 14649 raft_consensus.cc:2272] T 350f530ddf734358bef3d1a96410b5f3 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.617794 14649 tablet_replica.cc:333] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.618466 14649 raft_consensus.cc:2243] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.618930 14649 raft_consensus.cc:2272] T 21e8af32d711469181861fb4a98feec9 P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.621296 14649 tablet_replica.cc:333] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.621991 14649 raft_consensus.cc:2243] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.622982 14649 raft_consensus.cc:2272] T 58dc18a7b4f448bd8d86eec830a0f612 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.625599 14649 tablet_replica.cc:333] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.626332 14649 raft_consensus.cc:2243] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.626825 14649 raft_consensus.cc:2272] T a5852b04bfec4fa5b2fee780cfb44ce2 P 2fa3925738bd485e912c7ac0e28b0265 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.628988 14649 tablet_replica.cc:333] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.629652 14649 raft_consensus.cc:2243] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.630645 14649 raft_consensus.cc:2272] T 1db7600d8ee247d0abddcf104708f152 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.633203 14649 tablet_replica.cc:333] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.633985 14649 raft_consensus.cc:2243] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.634629 14649 raft_consensus.cc:2272] T 17a5ecf16d3543828d16fe27e061a42e P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.635641 22315 raft_consensus.cc:493] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b5f0a13b879f47dd804f8fc4b7b19a0a)
I20260709 12:26:49.636233 22315 raft_consensus.cc:515] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fd62f0fa06a4561a0a7101b85942f86" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 38945 } } peers { permanent_uuid: "b5f0a13b879f47dd804f8fc4b7b19a0a" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39871 } } peers { permanent_uuid: "2fa3925738bd485e912c7ac0e28b0265" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43743 } attrs { promote: false } }
I20260709 12:26:49.637692 14649 tablet_replica.cc:333] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.638535 14649 raft_consensus.cc:2243] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.638650 22315 leader_election.cc:290] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945), b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871)
I20260709 12:26:49.639565 14649 raft_consensus.cc:2272] T 7cbb40ff3a44403a8705489ecc556e3b P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.642025 14649 tablet_replica.cc:333] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.642676 14649 raft_consensus.cc:2243] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.643726 14649 raft_consensus.cc:2272] T 661598743dad4055844a0b0f97c07156 P 2fa3925738bd485e912c7ac0e28b0265 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.646186 14649 tablet_replica.cc:333] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.646871 14649 raft_consensus.cc:2243] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.647608 14649 raft_consensus.cc:2272] T 2b991ff9e213435786d19248864c5cfc P 2fa3925738bd485e912c7ac0e28b0265 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:49.648999 16457 leader_election.cc:336] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fd62f0fa06a4561a0a7101b85942f86 (127.14.78.65:38945): Network error: Client connection negotiation failed: client connection to 127.14.78.65:38945: connect: Connection refused (error 111)
W20260709 12:26:49.649910 16460 leader_election.cc:336] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b5f0a13b879f47dd804f8fc4b7b19a0a (127.14.78.67:39871): Network error: Client connection negotiation failed: client connection to 127.14.78.67:39871: connect: Connection refused (error 111)
I20260709 12:26:49.650454 14649 tablet_replica.cc:333] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.650331 16460 leader_election.cc:304] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa3925738bd485e912c7ac0e28b0265; no voters: 9fd62f0fa06a4561a0a7101b85942f86, b5f0a13b879f47dd804f8fc4b7b19a0a
I20260709 12:26:49.651188 14649 raft_consensus.cc:2243] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.651460 22315 raft_consensus.cc:2749] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:49.652279 14649 raft_consensus.cc:2272] T 9e271b9d1bc8403ba1c9d3e80c36917c P 2fa3925738bd485e912c7ac0e28b0265 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.654868 14649 tablet_replica.cc:333] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.655565 14649 raft_consensus.cc:2243] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.656672 14649 raft_consensus.cc:2272] T 5521db1dbeb94ad8ae63681494d5565d P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.659201 14649 tablet_replica.cc:333] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.659958 14649 raft_consensus.cc:2243] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.660679 14649 raft_consensus.cc:2272] T 7c8f740585214d0fb73ad203c56cbaaf P 2fa3925738bd485e912c7ac0e28b0265 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.663576 14649 tablet_replica.cc:333] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.664319 14649 raft_consensus.cc:2243] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.664881 14649 raft_consensus.cc:2272] T 7571c77d7cc54b31955653214a4cee6c P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.667567 14649 tablet_replica.cc:333] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.668320 14649 raft_consensus.cc:2243] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.669386 14649 raft_consensus.cc:2272] T 8b51295f13874e3492f0541da8a1f625 P 2fa3925738bd485e912c7ac0e28b0265 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.672025 14649 tablet_replica.cc:333] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.672818 14649 raft_consensus.cc:2243] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.673446 14649 raft_consensus.cc:2272] T b792e6a0c581428bae7ae0020c5c6edc P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.676077 14649 tablet_replica.cc:333] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.676783 14649 raft_consensus.cc:2243] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.677775 14649 raft_consensus.cc:2272] T ec82df0e9104447ab3e50c2a6968cf7e P 2fa3925738bd485e912c7ac0e28b0265 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.680318 14649 tablet_replica.cc:333] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.681068 14649 raft_consensus.cc:2243] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.681962 14649 raft_consensus.cc:2272] T 5698e9ff3e90444081e6234a1cd5ce81 P 2fa3925738bd485e912c7ac0e28b0265 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.684959 14649 tablet_replica.cc:333] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.685694 14649 raft_consensus.cc:2243] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.686208 14649 raft_consensus.cc:2272] T 1b3c37964b604d879b4e5a45e6154d8e P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.688948 14649 tablet_replica.cc:333] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.689723 14649 raft_consensus.cc:2243] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:49.690248 14649 raft_consensus.cc:2272] T 43b58d74f13f487eaa63ac4992bca77b P 2fa3925738bd485e912c7ac0e28b0265 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:49.692901 14649 tablet_replica.cc:333] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265: stopping tablet replica
I20260709 12:26:49.693534 14649 raft_consensus.cc:2243] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:49.694581 14649 raft_consensus.cc:2272] T 12b10f85daf040e1af9735597b9af404 P 2fa3925738bd485e912c7ac0e28b0265 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.241447 14649 tablet_server.cc:196] TabletServer@127.14.78.68:0 shutdown complete.
I20260709 12:26:50.310549 14649 master.cc:562] Master@127.14.78.126:37123 shutting down...
W20260709 12:26:50.348064 15783 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:26:50.348341 15783 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:26:50.348567 15783 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:26:50.351704 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.352240 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.352569 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7d3391ee630646ccabf92830e1028bc1: stopping tablet replica
I20260709 12:26:50.486446 14649 master.cc:584] Master@127.14.78.126:37123 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (202571 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:26:50.586894 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:38407
I20260709 12:26:50.588025 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.593647 22317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.594676 22318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.595129 22320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.595520 14649 server_base.cc:1061] running on GCE node
I20260709 12:26:50.598409 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.598598 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.598822 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600010598802 us; error 0 us; skew 500 ppm
I20260709 12:26:50.599387 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.608247 14649 webserver.cc:533] Webserver started at http://127.14.78.126:42537/ using document root <none> and password file <none>
I20260709 12:26:50.609212 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.609511 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.609889 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.612241 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "151e6f25ba1f490d93bfd0a4c1484f56"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:26:50.619901 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:26:50.625188 22325 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.626304 14649 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:50.626716 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "151e6f25ba1f490d93bfd0a4c1484f56"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:26:50.627121 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:50.654266 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:50.655594 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:50.701014 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:38407
I20260709 12:26:50.701177 22376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:38407 every 8 connection(s)
I20260709 12:26:50.705190 22377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.716099 22377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56: Bootstrap starting.
I20260709 12:26:50.721297 22377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.725665 22377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56: No bootstrap required, opened a new log
I20260709 12:26:50.727708 22377 raft_consensus.cc:359] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" member_type: VOTER }
I20260709 12:26:50.728080 22377 raft_consensus.cc:385] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.728325 22377 raft_consensus.cc:740] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151e6f25ba1f490d93bfd0a4c1484f56, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.728976 22377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" member_type: VOTER }
I20260709 12:26:50.729542 22377 raft_consensus.cc:399] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:50.729868 22377 raft_consensus.cc:493] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:50.730211 22377 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.734485 22377 raft_consensus.cc:515] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" member_type: VOTER }
I20260709 12:26:50.734979 22377 leader_election.cc:304] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 151e6f25ba1f490d93bfd0a4c1484f56; no voters: 
I20260709 12:26:50.735999 22377 leader_election.cc:290] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:50.736390 22380 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.737725 22380 raft_consensus.cc:697] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 1 LEADER]: Becoming Leader. State: Replica: 151e6f25ba1f490d93bfd0a4c1484f56, State: Running, Role: LEADER
I20260709 12:26:50.738391 22380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" member_type: VOTER }
I20260709 12:26:50.738843 22377 sys_catalog.cc:565] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:50.743934 22382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 151e6f25ba1f490d93bfd0a4c1484f56. Latest consensus state: current_term: 1 leader_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" member_type: VOTER } }
I20260709 12:26:50.744522 22382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:50.746404 22389 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:50.746233 22381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151e6f25ba1f490d93bfd0a4c1484f56" member_type: VOTER } }
I20260709 12:26:50.746778 22381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:50.751709 22389 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:50.755242 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:50.761153 22389 catalog_manager.cc:1383] Generated new cluster ID: 68be774199054322971dcef2955cb72e
I20260709 12:26:50.761390 22389 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:50.777225 22389 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:50.778332 22389 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:50.790931 22389 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56: Generated new TSK 0
I20260709 12:26:50.791520 22389 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:50.822265 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.828032 22398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.829842 22399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.833199 14649 server_base.cc:1061] running on GCE node
W20260709 12:26:50.833179 22401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.835518 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.835698 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.835830 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600010835819 us; error 0 us; skew 500 ppm
I20260709 12:26:50.836270 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.838550 14649 webserver.cc:533] Webserver started at http://127.14.78.65:39989/ using document root <none> and password file <none>
I20260709 12:26:50.838971 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.839121 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.839329 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.840545 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "7b50b6c210724c66b6ee01c04ab9676d"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:26:50.845484 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:50.848589 22406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.849409 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:50.849705 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "7b50b6c210724c66b6ee01c04ab9676d"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:26:50.849989 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:50.873814 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:50.874997 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:50.876449 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:50.878717 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:50.878952 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.879204 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:50.879395 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.919387 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:34885
I20260709 12:26:50.919412 22468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:34885 every 8 connection(s)
I20260709 12:26:50.927289 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.937069 22473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.938679 22474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.942395 22469 heartbeater.cc:344] Connected to a master server at 127.14.78.126:38407
I20260709 12:26:50.942795 22469 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:50.943516 22469 heartbeater.cc:507] Master 127.14.78.126:38407 requested a full tablet report, sending...
I20260709 12:26:50.945842 22342 ts_manager.cc:194] Registered new tserver with Master: 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:50.946944 14649 server_base.cc:1061] running on GCE node
I20260709 12:26:50.948486 22342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57790
W20260709 12:26:50.949682 22477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.950861 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.951196 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.951615 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600010951594 us; error 0 us; skew 500 ppm
I20260709 12:26:50.952191 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.954684 14649 webserver.cc:533] Webserver started at http://127.14.78.66:33693/ using document root <none> and password file <none>
I20260709 12:26:50.955204 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.955468 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.955827 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.957536 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "b3766de80037442fbcfbef7158ad1868"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:26:50.963470 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:50.966974 22481 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.967918 14649 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:26:50.968251 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "b3766de80037442fbcfbef7158ad1868"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:26:50.968619 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:51.006282 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:51.007503 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:51.009011 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:51.011198 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:51.011384 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.011672 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:51.011829 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.050411 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:35239
I20260709 12:26:51.050539 22543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:35239 every 8 connection(s)
I20260709 12:26:51.055296 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:51.062261 22547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:51.063103 22548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:51.065876 22550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:51.066727 14649 server_base.cc:1061] running on GCE node
I20260709 12:26:51.067618 22544 heartbeater.cc:344] Connected to a master server at 127.14.78.126:38407
I20260709 12:26:51.067739 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:51.068018 22544 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:51.068120 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:51.068485 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600011068459 us; error 0 us; skew 500 ppm
I20260709 12:26:51.068946 22544 heartbeater.cc:507] Master 127.14.78.126:38407 requested a full tablet report, sending...
I20260709 12:26:51.069124 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:51.071154 22342 ts_manager.cc:194] Registered new tserver with Master: b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:51.071767 14649 webserver.cc:533] Webserver started at http://127.14.78.67:37459/ using document root <none> and password file <none>
I20260709 12:26:51.072268 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:51.072479 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:51.072746 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:51.072769 22342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57792
I20260709 12:26:51.074164 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "b662aaf197d344acbc951b9da5cebf2b"
format_stamp: "Formatted at 2026-07-09 12:26:51 on dist-test-slave-vrh7"
I20260709 12:26:51.078310 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:51.081470 22555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.082198 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:51.082527 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "b662aaf197d344acbc951b9da5cebf2b"
format_stamp: "Formatted at 2026-07-09 12:26:51 on dist-test-slave-vrh7"
I20260709 12:26:51.082814 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:51.100950 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:51.102100 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:51.103518 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:51.105690 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:51.105916 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.106163 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:51.106338 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.146371 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:33639
I20260709 12:26:51.146486 22617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:33639 every 8 connection(s)
I20260709 12:26:51.151213 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:51.158313 22621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:51.160044 22622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:51.163846 14649 server_base.cc:1061] running on GCE node
W20260709 12:26:51.164484 22624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:51.165390 22618 heartbeater.cc:344] Connected to a master server at 127.14.78.126:38407
I20260709 12:26:51.165548 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:51.165814 22618 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:51.165818 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:51.166271 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600011166250 us; error 0 us; skew 500 ppm
I20260709 12:26:51.166822 22618 heartbeater.cc:507] Master 127.14.78.126:38407 requested a full tablet report, sending...
I20260709 12:26:51.167070 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:51.169181 22342 ts_manager.cc:194] Registered new tserver with Master: b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:51.169970 14649 webserver.cc:533] Webserver started at http://127.14.78.68:38925/ using document root <none> and password file <none>
I20260709 12:26:51.170516 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:51.170732 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:51.170773 22342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57796
I20260709 12:26:51.171028 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:51.172361 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-3-root/instance:
uuid: "1704a791486d41aca21c226c48b00d89"
format_stamp: "Formatted at 2026-07-09 12:26:51 on dist-test-slave-vrh7"
I20260709 12:26:51.176520 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:51.179706 22629 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.180497 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:51.180830 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-3-root
uuid: "1704a791486d41aca21c226c48b00d89"
format_stamp: "Formatted at 2026-07-09 12:26:51 on dist-test-slave-vrh7"
I20260709 12:26:51.181207 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:51.231815 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:51.233214 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:51.234562 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:51.236845 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:51.237112 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:51.237388 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:51.237592 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:51.279604 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.68:43965
I20260709 12:26:51.279695 22691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.68:43965 every 8 connection(s)
I20260709 12:26:51.293967 22692 heartbeater.cc:344] Connected to a master server at 127.14.78.126:38407
I20260709 12:26:51.294365 22692 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:51.295084 22692 heartbeater.cc:507] Master 127.14.78.126:38407 requested a full tablet report, sending...
I20260709 12:26:51.296901 22342 ts_manager.cc:194] Registered new tserver with Master: 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:51.297024 14649 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013973784s
I20260709 12:26:51.298352 22342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57812
I20260709 12:26:51.322008 22342 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57820:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:51.555955 22657 tablet_service.cc:1511] Processing CreateTablet for tablet 3eeef333a78947669db43fca25c58e78 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:51.557426 22657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eeef333a78947669db43fca25c58e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.563174 22656 tablet_service.cc:1511] Processing CreateTablet for tablet d909a252b3344a49aa050687c81371f1 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:51.564580 22656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a252b3344a49aa050687c81371f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.566298 22655 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2297d3b48646d290a82d37a12edfe4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:51.566787 22434 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4c481bc7524854a8e81ad008f1c22b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:51.567902 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2297d3b48646d290a82d37a12edfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.568701 22434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c481bc7524854a8e81ad008f1c22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.571548 22433 tablet_service.cc:1511] Processing CreateTablet for tablet d909a252b3344a49aa050687c81371f1 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:51.572830 22433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a252b3344a49aa050687c81371f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.574097 22509 tablet_service.cc:1511] Processing CreateTablet for tablet 3eeef333a78947669db43fca25c58e78 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:51.574497 22508 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4c481bc7524854a8e81ad008f1c22b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:51.575409 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eeef333a78947669db43fca25c58e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.575771 22432 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2297d3b48646d290a82d37a12edfe4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:51.576575 22507 tablet_service.cc:1511] Processing CreateTablet for tablet d909a252b3344a49aa050687c81371f1 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:51.577096 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2297d3b48646d290a82d37a12edfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.577931 22507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d909a252b3344a49aa050687c81371f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.581110 22508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c481bc7524854a8e81ad008f1c22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.582540 22583 tablet_service.cc:1511] Processing CreateTablet for tablet 3eeef333a78947669db43fca25c58e78 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:51.583793 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eeef333a78947669db43fca25c58e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.583636 22582 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4c481bc7524854a8e81ad008f1c22b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:51.586203 22581 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2297d3b48646d290a82d37a12edfe4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:51.584931 22582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c481bc7524854a8e81ad008f1c22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.597450 22581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2297d3b48646d290a82d37a12edfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.611215 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 0c00de8d7389494ebc91a22801a56392 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:51.612572 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c00de8d7389494ebc91a22801a56392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.613564 22580 tablet_service.cc:1511] Processing CreateTablet for tablet 0c00de8d7389494ebc91a22801a56392 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:51.614866 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c00de8d7389494ebc91a22801a56392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.616916 22430 tablet_service.cc:1511] Processing CreateTablet for tablet 890e148410fe4d348d9bb67d9b26e53c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:51.618242 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890e148410fe4d348d9bb67d9b26e53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.619387 22579 tablet_service.cc:1511] Processing CreateTablet for tablet d11e7fd15033436594cf4c660a36ef40 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:51.620620 22579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11e7fd15033436594cf4c660a36ef40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.622700 22654 tablet_service.cc:1511] Processing CreateTablet for tablet 890e148410fe4d348d9bb67d9b26e53c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:51.624783 22712 tablet_bootstrap.cc:492] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:51.627315 22653 tablet_service.cc:1511] Processing CreateTablet for tablet d11e7fd15033436594cf4c660a36ef40 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:51.630354 22654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890e148410fe4d348d9bb67d9b26e53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.623061 22505 tablet_service.cc:1511] Processing CreateTablet for tablet 890e148410fe4d348d9bb67d9b26e53c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:51.637935 22712 tablet_bootstrap.cc:654] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.638129 22504 tablet_service.cc:1511] Processing CreateTablet for tablet e82e23baefcf48e78cfcbd3978804f66 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:51.639674 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82e23baefcf48e78cfcbd3978804f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.634987 22653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11e7fd15033436594cf4c660a36ef40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.647976 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 890e148410fe4d348d9bb67d9b26e53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.651435 22429 tablet_service.cc:1511] Processing CreateTablet for tablet d11e7fd15033436594cf4c660a36ef40 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:51.652812 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11e7fd15033436594cf4c660a36ef40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.654269 22578 tablet_service.cc:1511] Processing CreateTablet for tablet e82e23baefcf48e78cfcbd3978804f66 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:51.655682 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82e23baefcf48e78cfcbd3978804f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.618234 22506 tablet_service.cc:1511] Processing CreateTablet for tablet 0c00de8d7389494ebc91a22801a56392 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:51.658226 22577 tablet_service.cc:1511] Processing CreateTablet for tablet 0dec979f13504b80853778e1e0e2f2c0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:51.658900 22506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c00de8d7389494ebc91a22801a56392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.659554 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dec979f13504b80853778e1e0e2f2c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.663766 22652 tablet_service.cc:1511] Processing CreateTablet for tablet e82e23baefcf48e78cfcbd3978804f66 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:51.666648 22503 tablet_service.cc:1511] Processing CreateTablet for tablet 0dec979f13504b80853778e1e0e2f2c0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:51.668372 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dec979f13504b80853778e1e0e2f2c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.678974 22651 tablet_service.cc:1511] Processing CreateTablet for tablet e64be06c2f304bb0bc47273eb5b3443a (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:51.680707 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64be06c2f304bb0bc47273eb5b3443a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.703971 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82e23baefcf48e78cfcbd3978804f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.709625 22711 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:51.710934 22428 tablet_service.cc:1511] Processing CreateTablet for tablet e64be06c2f304bb0bc47273eb5b3443a (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:51.712271 22428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64be06c2f304bb0bc47273eb5b3443a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.721755 22434 tablet_service.cc:1511] Processing CreateTablet for tablet 0dec979f13504b80853778e1e0e2f2c0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:51.729768 22650 tablet_service.cc:1511] Processing CreateTablet for tablet 3faa19b604754a1382a3c631b4bb69ea (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:51.731135 22650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faa19b604754a1382a3c631b4bb69ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.732082 22583 tablet_service.cc:1511] Processing CreateTablet for tablet 3faa19b604754a1382a3c631b4bb69ea (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:51.732220 22427 tablet_service.cc:1511] Processing CreateTablet for tablet 3faa19b604754a1382a3c631b4bb69ea (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:51.733426 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faa19b604754a1382a3c631b4bb69ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.734403 22508 tablet_service.cc:1511] Processing CreateTablet for tablet 34b4e6a3678b4214ab4cd68a86f36c7d (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:51.735718 22508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4e6a3678b4214ab4cd68a86f36c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.741528 22434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dec979f13504b80853778e1e0e2f2c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.742161 22427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faa19b604754a1382a3c631b4bb69ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.742899 22711 tablet_bootstrap.cc:654] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.748775 22582 tablet_service.cc:1511] Processing CreateTablet for tablet 34b4e6a3678b4214ab4cd68a86f36c7d (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:51.749768 22509 tablet_service.cc:1511] Processing CreateTablet for tablet e64be06c2f304bb0bc47273eb5b3443a (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:51.751246 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64be06c2f304bb0bc47273eb5b3443a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:51.752048 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:51.755465 22656 tablet_service.cc:1511] Processing CreateTablet for tablet 34b4e6a3678b4214ab4cd68a86f36c7d (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:51.756750 22656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4e6a3678b4214ab4cd68a86f36c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.758780 22582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b4e6a3678b4214ab4cd68a86f36c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.763023 22713 tablet_bootstrap.cc:492] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:51.772037 22713 tablet_bootstrap.cc:654] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.792137 22427 tablet_service.cc:1511] Processing CreateTablet for tablet e89d8ff5add1411fb67886f3c197525e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:51.793450 22427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d8ff5add1411fb67886f3c197525e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.798709 22712 tablet_bootstrap.cc:492] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:51.799273 22712 ts_tablet_manager.cc:1403] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.003s
I20260709 12:26:51.812213 22508 tablet_service.cc:1511] Processing CreateTablet for tablet e89d8ff5add1411fb67886f3c197525e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:51.813599 22508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d8ff5add1411fb67886f3c197525e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.823482 22651 tablet_service.cc:1511] Processing CreateTablet for tablet 81ad0895a1da4871ab543142576039f5 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:51.823755 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 81ad0895a1da4871ab543142576039f5 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:51.827771 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ad0895a1da4871ab543142576039f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.827922 22504 tablet_service.cc:1511] Processing CreateTablet for tablet 81ad0895a1da4871ab543142576039f5 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:51.829560 22714 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:51.833897 22711 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:51.834405 22711 ts_tablet_manager.cc:1403] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.003s
I20260709 12:26:51.834100 22712 raft_consensus.cc:359] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.834843 22712 raft_consensus.cc:385] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.835162 22712 raft_consensus.cc:740] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.838577 22712 consensus_queue.cc:260] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.823755 22583 tablet_service.cc:1511] Processing CreateTablet for tablet e89d8ff5add1411fb67886f3c197525e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:51.840828 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ad0895a1da4871ab543142576039f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.841658 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ad0895a1da4871ab543142576039f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.842706 22713 tablet_bootstrap.cc:492] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:51.843257 22713 ts_tablet_manager.cc:1403] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.021s
I20260709 12:26:51.842090 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d8ff5add1411fb67886f3c197525e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.844198 22714 tablet_bootstrap.cc:654] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.846235 22713 raft_consensus.cc:359] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.847940 22713 raft_consensus.cc:385] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.848716 22713 raft_consensus.cc:740] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.840760 22711 raft_consensus.cc:359] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:51.849992 22711 raft_consensus.cc:385] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.853703 22650 tablet_service.cc:1511] Processing CreateTablet for tablet 1844b0368bfa419ca7922fd6c6d4a81f (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:51.855016 22650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1844b0368bfa419ca7922fd6c6d4a81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.851428 22577 tablet_service.cc:1511] Processing CreateTablet for tablet 1844b0368bfa419ca7922fd6c6d4a81f (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:51.861810 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1844b0368bfa419ca7922fd6c6d4a81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.852188 22711 raft_consensus.cc:740] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.864758 22429 tablet_service.cc:1511] Processing CreateTablet for tablet 1844b0368bfa419ca7922fd6c6d4a81f (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:51.866114 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1844b0368bfa419ca7922fd6c6d4a81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.865998 22711 consensus_queue.cc:260] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:51.869202 22711 ts_tablet_manager.cc:1434] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:26:51.870059 22509 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0804e286664773b5ec173401e74bfc (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:51.871456 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0804e286664773b5ec173401e74bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.873762 22469 heartbeater.cc:499] Master 127.14.78.126:38407 was elected leader, sending a full tablet report...
I20260709 12:26:51.882967 22580 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0804e286664773b5ec173401e74bfc (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:51.884676 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0804e286664773b5ec173401e74bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.894369 22544 heartbeater.cc:499] Master 127.14.78.126:38407 was elected leader, sending a full tablet report...
I20260709 12:26:51.895432 22712 ts_tablet_manager.cc:1434] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 12:26:51.896402 22712 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:51.870002 22713 consensus_queue.cc:260] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.899950 22711 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:51.901616 22652 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0804e286664773b5ec173401e74bfc (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:51.902910 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0804e286664773b5ec173401e74bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.913209 22431 tablet_service.cc:1511] Processing CreateTablet for tablet f6a24bc91e384d40a18eabd347212ba4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:51.915066 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a24bc91e384d40a18eabd347212ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.918762 22618 heartbeater.cc:499] Master 127.14.78.126:38407 was elected leader, sending a full tablet report...
I20260709 12:26:51.919883 22713 ts_tablet_manager.cc:1434] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.001s
I20260709 12:26:51.920884 22713 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:51.924564 22714 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:51.925133 22714 ts_tablet_manager.cc:1403] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.096s	user 0.034s	sys 0.053s
W20260709 12:26:51.926802 22470 tablet.cc:2406] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:51.929492 22714 raft_consensus.cc:359] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.930250 22714 raft_consensus.cc:385] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.930603 22714 raft_consensus.cc:740] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.931661 22712 tablet_bootstrap.cc:654] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.931537 22714 consensus_queue.cc:260] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.941118 22714 ts_tablet_manager.cc:1434] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:26:51.941859 22692 heartbeater.cc:499] Master 127.14.78.126:38407 was elected leader, sending a full tablet report...
I20260709 12:26:51.942704 22711 tablet_bootstrap.cc:654] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.944105 22505 tablet_service.cc:1511] Processing CreateTablet for tablet f6a24bc91e384d40a18eabd347212ba4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:51.945421 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a24bc91e384d40a18eabd347212ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.947127 22713 tablet_bootstrap.cc:654] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.952281 22582 tablet_service.cc:1511] Processing CreateTablet for tablet f6a24bc91e384d40a18eabd347212ba4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:51.953619 22582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a24bc91e384d40a18eabd347212ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.954468 22712 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:51.954972 22712 ts_tablet_manager.cc:1403] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.059s	user 0.002s	sys 0.008s
I20260709 12:26:51.959774 22712 raft_consensus.cc:359] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.964205 22712 raft_consensus.cc:385] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.964587 22712 raft_consensus.cc:740] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.963275 22711 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:51.965375 22714 tablet_bootstrap.cc:492] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:51.965791 22711 ts_tablet_manager.cc:1403] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 12:26:51.965400 22712 consensus_queue.cc:260] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:51.968875 22711 raft_consensus.cc:359] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:51.974593 22711 raft_consensus.cc:385] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.974970 22711 raft_consensus.cc:740] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.975883 22711 consensus_queue.cc:260] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:51.976881 22503 tablet_service.cc:1511] Processing CreateTablet for tablet ff440e4e2d764ef1ae95785dc37916bd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:51.978209 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff440e4e2d764ef1ae95785dc37916bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.980733 22711 ts_tablet_manager.cc:1434] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:51.981743 22711 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:51.983245 22580 tablet_service.cc:1511] Processing CreateTablet for tablet afb9c110162141dbbeb161a2aaa00e82 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:51.984308 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb9c110162141dbbeb161a2aaa00e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.987833 22711 tablet_bootstrap.cc:654] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.974256 22712 ts_tablet_manager.cc:1434] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:26:51.988869 22712 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:51.971838 22713 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:51.993429 22713 ts_tablet_manager.cc:1403] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:26:51.996407 22713 raft_consensus.cc:359] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.000289 22713 raft_consensus.cc:385] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.997313 22721 raft_consensus.cc:493] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.000844 22721 raft_consensus.cc:515] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.001785 22431 tablet_service.cc:1511] Processing CreateTablet for tablet ff440e4e2d764ef1ae95785dc37916bd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:52.003068 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff440e4e2d764ef1ae95785dc37916bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.003551 22721 leader_election.cc:290] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:51.972893 22651 tablet_service.cc:1511] Processing CreateTablet for tablet ff440e4e2d764ef1ae95785dc37916bd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:52.004833 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff440e4e2d764ef1ae95785dc37916bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.971364 22714 tablet_bootstrap.cc:654] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.005144 22713 raft_consensus.cc:740] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.016091 22713 consensus_queue.cc:260] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.017478 22650 tablet_service.cc:1511] Processing CreateTablet for tablet afb9c110162141dbbeb161a2aaa00e82 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:52.018748 22712 tablet_bootstrap.cc:654] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.023509 22650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb9c110162141dbbeb161a2aaa00e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.025498 22714 tablet_bootstrap.cc:492] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:52.027217 22714 ts_tablet_manager.cc:1403] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.006s
I20260709 12:26:52.038385 22582 tablet_service.cc:1511] Processing CreateTablet for tablet 0b01a5d3d09f49098b1c8a295825a3e4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:52.041764 22503 tablet_service.cc:1511] Processing CreateTablet for tablet 0b01a5d3d09f49098b1c8a295825a3e4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:52.042335 22427 tablet_service.cc:1511] Processing CreateTablet for tablet 21c2cfe20d2945009689b68b54859bdc (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:52.043009 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b01a5d3d09f49098b1c8a295825a3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.043992 22427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c2cfe20d2945009689b68b54859bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.046746 22429 tablet_service.cc:1511] Processing CreateTablet for tablet afb9c110162141dbbeb161a2aaa00e82 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:52.047914 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afb9c110162141dbbeb161a2aaa00e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.050729 22583 tablet_service.cc:1511] Processing CreateTablet for tablet 21c2cfe20d2945009689b68b54859bdc (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:52.051708 22720 raft_consensus.cc:493] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.051975 22713 ts_tablet_manager.cc:1434] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:26:52.051815 22509 tablet_service.cc:1511] Processing CreateTablet for tablet 21c2cfe20d2945009689b68b54859bdc (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:52.052306 22720 raft_consensus.cc:515] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:52.053179 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c2cfe20d2945009689b68b54859bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.050796 22652 tablet_service.cc:1511] Processing CreateTablet for tablet 0b01a5d3d09f49098b1c8a295825a3e4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:52.054854 22720 leader_election.cc:290] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:52.057587 22582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b01a5d3d09f49098b1c8a295825a3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.084028 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b01a5d3d09f49098b1c8a295825a3e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.094668 22655 tablet_service.cc:1511] Processing CreateTablet for tablet 8e68bab18985498ba50de54dca27ab78 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:52.095978 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e68bab18985498ba50de54dca27ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.101222 22434 tablet_service.cc:1511] Processing CreateTablet for tablet 8e68bab18985498ba50de54dca27ab78 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:52.102005 22504 tablet_service.cc:1511] Processing CreateTablet for tablet dc626c4c37b24f3eb817050fb30f6514 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:52.102480 22434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e68bab18985498ba50de54dca27ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.103283 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc626c4c37b24f3eb817050fb30f6514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.105561 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c2cfe20d2945009689b68b54859bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.105985 22656 tablet_service.cc:1511] Processing CreateTablet for tablet 1533d020c6df4b0a969ce556adf9dc6e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:52.107215 22656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1533d020c6df4b0a969ce556adf9dc6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.109886 22505 tablet_service.cc:1511] Processing CreateTablet for tablet 1533d020c6df4b0a969ce556adf9dc6e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:52.111124 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1533d020c6df4b0a969ce556adf9dc6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.113649 22713 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:52.089489 22577 tablet_service.cc:1511] Processing CreateTablet for tablet 8e68bab18985498ba50de54dca27ab78 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:52.114449 22580 tablet_service.cc:1511] Processing CreateTablet for tablet dc626c4c37b24f3eb817050fb30f6514 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:52.115585 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e68bab18985498ba50de54dca27ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.116264 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc626c4c37b24f3eb817050fb30f6514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.089489 22428 tablet_service.cc:1511] Processing CreateTablet for tablet 1533d020c6df4b0a969ce556adf9dc6e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:52.118652 22428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1533d020c6df4b0a969ce556adf9dc6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.089407 22714 raft_consensus.cc:359] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.128137 22714 raft_consensus.cc:385] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.128558 22714 raft_consensus.cc:740] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.130170 22722 raft_consensus.cc:493] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.130844 22722 raft_consensus.cc:515] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.148381 22654 tablet_service.cc:1511] Processing CreateTablet for tablet dc626c4c37b24f3eb817050fb30f6514 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:52.150094 22654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc626c4c37b24f3eb817050fb30f6514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.152189 22712 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:52.152859 22712 ts_tablet_manager.cc:1403] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.011s
I20260709 12:26:52.158344 22432 tablet_service.cc:1511] Processing CreateTablet for tablet 08b620a48e004eb98b5a6e7b1872a55b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:52.159641 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b620a48e004eb98b5a6e7b1872a55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.161201 22714 consensus_queue.cc:260] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.180300 22714 ts_tablet_manager.cc:1434] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.147s	user 0.010s	sys 0.001s
I20260709 12:26:52.180856 22504 tablet_service.cc:1511] Processing CreateTablet for tablet 08b620a48e004eb98b5a6e7b1872a55b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:52.181746 22711 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:52.184847 22711 ts_tablet_manager.cc:1403] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.203s	user 0.017s	sys 0.008s
I20260709 12:26:52.185113 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b620a48e004eb98b5a6e7b1872a55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.186554 22722 leader_election.cc:290] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.200023 22579 tablet_service.cc:1511] Processing CreateTablet for tablet 08b620a48e004eb98b5a6e7b1872a55b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:52.203639 22711 raft_consensus.cc:359] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.204363 22711 raft_consensus.cc:385] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.204660 22711 raft_consensus.cc:740] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.205364 22711 consensus_queue.cc:260] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.207916 22711 ts_tablet_manager.cc:1434] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:26:52.209487 22579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b620a48e004eb98b5a6e7b1872a55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.225967 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eeef333a78947669db43fca25c58e78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:52.228125 22519 raft_consensus.cc:2468] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:52.229704 22559 leader_election.cc:304] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:52.230521 22721 raft_consensus.cc:2804] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.230892 22721 raft_consensus.cc:493] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.231215 22721 raft_consensus.cc:3060] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.235484 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 2a056e813b794e0bb9f0055705fc192a (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:52.236768 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a056e813b794e0bb9f0055705fc192a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.237027 22509 tablet_service.cc:1511] Processing CreateTablet for tablet 2a056e813b794e0bb9f0055705fc192a (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:52.238813 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a056e813b794e0bb9f0055705fc192a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.241140 22721 raft_consensus.cc:515] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.241550 22430 tablet_service.cc:1511] Processing CreateTablet for tablet c1e9a4f6e8ed40e5a1854b3462b79964 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:52.242738 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e9a4f6e8ed40e5a1854b3462b79964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.242668 22508 tablet_service.cc:1511] Processing CreateTablet for tablet c8474847f8e04fd58b6b04a2bce93bee (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:52.243168 22721 leader_election.cc:290] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.244000 22508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8474847f8e04fd58b6b04a2bce93bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.245450 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2297d3b48646d290a82d37a12edfe4" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:52.247865 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eeef333a78947669db43fca25c58e78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:52.248612 22519 raft_consensus.cc:3060] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.250787 22714 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:52.252717 22713 tablet_bootstrap.cc:654] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.297079 22711 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:52.256966 22714 tablet_bootstrap.cc:654] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.269393 22720 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.258899 22583 tablet_service.cc:1511] Processing CreateTablet for tablet c1e9a4f6e8ed40e5a1854b3462b79964 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 12:26:52.273707 22409 leader_election.cc:343] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.317766 22718 raft_consensus.cc:493] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.283507 22519 raft_consensus.cc:2468] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:52.221011 22712 raft_consensus.cc:359] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.326195 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2297d3b48646d290a82d37a12edfe4" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:52.325419 22718 raft_consensus.cc:515] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.328356 22578 tablet_service.cc:1511] Processing CreateTablet for tablet c8474847f8e04fd58b6b04a2bce93bee (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:52.329424 22718 leader_election.cc:290] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:52.331141 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e9a4f6e8ed40e5a1854b3462b79964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.342518 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8474847f8e04fd58b6b04a2bce93bee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:52.324430 22409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.67:33639, user_credentials={real_user=slave}} blocked reactor thread for 50959us
I20260709 12:26:52.347101 22559 leader_election.cc:304] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:52.333798 22712 raft_consensus.cc:385] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.354029 22721 raft_consensus.cc:2804] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.360049 22505 tablet_service.cc:1511] Processing CreateTablet for tablet eed4a7e6a404436dafc8fa216c27bbb4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:52.344131 22428 tablet_service.cc:1511] Processing CreateTablet for tablet eed4a7e6a404436dafc8fa216c27bbb4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:52.321888 22720 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.375233 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed4a7e6a404436dafc8fa216c27bbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.377442 22580 tablet_service.cc:1511] Processing CreateTablet for tablet eed4a7e6a404436dafc8fa216c27bbb4 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:52.379191 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed4a7e6a404436dafc8fa216c27bbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.356160 22712 raft_consensus.cc:740] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.382577 22721 raft_consensus.cc:697] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:52.389623 22721 consensus_queue.cc:237] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.395354 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eeef333a78947669db43fca25c58e78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:52.415653 22667 raft_consensus.cc:2468] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:52.398528 22744 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.416914 22744 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.390031 22740 raft_consensus.cc:493] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.418305 22740 raft_consensus.cc:515] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.419970 22744 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.420439 22740 leader_election.cc:290] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.420661 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:52.398190 22654 tablet_service.cc:1511] Processing CreateTablet for tablet caf37be188fc415084a391ababe64d34 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:52.397904 22652 tablet_service.cc:1511] Processing CreateTablet for tablet c8474847f8e04fd58b6b04a2bce93bee (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:52.390256 22428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed4a7e6a404436dafc8fa216c27bbb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.392762 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:52.426916 22593 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:52.395828 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eeef333a78947669db43fca25c58e78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:52.421985 22654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf37be188fc415084a391ababe64d34. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:52.388796 22410 leader_election.cc:343] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.392953 22720 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:52.424620 22655 tablet_service.cc:1511] Processing CreateTablet for tablet c1e9a4f6e8ed40e5a1854b3462b79964 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:52.431636 22666 raft_consensus.cc:3060] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.436303 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:52.455540 22667 raft_consensus.cc:2468] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:52.456918 22485 leader_election.cc:304] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:52.457804 22718 raft_consensus.cc:2804] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.458159 22718 raft_consensus.cc:493] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.458474 22718 raft_consensus.cc:3060] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.393462 22712 consensus_queue.cc:260] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.439196 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:52.464115 22409 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:52.442154 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:52.448424 22503 tablet_service.cc:1511] Processing CreateTablet for tablet caf37be188fc415084a391ababe64d34 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:52.449594 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:52.463816 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8474847f8e04fd58b6b04a2bce93bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.469056 22577 tablet_service.cc:1511] Processing CreateTablet for tablet 7fcb63af1b654f0b8f361fb4bcf9a9a6 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:52.469421 22443 raft_consensus.cc:2468] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:52.470358 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fcb63af1b654f0b8f361fb4bcf9a9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.470307 22519 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:52.454403 22410 leader_election.cc:304] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:52.468261 22431 tablet_service.cc:1511] Processing CreateTablet for tablet caf37be188fc415084a391ababe64d34 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:52.464454 22444 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:52.476785 22557 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
W20260709 12:26:52.477025 22410 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 95150us
I20260709 12:26:52.477442 22631 leader_election.cc:304] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:52.477654 22744 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.478068 22744 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.478418 22744 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.479087 22740 raft_consensus.cc:2749] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.479580 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf37be188fc415084a391ababe64d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.479971 22735 raft_consensus.cc:2804] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.480360 22735 raft_consensus.cc:493] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.480700 22735 raft_consensus.cc:3060] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.481021 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:52.482312 22720 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.482946 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e9a4f6e8ed40e5a1854b3462b79964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.478440 22650 tablet_service.cc:1511] Processing CreateTablet for tablet 7fcb63af1b654f0b8f361fb4bcf9a9a6 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:52.474684 22718 raft_consensus.cc:515] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.485992 22518 raft_consensus.cc:2393] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1704a791486d41aca21c226c48b00d89 in current term 1: Already voted for candidate b3766de80037442fbcfbef7158ad1868 in this term.
I20260709 12:26:52.485978 22744 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.487403 22650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fcb63af1b654f0b8f361fb4bcf9a9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.488965 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:52.489566 22444 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.498693 22444 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:52.504439 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:52.505137 22518 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.505846 22713 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:52.506537 22713 ts_tablet_manager.cc:1403] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.393s	user 0.008s	sys 0.009s
I20260709 12:26:52.507447 22517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:52.508275 22517 raft_consensus.cc:2393] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b50b6c210724c66b6ee01c04ab9676d in current term 1: Already voted for candidate b3766de80037442fbcfbef7158ad1868 in this term.
I20260709 12:26:52.511749 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf37be188fc415084a391ababe64d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.512663 22518 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:52.513984 22559 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:52.514940 22721 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.512164 22744 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.515729 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:52.516614 22519 raft_consensus.cc:2393] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b50b6c210724c66b6ee01c04ab9676d in current term 1: Already voted for candidate b662aaf197d344acbc951b9da5cebf2b in this term.
I20260709 12:26:52.512082 22342 catalog_manager.cc:5697] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.501663 22720 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.520108 22720 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.524369 22735 raft_consensus.cc:515] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.526588 22667 raft_consensus.cc:2393] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b50b6c210724c66b6ee01c04ab9676d in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:26:52.528367 22410 leader_election.cc:304] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:52.529624 22740 raft_consensus.cc:3060] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.530032 22718 leader_election.cc:290] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:52.530874 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:52.530922 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:52.532027 22667 raft_consensus.cc:2393] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:26:52.525450 22651 tablet_service.cc:1511] Processing CreateTablet for tablet 2a056e813b794e0bb9f0055705fc192a (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:52.546904 22735 leader_election.cc:290] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.547364 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:52.547851 22430 tablet_service.cc:1511] Processing CreateTablet for tablet 7fcb63af1b654f0b8f361fb4bcf9a9a6 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:52.548494 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:52.549139 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fcb63af1b654f0b8f361fb4bcf9a9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.549284 22519 raft_consensus.cc:2393] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1704a791486d41aca21c226c48b00d89 in current term 1: Already voted for candidate b3766de80037442fbcfbef7158ad1868 in this term.
I20260709 12:26:52.549671 22714 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:52.550158 22714 ts_tablet_manager.cc:1403] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.300s	user 0.010s	sys 0.005s
I20260709 12:26:52.551777 22631 leader_election.cc:304] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:52.552953 22735 raft_consensus.cc:2749] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.555436 22740 raft_consensus.cc:2749] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.557479 22711 tablet_bootstrap.cc:654] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.536156 22666 raft_consensus.cc:2468] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:52.565073 22443 raft_consensus.cc:2468] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:52.565441 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a056e813b794e0bb9f0055705fc192a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.567489 22483 leader_election.cc:304] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:52.543144 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d909a252b3344a49aa050687c81371f1" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:52.569720 22444 raft_consensus.cc:2376] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1. Re-sending same reply.
I20260709 12:26:52.565106 22712 ts_tablet_manager.cc:1434] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.412s	user 0.018s	sys 0.023s
I20260709 12:26:52.581508 22713 raft_consensus.cc:359] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:52.582695 22748 raft_consensus.cc:2804] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.585949 22580 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab59b0f3c2140c198fb8aeb30cf9389 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:52.587322 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab59b0f3c2140c198fb8aeb30cf9389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.584479 22713 raft_consensus.cc:385] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.588505 22713 raft_consensus.cc:740] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.588143 22432 tablet_service.cc:1511] Processing CreateTablet for tablet 8232aac5b6cf43f79a9dcb0181721fb3 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:52.589567 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8232aac5b6cf43f79a9dcb0181721fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.589311 22713 consensus_queue.cc:260] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:52.591156 22652 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab59b0f3c2140c198fb8aeb30cf9389 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:52.592367 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab59b0f3c2140c198fb8aeb30cf9389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.593387 22748 raft_consensus.cc:697] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:52.594414 22748 consensus_queue.cc:237] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.588178 22720 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.600018 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:52.600636 22519 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.601749 22713 ts_tablet_manager.cc:1434] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.000s
I20260709 12:26:52.602010 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:52.582266 22721 raft_consensus.cc:697] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:52.588760 22714 raft_consensus.cc:359] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.616400 22714 raft_consensus.cc:385] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.616770 22714 raft_consensus.cc:740] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.603039 22720 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:52.617323 22721 consensus_queue.cc:237] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.617790 22714 consensus_queue.cc:260] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.618300 22503 tablet_service.cc:1511] Processing CreateTablet for tablet 8232aac5b6cf43f79a9dcb0181721fb3 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:52.619688 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8232aac5b6cf43f79a9dcb0181721fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.561535 22505 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab59b0f3c2140c198fb8aeb30cf9389 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:52.610549 22711 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:52.611821 22519 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:26:52.629340 22410 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:52.613476 22712 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:52.630285 22720 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.602790 22713 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:52.631541 22720 raft_consensus.cc:697] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:26:52.632431 22720 consensus_queue.cc:237] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.627594 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab59b0f3c2140c198fb8aeb30cf9389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.628055 22711 ts_tablet_manager.cc:1403] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.419s	user 0.009s	sys 0.011s
I20260709 12:26:52.642728 22711 raft_consensus.cc:359] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.643502 22711 raft_consensus.cc:385] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.643847 22711 raft_consensus.cc:740] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.644977 22711 consensus_queue.cc:260] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.625154 22714 ts_tablet_manager.cc:1434] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:26:52.646639 22714 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:52.656147 22713 tablet_bootstrap.cc:654] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.660245 22712 tablet_bootstrap.cc:654] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.662324 22711 ts_tablet_manager.cc:1434] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:26:52.673707 22711 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:52.678419 22577 tablet_service.cc:1511] Processing CreateTablet for tablet 8232aac5b6cf43f79a9dcb0181721fb3 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:52.683709 22714 tablet_bootstrap.cc:654] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.686241 22654 tablet_service.cc:1511] Processing CreateTablet for tablet 347648ceea81494ab02439c3c0cbb346 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:52.687954 22654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347648ceea81494ab02439c3c0cbb346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.680969 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8232aac5b6cf43f79a9dcb0181721fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.689663 22338 catalog_manager.cc:5697] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 0 to 2, leader changed from <none> to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.684211 22341 catalog_manager.cc:5697] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.700827 22508 tablet_service.cc:1511] Processing CreateTablet for tablet 347648ceea81494ab02439c3c0cbb346 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:52.702240 22508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347648ceea81494ab02439c3c0cbb346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.703227 22655 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72f62885ce4d3b96f5b6e5e2f1b1a2 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:52.705494 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72f62885ce4d3b96f5b6e5e2f1b1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.705802 22509 tablet_service.cc:1511] Processing CreateTablet for tablet e663a8692ca14cefbe1c5e449bcdd818 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:52.707075 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e663a8692ca14cefbe1c5e449bcdd818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.707433 22583 tablet_service.cc:1511] Processing CreateTablet for tablet e663a8692ca14cefbe1c5e449bcdd818 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:52.707732 22580 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72f62885ce4d3b96f5b6e5e2f1b1a2 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:52.709221 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e663a8692ca14cefbe1c5e449bcdd818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.709956 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72f62885ce4d3b96f5b6e5e2f1b1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.710188 22428 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72f62885ce4d3b96f5b6e5e2f1b1a2 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:52.711573 22428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72f62885ce4d3b96f5b6e5e2f1b1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.715668 22651 tablet_service.cc:1511] Processing CreateTablet for tablet e663a8692ca14cefbe1c5e449bcdd818 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:52.718339 22504 tablet_service.cc:1511] Processing CreateTablet for tablet a0e89b4817634267af8055d08a1b1f72 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:52.719554 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e89b4817634267af8055d08a1b1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.720515 22650 tablet_service.cc:1511] Processing CreateTablet for tablet 2027b04cc47c4770a74b4e67e631780b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:52.721979 22579 tablet_service.cc:1511] Processing CreateTablet for tablet a0e89b4817634267af8055d08a1b1f72 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:52.723172 22579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e89b4817634267af8055d08a1b1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.726562 22506 tablet_service.cc:1511] Processing CreateTablet for tablet 2027b04cc47c4770a74b4e67e631780b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:52.727818 22506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2027b04cc47c4770a74b4e67e631780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.728478 22578 tablet_service.cc:1511] Processing CreateTablet for tablet 8051a982a56c4bd6a92fe0fcc84095e6 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:52.729770 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8051a982a56c4bd6a92fe0fcc84095e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.730756 22656 tablet_service.cc:1511] Processing CreateTablet for tablet 8051a982a56c4bd6a92fe0fcc84095e6 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:52.733155 22430 tablet_service.cc:1511] Processing CreateTablet for tablet 2027b04cc47c4770a74b4e67e631780b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:52.736191 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2027b04cc47c4770a74b4e67e631780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.738090 22582 tablet_service.cc:1511] Processing CreateTablet for tablet 48be715b16cb41ebbc7dd26ce297706b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:52.738381 22427 tablet_service.cc:1511] Processing CreateTablet for tablet 8051a982a56c4bd6a92fe0fcc84095e6 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:52.739277 22582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be715b16cb41ebbc7dd26ce297706b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.739629 22427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8051a982a56c4bd6a92fe0fcc84095e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.734081 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e663a8692ca14cefbe1c5e449bcdd818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.736778 22507 tablet_service.cc:1511] Processing CreateTablet for tablet 48be715b16cb41ebbc7dd26ce297706b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:52.750627 22507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be715b16cb41ebbc7dd26ce297706b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.751683 22434 tablet_service.cc:1511] Processing CreateTablet for tablet f7825c613d9040b1bd0b0a76c9ab864e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:52.752913 22434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7825c613d9040b1bd0b0a76c9ab864e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:52.755127 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:52.754943 22581 tablet_service.cc:1511] Processing CreateTablet for tablet f7825c613d9040b1bd0b0a76c9ab864e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:52.756188 22581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7825c613d9040b1bd0b0a76c9ab864e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.758009 22429 tablet_service.cc:1511] Processing CreateTablet for tablet 01570c53874f495494092ddc9bb43c05 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:52.759194 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01570c53874f495494092ddc9bb43c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.761255 22576 tablet_service.cc:1511] Processing CreateTablet for tablet bbf864ca7eae4b90b7a573bcd2d4fe03 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:52.762513 22576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf864ca7eae4b90b7a573bcd2d4fe03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.763156 22502 tablet_service.cc:1511] Processing CreateTablet for tablet f7825c613d9040b1bd0b0a76c9ab864e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:52.763563 22657 tablet_service.cc:1511] Processing CreateTablet for tablet 48be715b16cb41ebbc7dd26ce297706b (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:52.764437 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7825c613d9040b1bd0b0a76c9ab864e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.764843 22657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be715b16cb41ebbc7dd26ce297706b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.766120 22501 tablet_service.cc:1511] Processing CreateTablet for tablet 01570c53874f495494092ddc9bb43c05 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:52.766597 22735 raft_consensus.cc:493] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.767148 22735 raft_consensus.cc:515] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:52.767508 22501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01570c53874f495494092ddc9bb43c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.770290 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890e148410fe4d348d9bb67d9b26e53c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:52.770915 22444 raft_consensus.cc:2468] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:52.772717 22631 leader_election.cc:304] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:52.773391 22653 tablet_service.cc:1511] Processing CreateTablet for tablet 01570c53874f495494092ddc9bb43c05 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:52.773981 22735 leader_election.cc:290] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:52.774528 22735 raft_consensus.cc:2804] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.774653 22653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01570c53874f495494092ddc9bb43c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.774904 22735 raft_consensus.cc:493] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.775327 22735 raft_consensus.cc:3060] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.778266 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890e148410fe4d348d9bb67d9b26e53c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
W20260709 12:26:52.780120 22633 leader_election.cc:343] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.781749 22649 tablet_service.cc:1511] Processing CreateTablet for tablet bbf864ca7eae4b90b7a573bcd2d4fe03 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:52.783007 22649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf864ca7eae4b90b7a573bcd2d4fe03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.783754 22433 tablet_service.cc:1511] Processing CreateTablet for tablet bbf864ca7eae4b90b7a573bcd2d4fe03 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:52.785049 22433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf864ca7eae4b90b7a573bcd2d4fe03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.811458 22650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2027b04cc47c4770a74b4e67e631780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.822103 22575 tablet_service.cc:1511] Processing CreateTablet for tablet cae0b622804545ada0418c3cd4bfa2b5 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:52.822667 22500 tablet_service.cc:1511] Processing CreateTablet for tablet cae0b622804545ada0418c3cd4bfa2b5 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:52.823479 22575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae0b622804545ada0418c3cd4bfa2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.824020 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae0b622804545ada0418c3cd4bfa2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.826162 22648 tablet_service.cc:1511] Processing CreateTablet for tablet cae0b622804545ada0418c3cd4bfa2b5 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:52.833359 22648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae0b622804545ada0418c3cd4bfa2b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:52.837781 22753 log.cc:927] Time spent T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:26:52.837540 22432 tablet_service.cc:1511] Processing CreateTablet for tablet a0e89b4817634267af8055d08a1b1f72 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:52.838836 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e89b4817634267af8055d08a1b1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.847972 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 347648ceea81494ab02439c3c0cbb346 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:52.851120 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347648ceea81494ab02439c3c0cbb346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.855892 22656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8051a982a56c4bd6a92fe0fcc84095e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.861769 22711 tablet_bootstrap.cc:654] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.863284 22721 raft_consensus.cc:493] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.863754 22721 raft_consensus.cc:515] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:52.865338 22749 consensus_queue.cc:1048] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.867527 22721 leader_election.cc:290] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:52.869899 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:52.870800 22426 tablet_service.cc:1511] Processing CreateTablet for tablet 6050042789ac4564968285caf738cbfd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:26:52.874135 22559 leader_election.cc:343] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.877642 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
W20260709 12:26:52.880810 22557 leader_election.cc:343] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.881289 22557 leader_election.cc:304] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:26:52.882510 22721 raft_consensus.cc:2749] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:52.885485 22754 log.cc:927] Time spent T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:52.886094 22712 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:52.886584 22712 ts_tablet_manager.cc:1403] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.273s	user 0.013s	sys 0.026s
I20260709 12:26:52.895376 22749 consensus_queue.cc:1048] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.910212 22655 tablet_service.cc:1511] Processing CreateTablet for tablet d7389131679245b79dae4f4f256f4bd0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:52.911562 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7389131679245b79dae4f4f256f4bd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:52.819523 22631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:34885, user_credentials={real_user=slave}} blocked reactor thread for 46899.8us
I20260709 12:26:52.922072 22713 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:52.922596 22713 ts_tablet_manager.cc:1403] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.320s	user 0.011s	sys 0.006s
I20260709 12:26:52.925863 22509 tablet_service.cc:1511] Processing CreateTablet for tablet 6050042789ac4564968285caf738cbfd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:52.936395 22714 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:52.936959 22714 ts_tablet_manager.cc:1403] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.291s	user 0.014s	sys 0.011s
I20260709 12:26:52.944947 22429 tablet_service.cc:1511] Processing CreateTablet for tablet d7389131679245b79dae4f4f256f4bd0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:52.945434 22578 tablet_service.cc:1511] Processing CreateTablet for tablet 6050042789ac4564968285caf738cbfd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:52.957151 22577 tablet_service.cc:1511] Processing CreateTablet for tablet 2354de9b29b94e98875230231b43cf19 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:52.957967 22713 raft_consensus.cc:359] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:52.958796 22713 raft_consensus.cc:385] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.959085 22713 raft_consensus.cc:740] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.964919 22433 tablet_service.cc:1511] Processing CreateTablet for tablet 2354de9b29b94e98875230231b43cf19 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:52.965982 22712 raft_consensus.cc:359] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.966706 22712 raft_consensus.cc:385] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.966995 22712 raft_consensus.cc:740] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.967741 22712 consensus_queue.cc:260] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:52.969875 22506 tablet_service.cc:1511] Processing CreateTablet for tablet d7389131679245b79dae4f4f256f4bd0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:52.954682 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6050042789ac4564968285caf738cbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.972517 22504 tablet_service.cc:1511] Processing CreateTablet for tablet 323fb614c73f476e882fd71e0015db18 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:52.973101 22433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2354de9b29b94e98875230231b43cf19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.975425 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7389131679245b79dae4f4f256f4bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.975630 22649 tablet_service.cc:1511] Processing CreateTablet for tablet 2354de9b29b94e98875230231b43cf19 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:52.978591 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6050042789ac4564968285caf738cbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.978757 22712 ts_tablet_manager.cc:1434] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.002s
I20260709 12:26:52.981556 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2354de9b29b94e98875230231b43cf19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.985376 22714 raft_consensus.cc:359] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:52.986146 22714 raft_consensus.cc:385] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.986440 22714 raft_consensus.cc:740] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.987253 22714 consensus_queue.cc:260] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:52.990026 22714 ts_tablet_manager.cc:1434] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:26:52.991030 22714 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:52.976882 22649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2354de9b29b94e98875230231b43cf19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.994103 22580 tablet_service.cc:1511] Processing CreateTablet for tablet 323fb614c73f476e882fd71e0015db18 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:52.995397 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323fb614c73f476e882fd71e0015db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.998584 22735 raft_consensus.cc:515] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.010769 22509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6050042789ac4564968285caf738cbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.020150 22651 tablet_service.cc:1511] Processing CreateTablet for tablet 323fb614c73f476e882fd71e0015db18 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:53.022189 22519 raft_consensus.cc:1240] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Rejecting Update request from peer b662aaf197d344acbc951b9da5cebf2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.023375 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 53e50879db9d44aaaac554d982fb8377 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:53.026866 22517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890e148410fe4d348d9bb67d9b26e53c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:53.027763 22735 leader_election.cc:290] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:53.027951 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890e148410fe4d348d9bb67d9b26e53c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:53.038606 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e50879db9d44aaaac554d982fb8377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.038967 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323fb614c73f476e882fd71e0015db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.042528 22711 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:53.043215 22711 ts_tablet_manager.cc:1403] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.370s	user 0.007s	sys 0.007s
I20260709 12:26:53.046176 22444 raft_consensus.cc:3060] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.049702 22749 consensus_queue.cc:1059] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.050299 22712 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:52.999605 22713 consensus_queue.cc:260] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.086664 22503 tablet_service.cc:1511] Processing CreateTablet for tablet 53e50879db9d44aaaac554d982fb8377 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:53.154237 22506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7389131679245b79dae4f4f256f4bd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.063498 22744 raft_consensus.cc:493] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.160988 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323fb614c73f476e882fd71e0015db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.164276 22583 tablet_service.cc:1511] Processing CreateTablet for tablet 53e50879db9d44aaaac554d982fb8377 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:26:53.146620 22633 leader_election.cc:343] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:53.165333 22633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 101618us
I20260709 12:26:53.166659 22748 raft_consensus.cc:493] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.167141 22748 raft_consensus.cc:515] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.167660 22650 tablet_service.cc:1511] Processing CreateTablet for tablet e6212b63ad2544469e53bc3d157e04a9 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:53.168915 22650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6212b63ad2544469e53bc3d157e04a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.170276 22711 raft_consensus.cc:359] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.171003 22711 raft_consensus.cc:385] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.170733 22744 raft_consensus.cc:515] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.171360 22711 raft_consensus.cc:740] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.174382 22744 leader_election.cc:290] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:53.174212 22711 consensus_queue.cc:260] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.175963 22712 tablet_bootstrap.cc:654] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.182322 22583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e50879db9d44aaaac554d982fb8377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.183259 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e50879db9d44aaaac554d982fb8377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.184372 22714 tablet_bootstrap.cc:654] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.187268 22429 tablet_service.cc:1511] Processing CreateTablet for tablet e6212b63ad2544469e53bc3d157e04a9 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:53.188509 22429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6212b63ad2544469e53bc3d157e04a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.193400 22748 leader_election.cc:290] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:53.203527 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c00de8d7389494ebc91a22801a56392" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:53.221441 22711 ts_tablet_manager.cc:1434] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.178s	user 0.007s	sys 0.001s
I20260709 12:26:53.221866 22721 raft_consensus.cc:3055] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.222227 22721 raft_consensus.cc:740] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:53.222524 22711 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:53.223019 22721 consensus_queue.cc:260] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
W20260709 12:26:53.161427 22559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 101896us
I20260709 12:26:53.204212 22443 raft_consensus.cc:2468] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:53.273495 22483 leader_election.cc:304] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:53.280449 22748 raft_consensus.cc:2804] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.286075 22748 raft_consensus.cc:493] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.287148 22748 raft_consensus.cc:3060] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.311743 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2297d3b48646d290a82d37a12edfe4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:53.315421 22518 raft_consensus.cc:1275] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:53.318215 22442 raft_consensus.cc:1240] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Rejecting Update request from peer b662aaf197d344acbc951b9da5cebf2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.318638 22720 consensus_queue.cc:1048] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.321305 22712 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:53.322239 22712 ts_tablet_manager.cc:1403] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.272s	user 0.022s	sys 0.024s
I20260709 12:26:53.322350 22714 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:53.322852 22714 ts_tablet_manager.cc:1403] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.332s	user 0.017s	sys 0.065s
I20260709 12:26:53.324208 22721 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.325644 22714 raft_consensus.cc:359] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.326383 22714 raft_consensus.cc:385] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.326180 22426 tablet_service.cc:1511] Processing CreateTablet for tablet a54217161e134ab3aeccf82f299bdf52 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:53.326751 22714 raft_consensus.cc:740] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.327795 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54217161e134ab3aeccf82f299bdf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.327729 22714 consensus_queue.cc:260] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.330271 22714 ts_tablet_manager.cc:1434] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:53.332504 22433 tablet_service.cc:1511] Processing CreateTablet for tablet 37840b43da264e199e487917060afcd0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:53.333782 22433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37840b43da264e199e487917060afcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.336206 22714 tablet_bootstrap.cc:492] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:53.337236 22771 consensus_queue.cc:1048] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.338378 22430 tablet_service.cc:1511] Processing CreateTablet for tablet 00fa50014add43a18981a5a1af88f89c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:53.339587 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fa50014add43a18981a5a1af88f89c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.341236 22712 raft_consensus.cc:359] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.341965 22712 raft_consensus.cc:385] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.342257 22712 raft_consensus.cc:740] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.343240 22655 tablet_service.cc:1511] Processing CreateTablet for tablet a54217161e134ab3aeccf82f299bdf52 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:53.343982 22649 tablet_service.cc:1511] Processing CreateTablet for tablet 337431b8a27e4b17ac0a96ce4f9bfa1f (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:53.344486 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54217161e134ab3aeccf82f299bdf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.345175 22649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337431b8a27e4b17ac0a96ce4f9bfa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.343125 22712 consensus_queue.cc:260] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.345996 22657 tablet_service.cc:1511] Processing CreateTablet for tablet 00fa50014add43a18981a5a1af88f89c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:53.347194 22657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fa50014add43a18981a5a1af88f89c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.349125 22443 raft_consensus.cc:2468] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:53.349613 22432 tablet_service.cc:1511] Processing CreateTablet for tablet e1e0af41092c454cb010bef793f8ee91 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:53.350215 22656 tablet_service.cc:1511] Processing CreateTablet for tablet e1e0af41092c454cb010bef793f8ee91 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:53.350795 22432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e0af41092c454cb010bef793f8ee91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.351732 22656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e0af41092c454cb010bef793f8ee91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.354264 22648 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9971a97d734f6195685a52c3a70d69 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:53.355283 22771 consensus_queue.cc:1048] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.355598 22648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9971a97d734f6195685a52c3a70d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.369944 22434 tablet_service.cc:1511] Processing CreateTablet for tablet b957090ae4e240fdbd7eeca1dc5f62fd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:53.378229 22434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b957090ae4e240fdbd7eeca1dc5f62fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.364033 22444 raft_consensus.cc:2468] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:53.371623 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2297d3b48646d290a82d37a12edfe4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:53.419994 22631 leader_election.cc:304] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:53.420521 22712 ts_tablet_manager.cc:1434] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.098s	user 0.015s	sys 0.029s
I20260709 12:26:53.420840 22735 raft_consensus.cc:2804] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.421447 22735 raft_consensus.cc:697] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:53.421635 22712 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:53.421283 22426 tablet_service.cc:1511] Processing CreateTablet for tablet 97bf3648f5b74bf6a70e11f336dc788e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:53.422889 22426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bf3648f5b74bf6a70e11f336dc788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.422360 22735 consensus_queue.cc:237] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.429289 22714 tablet_bootstrap.cc:654] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.409191 22667 raft_consensus.cc:2468] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:53.432760 22713 ts_tablet_manager.cc:1434] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.510s	user 0.024s	sys 0.006s
I20260709 12:26:53.445858 22653 tablet_service.cc:1511] Processing CreateTablet for tablet 97bf3648f5b74bf6a70e11f336dc788e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:53.447239 22653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bf3648f5b74bf6a70e11f336dc788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.452049 22748 raft_consensus.cc:515] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.439994 22759 raft_consensus.cc:493] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.498390 22759 raft_consensus.cc:515] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.500077 22748 leader_election.cc:290] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:53.501137 22759 leader_election.cc:290] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:53.463006 22593 raft_consensus.cc:1275] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:26:53.463227 22431 tablet_service.cc:1511] Processing CreateTablet for tablet 9f54eadf52a74cd88517b59b0c79507c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:53.504896 22431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f54eadf52a74cd88517b59b0c79507c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.465181 22654 tablet_service.cc:1511] Processing CreateTablet for tablet 9f54eadf52a74cd88517b59b0c79507c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:53.414074 22557 leader_election.cc:304] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:53.448864 22711 tablet_bootstrap.cc:654] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.484999 22507 tablet_service.cc:1511] Processing CreateTablet for tablet e6212b63ad2544469e53bc3d157e04a9 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:53.487123 22502 tablet_service.cc:1511] Processing CreateTablet for tablet 337431b8a27e4b17ac0a96ce4f9bfa1f (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:53.489010 22506 tablet_service.cc:1511] Processing CreateTablet for tablet 37840b43da264e199e487917060afcd0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:53.490968 22508 tablet_service.cc:1511] Processing CreateTablet for tablet 00fa50014add43a18981a5a1af88f89c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:53.491297 22500 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9971a97d734f6195685a52c3a70d69 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:53.493992 22501 tablet_service.cc:1511] Processing CreateTablet for tablet b957090ae4e240fdbd7eeca1dc5f62fd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:53.495941 22505 tablet_service.cc:1511] Processing CreateTablet for tablet 97bf3648f5b74bf6a70e11f336dc788e (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:53.524814 22654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f54eadf52a74cd88517b59b0c79507c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.531149 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c00de8d7389494ebc91a22801a56392" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:53.531772 22444 raft_consensus.cc:3060] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.508267 22593 pending_rounds.cc:85] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Aborting all ops after (but not including) 0
I20260709 12:26:53.533259 22593 pending_rounds.cc:107] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:53.533531 22593 raft_consensus.cc:2889] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:53.504154 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:53.523607 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337431b8a27e4b17ac0a96ce4f9bfa1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:53.535272 22631 leader_election.cc:343] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.537336 22500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9971a97d734f6195685a52c3a70d69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:53.539529 22559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 75253.9us
I20260709 12:26:53.541509 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c00de8d7389494ebc91a22801a56392" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:53.543357 22484 leader_election.cc:343] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.543617 22444 raft_consensus.cc:2468] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:53.544780 22483 leader_election.cc:304] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:53.545513 22508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fa50014add43a18981a5a1af88f89c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.545714 22776 raft_consensus.cc:2804] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.523895 22712 tablet_bootstrap.cc:654] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.551311 22501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b957090ae4e240fdbd7eeca1dc5f62fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.525108 22714 tablet_bootstrap.cc:492] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:53.526151 22768 raft_consensus.cc:2804] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:53.518290 22557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:34885, user_credentials={real_user=slave}} blocked reactor thread for 109687us
W20260709 12:26:53.445222 22713 ts_tablet_manager.cc:1467] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: Tablet startup took 522ms
I20260709 12:26:53.554535 22505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bf3648f5b74bf6a70e11f336dc788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.555505 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c00de8d7389494ebc91a22801a56392" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:53.559285 22768 raft_consensus.cc:493] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.569239 22768 raft_consensus.cc:3060] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.565246 22776 raft_consensus.cc:697] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:53.560511 22714 ts_tablet_manager.cc:1403] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.229s	user 0.018s	sys 0.015s
W20260709 12:26:53.565706 22713 ts_tablet_manager.cc:1469] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: Trace:
0709 12:26:51.581253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.585124 (+  3871us) service_pool.cc:224] Handling call
0709 12:26:51.587002 (+  1878us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:51.587101 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:51.624430 (+ 37329us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:51.757099 (+132669us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:51.761182 (+  4083us) inbound_call.cc:177] Queueing success response
0709 12:26:52.602481 (+841299us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:52.922900 (+320419us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:52.923584 (+   684us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:52.924220 (+   636us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":112416,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"tablet-open.queue_time_us":841351,"thread_start_us":64901,"threads_started":1}
I20260709 12:26:53.576956 22776 consensus_queue.cc:237] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.578670 22713 tablet_bootstrap.cc:492] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:53.561959 22577 tablet_service.cc:1511] Processing CreateTablet for tablet a54217161e134ab3aeccf82f299bdf52 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:53.562413 22578 tablet_service.cc:1511] Processing CreateTablet for tablet 337431b8a27e4b17ac0a96ce4f9bfa1f (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:53.562539 22580 tablet_service.cc:1511] Processing CreateTablet for tablet 37840b43da264e199e487917060afcd0 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:53.580951 22580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37840b43da264e199e487917060afcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.563997 22582 tablet_service.cc:1511] Processing CreateTablet for tablet 9f54eadf52a74cd88517b59b0c79507c (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:53.566233 22575 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9971a97d734f6195685a52c3a70d69 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:53.582716 22720 consensus_queue.cc:1048] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.583838 22506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37840b43da264e199e487917060afcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.563997 22579 tablet_service.cc:1511] Processing CreateTablet for tablet e1e0af41092c454cb010bef793f8ee91 (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:53.582796 22577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54217161e134ab3aeccf82f299bdf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.566964 22581 tablet_service.cc:1511] Processing CreateTablet for tablet b957090ae4e240fdbd7eeca1dc5f62fd (DEFAULT_TABLE table=test-workload [id=235f0201073041d0bd6166cce9ab6a2e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:53.586624 22581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b957090ae4e240fdbd7eeca1dc5f62fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.587348 22575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9971a97d734f6195685a52c3a70d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.588862 22507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6212b63ad2544469e53bc3d157e04a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.588989 22582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f54eadf52a74cd88517b59b0c79507c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.595651 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337431b8a27e4b17ac0a96ce4f9bfa1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.579888 22714 raft_consensus.cc:359] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.599323 22714 raft_consensus.cc:385] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.599701 22714 raft_consensus.cc:740] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
W20260709 12:26:53.600050 22484 leader_election.cc:343] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.600579 22714 consensus_queue.cc:260] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.603036 22714 ts_tablet_manager.cc:1434] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:26:53.599045 22579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e0af41092c454cb010bef793f8ee91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:53.609978 22768 raft_consensus.cc:515] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.626564 22768 leader_election.cc:290] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:53.650063 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2297d3b48646d290a82d37a12edfe4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:53.650753 22442 raft_consensus.cc:3060] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.672253 22341 catalog_manager.cc:5697] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.681182 22714 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:53.689184 22712 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:53.689792 22712 ts_tablet_manager.cc:1403] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.268s	user 0.034s	sys 0.007s
I20260709 12:26:53.692806 22712 raft_consensus.cc:359] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.693513 22712 raft_consensus.cc:385] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.693809 22712 raft_consensus.cc:740] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.694489 22712 consensus_queue.cc:260] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.696616 22712 ts_tablet_manager.cc:1434] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:53.697618 22712 tablet_bootstrap.cc:492] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:53.698362 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2297d3b48646d290a82d37a12edfe4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:53.698987 22666 raft_consensus.cc:3060] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.703568 22712 tablet_bootstrap.cc:654] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.719884 22786 raft_consensus.cc:493] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.720342 22786 raft_consensus.cc:515] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.723248 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890e148410fe4d348d9bb67d9b26e53c" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:53.724086 22444 raft_consensus.cc:2393] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:26:53.723248 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "890e148410fe4d348d9bb67d9b26e53c" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:53.725514 22666 raft_consensus.cc:2468] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:53.726320 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:53.726878 22559 leader_election.cc:304] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:53.726970 22592 raft_consensus.cc:2468] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:53.727104 22485 leader_election.cc:304] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:26:53.727883 22768 raft_consensus.cc:2804] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.728057 22776 raft_consensus.cc:3060] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.728410 22768 raft_consensus.cc:697] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:53.729571 22768 consensus_queue.cc:237] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.733623 22632 leader_election.cc:304] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:26:53.734355 22442 raft_consensus.cc:2468] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:53.734524 22735 raft_consensus.cc:2804] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.734787 22786 leader_election.cc:290] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:53.735002 22735 raft_consensus.cc:493] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.735380 22735 raft_consensus.cc:3060] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.743438 22735 raft_consensus.cc:515] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.751070 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:53.751366 22711 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:53.751930 22711 ts_tablet_manager.cc:1403] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.530s	user 0.025s	sys 0.045s
W20260709 12:26:53.752590 22631 leader_election.cc:343] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.753675 22735 leader_election.cc:290] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:53.735406 22776 raft_consensus.cc:2749] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:53.755779 22713 tablet_bootstrap.cc:654] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.760041 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:53.760665 22592 raft_consensus.cc:3060] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.767364 22714 tablet_bootstrap.cc:654] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.767992 22592 raft_consensus.cc:2468] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
W20260709 12:26:53.764786 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:53.769261 22632 leader_election.cc:304] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:26:53.767309 22711 raft_consensus.cc:359] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.770535 22711 raft_consensus.cc:385] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.770900 22711 raft_consensus.cc:740] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.771876 22711 consensus_queue.cc:260] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.774963 22711 ts_tablet_manager.cc:1434] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:26:53.776983 22711 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:53.779743 22713 tablet_bootstrap.cc:492] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:53.775616 22735 raft_consensus.cc:2804] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.780244 22713 ts_tablet_manager.cc:1403] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.202s	user 0.010s	sys 0.013s
I20260709 12:26:53.780364 22735 raft_consensus.cc:697] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:53.781458 22735 consensus_queue.cc:237] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.782763 22714 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:53.783231 22713 raft_consensus.cc:359] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.784086 22713 raft_consensus.cc:385] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.784387 22713 raft_consensus.cc:740] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.785259 22713 consensus_queue.cc:260] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.787657 22713 ts_tablet_manager.cc:1434] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:53.788626 22713 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:53.791050 22711 tablet_bootstrap.cc:654] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.792001 22712 tablet_bootstrap.cc:492] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:53.792514 22712 ts_tablet_manager.cc:1403] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.002s
I20260709 12:26:53.796149 22713 tablet_bootstrap.cc:654] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.799150 22711 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:53.799043 22712 raft_consensus.cc:359] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.799940 22711 ts_tablet_manager.cc:1403] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.001s
I20260709 12:26:53.800228 22712 raft_consensus.cc:385] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.783286 22714 ts_tablet_manager.cc:1403] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.000s
I20260709 12:26:53.803088 22720 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.803738 22711 raft_consensus.cc:359] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.803593 22720 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.800707 22712 raft_consensus.cc:740] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.809587 22711 raft_consensus.cc:385] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.817068 22720 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:53.817196 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:53.818820 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:53.820715 22410 leader_election.cc:343] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.804965 22714 raft_consensus.cc:359] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
W20260709 12:26:53.821936 22409 leader_election.cc:343] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.822461 22409 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:53.822002 22714 raft_consensus.cc:385] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.815857 22711 raft_consensus.cc:740] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.823192 22720 raft_consensus.cc:2749] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:53.829521 22714 raft_consensus.cc:740] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.828909 22711 consensus_queue.cc:260] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.830554 22714 consensus_queue.cc:260] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.832365 22711 ts_tablet_manager.cc:1434] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 12:26:53.822746 22712 consensus_queue.cc:260] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.833611 22711 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:53.834263 22713 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:53.834802 22713 ts_tablet_manager.cc:1403] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.019s
I20260709 12:26:53.835426 22712 ts_tablet_manager.cc:1434] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.007s
I20260709 12:26:53.836239 22714 ts_tablet_manager.cc:1434] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:26:53.836611 22712 tablet_bootstrap.cc:492] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:53.837291 22714 tablet_bootstrap.cc:492] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:53.837975 22713 raft_consensus.cc:359] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.838732 22713 raft_consensus.cc:385] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.839061 22713 raft_consensus.cc:740] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.839978 22713 consensus_queue.cc:260] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.840639 22711 tablet_bootstrap.cc:654] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.842857 22713 ts_tablet_manager.cc:1434] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:53.843807 22713 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:53.844204 22712 tablet_bootstrap.cc:654] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.847524 22340 catalog_manager.cc:5697] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.849848 22713 tablet_bootstrap.cc:654] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.852674 22711 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:53.853273 22711 ts_tablet_manager.cc:1403] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:26:53.856583 22711 raft_consensus.cc:359] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.857470 22711 raft_consensus.cc:385] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.857810 22711 raft_consensus.cc:740] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.859395 22711 consensus_queue.cc:260] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.861150 22712 tablet_bootstrap.cc:492] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:53.861608 22712 ts_tablet_manager.cc:1403] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.003s
I20260709 12:26:53.861562 22711 ts_tablet_manager.cc:1434] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:53.861508 22713 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:53.862429 22713 ts_tablet_manager.cc:1403] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.010s
I20260709 12:26:53.862778 22711 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:53.864389 22712 raft_consensus.cc:359] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.863963 22341 catalog_manager.cc:5697] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.865079 22712 raft_consensus.cc:385] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.866652 22712 raft_consensus.cc:740] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.867331 22712 consensus_queue.cc:260] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.865398 22713 raft_consensus.cc:359] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.868199 22711 tablet_bootstrap.cc:654] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.869632 22712 ts_tablet_manager.cc:1434] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:53.868224 22713 raft_consensus.cc:385] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.870581 22712 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:53.870817 22713 raft_consensus.cc:740] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.871698 22713 consensus_queue.cc:260] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.873975 22713 ts_tablet_manager.cc:1434] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:26:53.874941 22713 tablet_bootstrap.cc:492] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:53.876551 22712 tablet_bootstrap.cc:654] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.880285 22713 tablet_bootstrap.cc:654] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.884121 22714 tablet_bootstrap.cc:654] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.906466 22342 catalog_manager.cc:5697] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.918222 22711 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:53.918717 22711 ts_tablet_manager.cc:1403] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.021s
I20260709 12:26:53.920490 22712 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:53.921006 22712 ts_tablet_manager.cc:1403] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.021s
I20260709 12:26:53.921388 22711 raft_consensus.cc:359] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.922112 22711 raft_consensus.cc:385] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.922390 22711 raft_consensus.cc:740] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.923065 22711 consensus_queue.cc:260] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.923906 22712 raft_consensus.cc:359] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.924551 22712 raft_consensus.cc:385] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.924793 22712 raft_consensus.cc:740] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.925388 22711 ts_tablet_manager.cc:1434] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:26:53.925549 22712 consensus_queue.cc:260] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.927495 22711 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:53.928083 22713 tablet_bootstrap.cc:492] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:53.928571 22713 ts_tablet_manager.cc:1403] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.014s
I20260709 12:26:53.930274 22712 ts_tablet_manager.cc:1434] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:26:53.931223 22712 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:53.932209 22714 tablet_bootstrap.cc:492] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:53.932658 22714 ts_tablet_manager.cc:1403] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.020s
I20260709 12:26:53.934182 22711 tablet_bootstrap.cc:654] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.935186 22714 raft_consensus.cc:359] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.935832 22714 raft_consensus.cc:385] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.936105 22714 raft_consensus.cc:740] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.931249 22713 raft_consensus.cc:359] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.937366 22713 raft_consensus.cc:385] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.937637 22713 raft_consensus.cc:740] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.938410 22713 consensus_queue.cc:260] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.940837 22713 ts_tablet_manager.cc:1434] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:26:53.941368 22714 consensus_queue.cc:260] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.942826 22713 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:53.944795 22712 tablet_bootstrap.cc:654] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.948824 22713 tablet_bootstrap.cc:654] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.953624 22711 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:53.954106 22711 ts_tablet_manager.cc:1403] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 12:26:53.954047 22714 ts_tablet_manager.cc:1434] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.005s
I20260709 12:26:53.956327 22714 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:53.957222 22711 raft_consensus.cc:359] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.957504 22744 raft_consensus.cc:493] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.958102 22744 raft_consensus.cc:515] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.960106 22744 leader_election.cc:290] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:53.961279 22711 raft_consensus.cc:385] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.961639 22711 raft_consensus.cc:740] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.962044 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:53.962707 22518 raft_consensus.cc:2468] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:53.962476 22711 consensus_queue.cc:260] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:53.963793 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:53.964365 22712 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:53.964752 22735 raft_consensus.cc:493] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.964982 22712 ts_tablet_manager.cc:1403] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.007s
I20260709 12:26:53.965296 22735 raft_consensus.cc:515] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:53.967437 22735 leader_election.cc:290] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:53.968432 22712 raft_consensus.cc:359] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.969333 22712 raft_consensus.cc:385] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.969671 22712 raft_consensus.cc:740] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.970666 22712 consensus_queue.cc:260] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:53.972179 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4e6a3678b4214ab4cd68a86f36c7d" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:53.972744 22711 ts_tablet_manager.cc:1434] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:53.972793 22592 raft_consensus.cc:2468] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:53.974231 22632 leader_election.cc:304] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:53.975209 22720 raft_consensus.cc:493] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.975678 22720 raft_consensus.cc:515] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.977665 22720 leader_election.cc:290] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:53.981537 22759 raft_consensus.cc:2804] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.981930 22759 raft_consensus.cc:493] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.982259 22759 raft_consensus.cc:3060] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.983633 22711 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:53.983930 22712 ts_tablet_manager.cc:1434] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:53.985390 22517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4e6a3678b4214ab4cd68a86f36c7d" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:53.986013 22517 raft_consensus.cc:2468] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:53.987807 22559 leader_election.cc:304] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:53.988658 22744 raft_consensus.cc:2804] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.989053 22744 raft_consensus.cc:493] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.989374 22744 raft_consensus.cc:3060] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.989708 22711 tablet_bootstrap.cc:654] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.993058 22712 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:53.964421 22666 raft_consensus.cc:2468] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:53.994529 22713 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:53.995012 22713 ts_tablet_manager.cc:1403] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.024s
I20260709 12:26:53.995815 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:53.996966 22813 raft_consensus.cc:493] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.997948 22713 raft_consensus.cc:359] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:53.998525 22712 tablet_bootstrap.cc:654] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.998744 22713 raft_consensus.cc:385] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.999053 22713 raft_consensus.cc:740] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
W20260709 12:26:53.999958 22409 leader_election.cc:343] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.000835 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:53.997503 22813 raft_consensus.cc:515] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.001528 22518 raft_consensus.cc:2468] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:54.002938 22410 leader_election.cc:304] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.003021 22711 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:54.004130 22720 raft_consensus.cc:2804] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.004269 22711 ts_tablet_manager.cc:1403] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 12:26:54.004670 22735 consensus_queue.cc:1048] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.004487 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64be06c2f304bb0bc47273eb5b3443a" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.005725 22442 raft_consensus.cc:2468] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:54.007056 22711 raft_consensus.cc:359] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.007721 22711 raft_consensus.cc:385] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.007972 22711 raft_consensus.cc:740] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.008580 22711 consensus_queue.cc:260] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.010524 22631 leader_election.cc:304] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:54.004522 22720 raft_consensus.cc:493] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.018432 22744 raft_consensus.cc:515] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.015898 22711 ts_tablet_manager.cc:1434] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:54.022727 22776 consensus_queue.cc:1048] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.023162 22711 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:54.017397 22759 raft_consensus.cc:515] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.027374 22517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4e6a3678b4214ab4cd68a86f36c7d" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:54.027957 22517 raft_consensus.cc:3060] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.028326 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:54.016819 22720 raft_consensus.cc:3060] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.035858 22711 tablet_bootstrap.cc:654] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.036310 22735 raft_consensus.cc:2804] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.036818 22518 raft_consensus.cc:3060] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.037617 22517 raft_consensus.cc:2468] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:54.038973 22633 leader_election.cc:304] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:54.037631 22735 raft_consensus.cc:493] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.040027 22735 raft_consensus.cc:3060] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.045399 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b4e6a3678b4214ab4cd68a86f36c7d" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:54.046147 22592 raft_consensus.cc:3060] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.055920 22759 leader_election.cc:290] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.057364 22759 raft_consensus.cc:2804] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.024914 22714 tablet_bootstrap.cc:654] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.999689 22713 consensus_queue.cc:260] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.062831 22768 raft_consensus.cc:493] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.063683 22768 raft_consensus.cc:515] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.073109 22713 ts_tablet_manager.cc:1434] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 12:26:54.073797 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.070087 22768 leader_election.cc:290] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.057925 22759 raft_consensus.cc:697] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:54.061213 22744 leader_election.cc:290] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:54.089171 22517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:54.090014 22517 raft_consensus.cc:2468] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:54.092175 22559 leader_election.cc:304] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:54.099642 22768 raft_consensus.cc:2804] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.100154 22768 raft_consensus.cc:493] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.102922 22713 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:54.084579 22813 leader_election.cc:290] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.101824 22768 raft_consensus.cc:3060] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.111223 22735 raft_consensus.cc:515] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.114199 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64be06c2f304bb0bc47273eb5b3443a" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.114763 22441 raft_consensus.cc:3060] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:54.104848 22633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 65971.3us
I20260709 12:26:54.126612 22759 consensus_queue.cc:237] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.133808 22768 raft_consensus.cc:515] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.134986 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:54.135605 22666 raft_consensus.cc:3060] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.135839 22768 leader_election.cc:290] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.136390 22768 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.136538 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.144064 22517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:54.144143 22441 raft_consensus.cc:2468] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:54.145398 22711 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:54.145813 22711 ts_tablet_manager.cc:1403] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.024s
I20260709 12:26:54.136847 22768 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.144744 22517 raft_consensus.cc:3060] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.129330 22592 raft_consensus.cc:2468] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:54.153194 22631 leader_election.cc:304] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:54.154479 22768 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.154778 22712 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:54.154536 22593 raft_consensus.cc:3060] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.165234 22720 raft_consensus.cc:515] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.167218 22666 raft_consensus.cc:2468] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:54.155457 22712 ts_tablet_manager.cc:1403] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.163s	user 0.053s	sys 0.068s
I20260709 12:26:54.139987 22735 leader_election.cc:290] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.170043 22559 leader_election.cc:304] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:54.152866 22816 consensus_queue.cc:1048] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:54.171123 22768 raft_consensus.cc:2804] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.171788 22768 raft_consensus.cc:697] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:54.171903 22517 raft_consensus.cc:2468] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:54.154870 22813 raft_consensus.cc:2804] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.156930 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64be06c2f304bb0bc47273eb5b3443a" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:54.173818 22559 leader_election.cc:304] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:26:54.157449 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.174599 22442 raft_consensus.cc:2468] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:54.175412 22813 raft_consensus.cc:697] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:54.175253 22712 raft_consensus.cc:359] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.175937 22712 raft_consensus.cc:385] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.176205 22712 raft_consensus.cc:740] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.176285 22813 consensus_queue.cc:237] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.163143 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64be06c2f304bb0bc47273eb5b3443a" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:54.168589 22443 raft_consensus.cc:2393] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b662aaf197d344acbc951b9da5cebf2b in current term 1: Already voted for candidate 7b50b6c210724c66b6ee01c04ab9676d in this term.
I20260709 12:26:54.168826 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:54.169126 22783 raft_consensus.cc:493] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.178727 22515 raft_consensus.cc:2393] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b50b6c210724c66b6ee01c04ab9676d in current term 1: Already voted for candidate b662aaf197d344acbc951b9da5cebf2b in this term.
I20260709 12:26:54.178612 22783 raft_consensus.cc:515] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.179603 22518 raft_consensus.cc:2468] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:54.180734 22783 leader_election.cc:290] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.176621 22557 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:54.186435 22824 consensus_queue.cc:1048] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.187459 22721 raft_consensus.cc:2804] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.163873 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.181403 22713 tablet_bootstrap.cc:654] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.176892 22712 consensus_queue.cc:260] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.162065 22714 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:54.173959 22519 raft_consensus.cc:2468] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:54.189028 22714 ts_tablet_manager.cc:1403] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.233s	user 0.016s	sys 0.005s
I20260709 12:26:54.191248 22712 ts_tablet_manager.cc:1434] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:26:54.205982 22712 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:54.190652 22744 raft_consensus.cc:2804] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.209158 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:54.210219 22744 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.210067 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:54.218420 22711 raft_consensus.cc:359] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.210510 22721 raft_consensus.cc:697] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:54.225881 22711 raft_consensus.cc:385] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.221417 22714 raft_consensus.cc:359] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.229897 22714 raft_consensus.cc:385] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.230324 22714 raft_consensus.cc:740] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.231525 22714 consensus_queue.cc:260] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.233659 22714 ts_tablet_manager.cc:1434] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.002s
I20260709 12:26:54.234401 22714 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:54.173096 22768 consensus_queue.cc:237] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.231599 22342 catalog_manager.cc:5697] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.234655 22711 raft_consensus.cc:740] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.212868 22720 leader_election.cc:290] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.237006 22711 consensus_queue.cc:260] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.238257 22786 raft_consensus.cc:493] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.225476 22744 raft_consensus.cc:3060] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.234961 22518 raft_consensus.cc:2468] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:54.228807 22721 consensus_queue.cc:237] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.245683 22711 ts_tablet_manager.cc:1434] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 12:26:54.247984 22711 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:54.242293 22786 raft_consensus.cc:515] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.255017 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ad0895a1da4871ab543142576039f5" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.256359 22714 tablet_bootstrap.cc:654] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.256831 22786 leader_election.cc:290] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
W20260709 12:26:54.258206 22485 leader_election.cc:343] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:54.246742 22559 leader_election.cc:343] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.262177 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ad0895a1da4871ab543142576039f5" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.263001 22443 raft_consensus.cc:2468] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:54.263279 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:54.265219 22483 leader_election.cc:304] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
W20260709 12:26:54.267886 22409 leader_election.cc:343] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.267220 22720 raft_consensus.cc:493] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.272445 22720 raft_consensus.cc:515] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.271412 22409 leader_election.cc:304] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.275969 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ad0895a1da4871ab543142576039f5" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.277266 22825 raft_consensus.cc:2749] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:54.277302 22410 leader_election.cc:343] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.276895 22786 raft_consensus.cc:2804] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.284093 22821 consensus_queue.cc:1048] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:26:54.286598 22410 leader_election.cc:304] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.287357 22825 raft_consensus.cc:2804] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.287708 22825 raft_consensus.cc:493] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.288036 22825 raft_consensus.cc:3060] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.289609 22711 tablet_bootstrap.cc:654] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.284545 22786 raft_consensus.cc:493] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.304006 22786 raft_consensus.cc:3060] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.304708 22813 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.298619 22821 consensus_queue.cc:1048] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:26:54.322077 22714 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:54.322585 22714 ts_tablet_manager.cc:1403] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.014s
I20260709 12:26:54.322232 22813 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.324515 22813 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.310292 22720 leader_election.cc:290] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.311685 22713 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:54.325727 22713 ts_tablet_manager.cc:1403] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.223s	user 0.023s	sys 0.021s
I20260709 12:26:54.326814 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:54.327270 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.312181 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ad0895a1da4871ab543142576039f5" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:54.313438 22712 tablet_bootstrap.cc:654] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.328006 22442 raft_consensus.cc:2468] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:54.329699 22631 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:54.313834 22759 consensus_queue.cc:1048] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:54.337517 22713 raft_consensus.cc:359] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.338188 22713 raft_consensus.cc:385] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.338438 22713 raft_consensus.cc:740] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.339082 22713 consensus_queue.cc:260] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.342029 22825 raft_consensus.cc:515] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.344148 22825 leader_election.cc:290] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.333509 22816 raft_consensus.cc:2804] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.345309 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:54.346164 22515 raft_consensus.cc:3060] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.348932 22713 ts_tablet_manager.cc:1434] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:26:54.350037 22713 tablet_bootstrap.cc:492] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:54.350382 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:54.345311 22816 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.351605 22816 raft_consensus.cc:3060] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:54.351738 22409 leader_election.cc:343] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.354242 22711 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:54.357365 22711 ts_tablet_manager.cc:1403] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.004s
I20260709 12:26:54.358080 22342 catalog_manager.cc:5697] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.360782 22714 raft_consensus.cc:359] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
W20260709 12:26:54.364796 22826 log.cc:927] Time spent T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:26:54.362233 22714 raft_consensus.cc:385] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.366348 22714 raft_consensus.cc:740] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.369725 22714 consensus_queue.cc:260] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.369093 22341 catalog_manager.cc:5697] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.378150 22714 ts_tablet_manager.cc:1434] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:26:54.379069 22714 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:54.380152 22711 raft_consensus.cc:359] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.380828 22711 raft_consensus.cc:385] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.381106 22711 raft_consensus.cc:740] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
W20260709 12:26:54.389190 22833 log.cc:927] Time spent T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:26:54.398754 22442 raft_consensus.cc:3060] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.401742 22786 raft_consensus.cc:515] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.398649 22515 raft_consensus.cc:2468] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 1.
I20260709 12:26:54.403644 22518 raft_consensus.cc:2393] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b50b6c210724c66b6ee01c04ab9676d in current term 1: Already voted for candidate b3766de80037442fbcfbef7158ad1868 in this term.
I20260709 12:26:54.405788 22410 leader_election.cc:304] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:54.407095 22825 raft_consensus.cc:3060] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.407754 22720 raft_consensus.cc:493] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.408280 22720 raft_consensus.cc:515] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.410298 22720 leader_election.cc:290] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:54.413269 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.413935 22825 raft_consensus.cc:2749] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.413269 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11e7fd15033436594cf4c660a36ef40" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:54.415692 22711 consensus_queue.cc:260] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.402904 22340 catalog_manager.cc:5697] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.417161 22712 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:54.419128 22712 ts_tablet_manager.cc:1403] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.227s	user 0.026s	sys 0.017s
I20260709 12:26:54.420704 22711 ts_tablet_manager.cc:1434] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 12:26:54.421980 22711 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:54.425063 22410 leader_election.cc:304] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.419006 22744 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.430608 22825 raft_consensus.cc:2804] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.419282 22409 leader_election.cc:304] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.433761 22720 raft_consensus.cc:2749] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.434245 22816 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.436218 22825 raft_consensus.cc:697] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:26:54.436714 22786 leader_election.cc:290] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.436815 22759 consensus_queue.cc:1048] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.437381 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:54.437142 22825 consensus_queue.cc:237] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.439090 22712 raft_consensus.cc:359] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.439327 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ad0895a1da4871ab543142576039f5" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:54.439787 22712 raft_consensus.cc:385] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.440107 22712 raft_consensus.cc:740] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.440148 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ad0895a1da4871ab543142576039f5" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.440181 22667 raft_consensus.cc:3060] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.441725 22592 raft_consensus.cc:2393] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1704a791486d41aca21c226c48b00d89 in current term 1: Already voted for candidate b662aaf197d344acbc951b9da5cebf2b in this term.
I20260709 12:26:54.445788 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:54.446525 22666 raft_consensus.cc:2393] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b662aaf197d344acbc951b9da5cebf2b in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:26:54.449976 22443 raft_consensus.cc:2468] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:54.451306 22816 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.452247 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.452931 22441 raft_consensus.cc:3060] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.452989 22483 leader_election.cc:304] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:54.454167 22786 raft_consensus.cc:2804] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.454711 22786 raft_consensus.cc:697] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:54.455523 22786 consensus_queue.cc:237] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.456990 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.458860 22744 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.458999 22631 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.461864 22816 raft_consensus.cc:2749] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.440793 22712 consensus_queue.cc:260] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.462787 22714 tablet_bootstrap.cc:654] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.465896 22667 raft_consensus.cc:2468] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:54.468952 22712 ts_tablet_manager.cc:1434] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:26:54.472272 22712 tablet_bootstrap.cc:492] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:54.450103 22713 tablet_bootstrap.cc:654] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.479723 22713 tablet_bootstrap.cc:492] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:54.480213 22713 ts_tablet_manager.cc:1403] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.001s
I20260709 12:26:54.480697 22711 tablet_bootstrap.cc:654] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.483387 22714 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:54.483961 22714 ts_tablet_manager.cc:1403] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 12:26:54.487268 22714 raft_consensus.cc:359] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.488147 22714 raft_consensus.cc:385] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.488483 22714 raft_consensus.cc:740] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.537264 22711 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:54.538959 22711 ts_tablet_manager.cc:1403] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.005s
I20260709 12:26:54.547835 22338 catalog_manager.cc:5697] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.552161 22712 tablet_bootstrap.cc:654] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.562335 22711 raft_consensus.cc:359] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.564884 22824 raft_consensus.cc:493] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.567194 22744 raft_consensus.cc:493] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.568841 22711 raft_consensus.cc:385] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.564642 22714 consensus_queue.cc:260] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.570840 22711 raft_consensus.cc:740] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.571997 22824 raft_consensus.cc:515] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.577245 22816 consensus_queue.cc:1048] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.580546 22714 ts_tablet_manager.cc:1434] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.096s	user 0.011s	sys 0.000s
I20260709 12:26:54.582629 22714 tablet_bootstrap.cc:492] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:54.576190 22744 raft_consensus.cc:515] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.590953 22714 tablet_bootstrap.cc:654] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.587216 22824 leader_election.cc:290] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.590437 22713 raft_consensus.cc:359] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.595247 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:54.585422 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.602972 22759 consensus_queue.cc:1048] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.600793 22711 consensus_queue.cc:260] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.605490 22744 leader_election.cc:290] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.602972 22442 raft_consensus.cc:2468] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:54.599910 22713 raft_consensus.cc:385] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.607903 22713 raft_consensus.cc:740] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.608403 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.608690 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.609409 22667 raft_consensus.cc:2468] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:54.609710 22444 raft_consensus.cc:2468] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
W20260709 12:26:54.608457 22484 leader_election.cc:343] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.608736 22713 consensus_queue.cc:260] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.610852 22483 leader_election.cc:304] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.613277 22557 leader_election.cc:304] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:54.619894 22768 raft_consensus.cc:2804] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.620550 22768 raft_consensus.cc:493] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.616927 22824 raft_consensus.cc:2804] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.621078 22768 raft_consensus.cc:3060] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.621551 22824 raft_consensus.cc:493] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.622319 22824 raft_consensus.cc:3060] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.621023 22712 tablet_bootstrap.cc:492] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:54.625675 22712 ts_tablet_manager.cc:1403] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.156s	user 0.018s	sys 0.002s
I20260709 12:26:54.626113 22441 raft_consensus.cc:2468] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:54.628073 22557 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:54.629989 22721 raft_consensus.cc:2804] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.630684 22721 raft_consensus.cc:697] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:54.631524 22713 ts_tablet_manager.cc:1434] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.151s	user 0.005s	sys 0.007s
I20260709 12:26:54.632241 22721 consensus_queue.cc:237] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.636919 22711 ts_tablet_manager.cc:1434] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.097s	user 0.011s	sys 0.003s
I20260709 12:26:54.638680 22711 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:54.649751 22712 raft_consensus.cc:359] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.650841 22712 raft_consensus.cc:385] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.651196 22712 raft_consensus.cc:740] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.651994 22712 consensus_queue.cc:260] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.669442 22712 ts_tablet_manager.cc:1434] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 12:26:54.671083 22712 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:54.675927 22713 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:54.678299 22711 tablet_bootstrap.cc:654] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.667904 22768 raft_consensus.cc:515] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.685884 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.686681 22444 raft_consensus.cc:3060] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.686547 22824 raft_consensus.cc:515] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.688544 22713 tablet_bootstrap.cc:654] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.688694 22824 leader_election.cc:290] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.685992 22768 leader_election.cc:290] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:54.694028 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
W20260709 12:26:54.697350 22484 leader_election.cc:343] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.699987 22825 raft_consensus.cc:493] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.700516 22825 raft_consensus.cc:515] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.704821 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:54.705585 22667 raft_consensus.cc:3060] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.706007 22759 consensus_queue.cc:1048] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.707250 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff440e4e2d764ef1ae95785dc37916bd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.709192 22712 tablet_bootstrap.cc:654] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:54.709914 22410 leader_election.cc:343] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.719213 22721 consensus_queue.cc:1048] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.720711 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:54.721520 22443 raft_consensus.cc:3060] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.723703 22518 raft_consensus.cc:3060] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.726361 22444 raft_consensus.cc:2468] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:54.729532 22557 leader_election.cc:304] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:54.730945 22768 raft_consensus.cc:2804] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.731649 22768 raft_consensus.cc:697] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:54.719762 22825 leader_election.cc:290] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.733124 22768 consensus_queue.cc:237] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.734469 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff440e4e2d764ef1ae95785dc37916bd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:54.735879 22714 tablet_bootstrap.cc:492] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
W20260709 12:26:54.736285 22410 leader_election.cc:343] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.736505 22714 ts_tablet_manager.cc:1403] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.022s
I20260709 12:26:54.736830 22410 leader_election.cc:304] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:54.738160 22825 raft_consensus.cc:2749] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.739948 22714 raft_consensus.cc:359] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.740814 22714 raft_consensus.cc:385] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.741195 22714 raft_consensus.cc:740] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.717708 22667 raft_consensus.cc:2468] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
W20260709 12:26:54.746060 22852 log.cc:927] Time spent T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:26:54.749735 22714 consensus_queue.cc:260] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.766256 22714 ts_tablet_manager.cc:1434] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:26:54.779003 22721 consensus_queue.cc:1048] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:54.761114 22712 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:54.772032 22711 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:54.783675 22712 ts_tablet_manager.cc:1403] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.005s
I20260709 12:26:54.783830 22711 ts_tablet_manager.cc:1403] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.020s
I20260709 12:26:54.786803 22711 raft_consensus.cc:359] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.787469 22711 raft_consensus.cc:385] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.787758 22711 raft_consensus.cc:740] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.756196 22443 raft_consensus.cc:2468] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:54.788641 22711 consensus_queue.cc:260] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.790143 22483 leader_election.cc:304] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.790952 22711 ts_tablet_manager.cc:1434] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:54.791512 22824 raft_consensus.cc:2804] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.791824 22714 tablet_bootstrap.cc:492] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:54.792075 22824 raft_consensus.cc:697] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:54.793007 22824 consensus_queue.cc:237] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.756683 22818 consensus_queue.cc:1048] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
W20260709 12:26:54.809718 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:54.803161 22712 raft_consensus.cc:359] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.803319 22340 catalog_manager.cc:5697] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 1 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.816776 22713 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:54.817507 22713 ts_tablet_manager.cc:1403] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.164s	user 0.010s	sys 0.007s
I20260709 12:26:54.818121 22712 raft_consensus.cc:385] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.825731 22712 raft_consensus.cc:740] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.826023 22338 catalog_manager.cc:5697] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.827455 22712 consensus_queue.cc:260] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:54.830569 22714 tablet_bootstrap.cc:654] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.833755 22824 raft_consensus.cc:493] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.834153 22824 raft_consensus.cc:515] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.836768 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0804e286664773b5ec173401e74bfc" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:54.837421 22592 raft_consensus.cc:2468] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:54.820420 22711 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:54.821615 22713 raft_consensus.cc:359] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.839515 22713 raft_consensus.cc:385] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.840258 22713 raft_consensus.cc:740] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.841336 22713 consensus_queue.cc:260] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.842272 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0804e286664773b5ec173401e74bfc" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:54.842936 22665 raft_consensus.cc:2468] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:54.843732 22713 ts_tablet_manager.cc:1434] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:26:54.844561 22485 leader_election.cc:304] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:54.845029 22824 leader_election.cc:290] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:54.851183 22713 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:54.851228 22824 raft_consensus.cc:2804] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.851792 22824 raft_consensus.cc:493] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.852154 22824 raft_consensus.cc:3060] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.853111 22821 consensus_queue.cc:1048] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.856607 22711 tablet_bootstrap.cc:654] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.859315 22713 tablet_bootstrap.cc:654] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.861523 22786 consensus_queue.cc:1048] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.846784 22712 ts_tablet_manager.cc:1434] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 12:26:54.868592 22712 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:54.870407 22342 catalog_manager.cc:5697] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.872500 22861 consensus_queue.cc:1048] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.876225 22824 raft_consensus.cc:515] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.873409 22711 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:54.886606 22711 ts_tablet_manager.cc:1403] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.000s
I20260709 12:26:54.886663 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0804e286664773b5ec173401e74bfc" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:54.887487 22592 raft_consensus.cc:3060] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.889828 22711 raft_consensus.cc:359] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.890566 22711 raft_consensus.cc:385] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.890836 22711 raft_consensus.cc:740] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.848953 22714 tablet_bootstrap.cc:492] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:54.893509 22714 ts_tablet_manager.cc:1403] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.002s
I20260709 12:26:54.895598 22711 consensus_queue.cc:260] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.897272 22821 consensus_queue.cc:1048] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:54.870616 22713 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:54.900203 22713 ts_tablet_manager.cc:1403] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.009s
I20260709 12:26:54.897956 22711 ts_tablet_manager.cc:1434] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:54.881289 22338 catalog_manager.cc:5697] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.901834 22711 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:54.902522 22824 leader_election.cc:290] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:54.906898 22593 raft_consensus.cc:3060] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.906777 22713 raft_consensus.cc:359] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.907526 22713 raft_consensus.cc:385] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.907794 22713 raft_consensus.cc:740] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.908324 22711 tablet_bootstrap.cc:654] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.909449 22713 consensus_queue.cc:260] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.911842 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0804e286664773b5ec173401e74bfc" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:54.912444 22667 raft_consensus.cc:3060] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.912784 22713 ts_tablet_manager.cc:1434] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:26:54.914206 22713 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:54.922936 22713 tablet_bootstrap.cc:654] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.903853 22592 raft_consensus.cc:2468] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:54.904093 22712 tablet_bootstrap.cc:654] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.943979 22484 leader_election.cc:304] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:54.944912 22786 raft_consensus.cc:2804] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.945467 22786 raft_consensus.cc:697] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:54.946383 22786 consensus_queue.cc:237] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.947089 22825 consensus_queue.cc:1048] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.896222 22714 raft_consensus.cc:359] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.949298 22714 raft_consensus.cc:385] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.949666 22714 raft_consensus.cc:740] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.950641 22714 consensus_queue.cc:260] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.955219 22713 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:54.955729 22713 ts_tablet_manager.cc:1403] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.016s
I20260709 12:26:54.955904 22854 raft_consensus.cc:493] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.956502 22854 raft_consensus.cc:515] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:54.958458 22713 raft_consensus.cc:359] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.959178 22713 raft_consensus.cc:385] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.959431 22713 raft_consensus.cc:740] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.959957 22854 leader_election.cc:290] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:54.961336 22821 raft_consensus.cc:493] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.961840 22821 raft_consensus.cc:515] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:54.962045 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:54.964625 22632 leader_election.cc:343] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.965978 22713 consensus_queue.cc:260] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:54.966477 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:54.967347 22667 raft_consensus.cc:2468] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:54.969267 22821 leader_election.cc:290] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:54.969641 22714 ts_tablet_manager.cc:1434] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.002s
W20260709 12:26:54.970851 22633 leader_election.cc:343] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.971335 22633 leader_election.cc:304] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:54.972551 22818 raft_consensus.cc:2749] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.971839 22713 ts_tablet_manager.cc:1434] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:26:54.974599 22713 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:54.975764 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:54.980561 22713 tablet_bootstrap.cc:654] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.985788 22714 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:54.996353 22714 tablet_bootstrap.cc:654] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.000885 22825 consensus_queue.cc:1048] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.010370 22712 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.011045 22712 ts_tablet_manager.cc:1403] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.019s
I20260709 12:26:55.016835 22711 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.017396 22711 ts_tablet_manager.cc:1403] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.029s
I20260709 12:26:55.018251 22712 raft_consensus.cc:359] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.018932 22712 raft_consensus.cc:385] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.019171 22712 raft_consensus.cc:740] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.014839 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.019788 22711 raft_consensus.cc:359] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.020520 22711 raft_consensus.cc:385] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.019824 22712 consensus_queue.cc:260] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.020782 22711 raft_consensus.cc:740] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.024117 22712 ts_tablet_manager.cc:1434] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:26:55.024801 22713 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.025159 22712 tablet_bootstrap.cc:492] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.025296 22713 ts_tablet_manager.cc:1403] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.005s
I20260709 12:26:55.027467 22559 leader_election.cc:304] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:55.027984 22713 raft_consensus.cc:359] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.028638 22713 raft_consensus.cc:385] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.028890 22713 raft_consensus.cc:740] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.029845 22713 consensus_queue.cc:260] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.032337 22713 ts_tablet_manager.cc:1434] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:55.035920 22825 raft_consensus.cc:493] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.036590 22713 tablet_bootstrap.cc:492] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.036463 22825 raft_consensus.cc:515] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.037719 22712 tablet_bootstrap.cc:654] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.038666 22825 leader_election.cc:290] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.039568 22744 raft_consensus.cc:2749] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.040411 22711 consensus_queue.cc:260] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.042742 22711 ts_tablet_manager.cc:1434] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:26:55.039778 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.043733 22711 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
W20260709 12:26:55.044421 22410 leader_election.cc:343] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.044159 22338 catalog_manager.cc:5697] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.045723 22713 tablet_bootstrap.cc:654] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.054286 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.054912 22592 raft_consensus.cc:2468] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:55.059813 22711 tablet_bootstrap.cc:654] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.061903 22409 leader_election.cc:304] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:55.083201 22714 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:55.083811 22714 ts_tablet_manager.cc:1403] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.032s
I20260709 12:26:55.087028 22714 raft_consensus.cc:359] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.087852 22714 raft_consensus.cc:385] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.088172 22714 raft_consensus.cc:740] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.089218 22714 consensus_queue.cc:260] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.099706 22714 ts_tablet_manager.cc:1434] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:26:55.101862 22882 raft_consensus.cc:2804] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.106069 22714 tablet_bootstrap.cc:492] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
W20260709 12:26:55.104749 22410 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 47938.8us
I20260709 12:26:55.109473 22712 tablet_bootstrap.cc:492] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.104686 22882 raft_consensus.cc:493] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.110100 22712 ts_tablet_manager.cc:1403] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.017s
I20260709 12:26:55.110580 22882 raft_consensus.cc:3060] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.112298 22711 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.112756 22711 ts_tablet_manager.cc:1403] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.004s
I20260709 12:26:55.113821 22712 raft_consensus.cc:359] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.114691 22712 raft_consensus.cc:385] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.115046 22712 raft_consensus.cc:740] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.116356 22713 tablet_bootstrap.cc:492] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.115959 22712 consensus_queue.cc:260] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.116832 22713 ts_tablet_manager.cc:1403] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.025s
I20260709 12:26:55.116981 22714 tablet_bootstrap.cc:654] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.119287 22712 ts_tablet_manager.cc:1434] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:55.119702 22713 raft_consensus.cc:359] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.120420 22712 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.120667 22713 raft_consensus.cc:385] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.115289 22711 raft_consensus.cc:359] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.125121 22711 raft_consensus.cc:385] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.125428 22711 raft_consensus.cc:740] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.126178 22711 consensus_queue.cc:260] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.121100 22713 raft_consensus.cc:740] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.127017 22712 tablet_bootstrap.cc:654] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.127669 22713 consensus_queue.cc:260] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.129839 22711 ts_tablet_manager.cc:1434] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:26:55.136179 22882 raft_consensus.cc:515] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.140750 22713 ts_tablet_manager.cc:1434] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:26:55.147327 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
W20260709 12:26:55.149077 22410 leader_election.cc:343] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.149860 22711 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.157569 22711 tablet_bootstrap.cc:654] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.158558 22768 raft_consensus.cc:493] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.158150 22821 consensus_queue.cc:1048] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.159138 22768 raft_consensus.cc:515] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.160466 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:55.158447 22882 leader_election.cc:290] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.161322 22768 leader_election.cc:290] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.163216 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.163794 22667 raft_consensus.cc:2468] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:55.164532 22713 tablet_bootstrap.cc:492] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.164835 22559 leader_election.cc:304] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.165696 22821 raft_consensus.cc:2804] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.166217 22821 raft_consensus.cc:493] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.166631 22821 raft_consensus.cc:3060] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.169384 22593 raft_consensus.cc:3060] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.173918 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.174538 22515 raft_consensus.cc:2468] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:55.175596 22593 raft_consensus.cc:2468] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 1.
I20260709 12:26:55.177160 22409 leader_election.cc:304] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:55.178069 22885 raft_consensus.cc:2804] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.178634 22885 raft_consensus.cc:697] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:26:55.179252 22720 raft_consensus.cc:493] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.179721 22720 raft_consensus.cc:515] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.179715 22885 consensus_queue.cc:237] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.181829 22720 leader_election.cc:290] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.183913 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:55.185400 22410 leader_election.cc:343] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.188396 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
W20260709 12:26:55.190583 22410 leader_election.cc:343] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.191054 22410 leader_election.cc:304] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:55.191829 22816 raft_consensus.cc:493] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.192322 22816 raft_consensus.cc:515] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.180711 22714 tablet_bootstrap.cc:492] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:55.194119 22714 ts_tablet_manager.cc:1403] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.013s
I20260709 12:26:55.194633 22816 leader_election.cc:290] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.196823 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff440e4e2d764ef1ae95785dc37916bd" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:55.197567 22441 raft_consensus.cc:2468] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:55.197811 22713 tablet_bootstrap.cc:654] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.198935 22882 raft_consensus.cc:2749] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.200278 22631 leader_election.cc:304] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:55.203836 22816 raft_consensus.cc:2804] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.204268 22816 raft_consensus.cc:493] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.203933 22821 raft_consensus.cc:515] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.204751 22714 raft_consensus.cc:359] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.216754 22714 raft_consensus.cc:385] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.217094 22714 raft_consensus.cc:740] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.217913 22711 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.217800 22714 consensus_queue.cc:260] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.218382 22711 ts_tablet_manager.cc:1403] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.030s
I20260709 12:26:55.220039 22714 ts_tablet_manager.cc:1434] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:26:55.204721 22816 raft_consensus.cc:3060] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.221165 22711 raft_consensus.cc:359] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.221879 22711 raft_consensus.cc:385] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.221954 22821 leader_election.cc:290] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.222168 22711 raft_consensus.cc:740] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.222924 22711 consensus_queue.cc:260] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.206924 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff440e4e2d764ef1ae95785dc37916bd" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.223817 22714 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:55.224232 22515 raft_consensus.cc:2468] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:55.224989 22711 ts_tablet_manager.cc:1434] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:55.207638 22768 consensus_queue.cc:1048] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:55.207607 22824 consensus_queue.cc:1048] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:55.226122 22885 raft_consensus.cc:493] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.222590 22821 consensus_queue.cc:1048] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:26:55.226616 22885 raft_consensus.cc:515] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.230402 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.231017 22519 raft_consensus.cc:2468] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:55.231858 22714 tablet_bootstrap.cc:654] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.232676 22410 leader_election.cc:304] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:55.233750 22882 raft_consensus.cc:2804] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.234109 22882 raft_consensus.cc:493] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.234555 22882 raft_consensus.cc:3060] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.237079 22885 leader_election.cc:290] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:55.239164 22711 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.244854 22713 tablet_bootstrap.cc:492] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.245333 22713 ts_tablet_manager.cc:1403] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 12:26:55.247916 22713 raft_consensus.cc:359] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.248551 22713 raft_consensus.cc:385] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.248814 22713 raft_consensus.cc:740] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.248963 22768 raft_consensus.cc:493] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.249512 22713 consensus_queue.cc:260] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.207773 22712 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.250988 22768 raft_consensus.cc:515] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.251920 22713 ts_tablet_manager.cc:1434] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:55.254535 22713 tablet_bootstrap.cc:492] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.252177 22712 ts_tablet_manager.cc:1403] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.004s
I20260709 12:26:55.266463 22712 raft_consensus.cc:359] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.267102 22712 raft_consensus.cc:385] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.267367 22712 raft_consensus.cc:740] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.268007 22712 consensus_queue.cc:260] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.275230 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:55.279315 22712 ts_tablet_manager.cc:1434] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:26:55.280728 22712 tablet_bootstrap.cc:492] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.285462 22768 leader_election.cc:290] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.287021 22712 tablet_bootstrap.cc:654] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.288789 22713 tablet_bootstrap.cc:654] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.288965 22338 catalog_manager.cc:5697] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 1 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:55.296250 22559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 77059.8us
I20260709 12:26:55.298735 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:55.303790 22519 raft_consensus.cc:3060] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.303988 22711 tablet_bootstrap.cc:654] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.317323 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:55.312213 22882 raft_consensus.cc:515] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.317950 22667 raft_consensus.cc:3060] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.319465 22882 leader_election.cc:290] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:55.316803 22816 raft_consensus.cc:515] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.324769 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:55.326922 22816 leader_election.cc:290] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.327277 22515 raft_consensus.cc:3060] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.328047 22519 raft_consensus.cc:2468] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.330636 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.332896 22593 raft_consensus.cc:3060] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.334438 22559 leader_election.cc:304] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.334928 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:55.335721 22590 raft_consensus.cc:3060] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.334483 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.344090 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff440e4e2d764ef1ae95785dc37916bd" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:55.344684 22441 raft_consensus.cc:3060] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.349426 22714 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:55.349933 22714 ts_tablet_manager.cc:1403] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.127s	user 0.040s	sys 0.030s
I20260709 12:26:55.350227 22768 raft_consensus.cc:2804] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.350785 22768 raft_consensus.cc:697] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:55.351615 22768 consensus_queue.cc:237] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.352802 22714 raft_consensus.cc:359] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.353509 22714 raft_consensus.cc:385] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.353756 22714 raft_consensus.cc:740] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.357153 22714 consensus_queue.cc:260] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.360620 22559 leader_election.cc:304] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:55.362169 22714 ts_tablet_manager.cc:1434] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:55.367632 22712 tablet_bootstrap.cc:492] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.368114 22712 ts_tablet_manager.cc:1403] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.010s
I20260709 12:26:55.368238 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff440e4e2d764ef1ae95785dc37916bd" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:55.370760 22519 raft_consensus.cc:3060] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.374378 22821 raft_consensus.cc:2749] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.376325 22667 raft_consensus.cc:2468] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.379106 22714 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:55.380443 22712 raft_consensus.cc:359] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.381193 22712 raft_consensus.cc:385] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.381458 22712 raft_consensus.cc:740] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.382120 22712 consensus_queue.cc:260] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.384508 22713 tablet_bootstrap.cc:492] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.386514 22590 raft_consensus.cc:2468] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 1.
I20260709 12:26:55.388166 22515 raft_consensus.cc:2468] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 1.
I20260709 12:26:55.389151 22712 ts_tablet_manager.cc:1434] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:26:55.403007 22712 tablet_bootstrap.cc:492] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.402894 22410 leader_election.cc:304] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:55.403855 22882 raft_consensus.cc:2804] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.404349 22882 raft_consensus.cc:697] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:26:55.405205 22882 consensus_queue.cc:237] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.393285 22768 consensus_queue.cc:1048] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:55.397090 22786 consensus_queue.cc:1048] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.410778 22519 raft_consensus.cc:2468] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:55.413683 22633 leader_election.cc:304] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:55.414691 22896 raft_consensus.cc:2804] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.415233 22896 raft_consensus.cc:697] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:55.400943 22338 catalog_manager.cc:5697] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.416431 22896 consensus_queue.cc:237] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.376049 22441 raft_consensus.cc:2468] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:55.398578 22713 ts_tablet_manager.cc:1403] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.011s
I20260709 12:26:55.420532 22711 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.421020 22711 ts_tablet_manager.cc:1403] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.182s	user 0.040s	sys 0.008s
I20260709 12:26:55.422762 22713 raft_consensus.cc:359] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.423650 22713 raft_consensus.cc:385] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.424012 22713 raft_consensus.cc:740] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.423878 22711 raft_consensus.cc:359] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.424767 22711 raft_consensus.cc:385] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.430078 22711 raft_consensus.cc:740] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.424919 22713 consensus_queue.cc:260] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.415516 22712 tablet_bootstrap.cc:654] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.433104 22713 ts_tablet_manager.cc:1434] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:26:55.434175 22713 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.437311 22711 consensus_queue.cc:260] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.439770 22711 ts_tablet_manager.cc:1434] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 12:26:55.441167 22711 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.443733 22712 tablet_bootstrap.cc:492] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.444218 22712 ts_tablet_manager.cc:1403] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.004s
I20260709 12:26:55.452106 22338 catalog_manager.cc:5697] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 1 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.453166 22885 raft_consensus.cc:493] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.453661 22885 raft_consensus.cc:515] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.455742 22885 leader_election.cc:290] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.456169 22885 raft_consensus.cc:493] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.456692 22711 tablet_bootstrap.cc:654] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.458523 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.453189 22713 tablet_bootstrap.cc:654] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.461671 22714 tablet_bootstrap.cc:654] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.456578 22885 raft_consensus.cc:515] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:26:55.466995 22409 leader_election.cc:343] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.469111 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.469444 22711 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.469771 22665 raft_consensus.cc:2468] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:55.469964 22711 ts_tablet_manager.cc:1403] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 12:26:55.469214 22340 catalog_manager.cc:5697] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.471122 22410 leader_election.cc:304] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:55.474148 22711 raft_consensus.cc:359] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.474804 22711 raft_consensus.cc:385] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.475077 22711 raft_consensus.cc:740] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.475793 22824 consensus_queue.cc:1048] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.475750 22711 consensus_queue.cc:260] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.476783 22825 raft_consensus.cc:2804] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.477205 22825 raft_consensus.cc:493] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.477526 22825 raft_consensus.cc:3060] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.476485 22885 leader_election.cc:290] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.488730 22713 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.489398 22713 ts_tablet_manager.cc:1403] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.009s
I20260709 12:26:55.489930 22825 raft_consensus.cc:515] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.492235 22713 raft_consensus.cc:359] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.492933 22825 leader_election.cc:290] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.490778 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.489447 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.492923 22713 raft_consensus.cc:385] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.484294 22711 ts_tablet_manager.cc:1434] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:26:55.483517 22712 raft_consensus.cc:359] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.494556 22712 raft_consensus.cc:385] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.494827 22712 raft_consensus.cc:740] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.493755 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
W20260709 12:26:55.495829 22410 leader_election.cc:343] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.494273 22713 raft_consensus.cc:740] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.496304 22410 leader_election.cc:304] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:55.496737 22712 consensus_queue.cc:260] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.497138 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:55.497633 22825 raft_consensus.cc:2749] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.498837 22712 ts_tablet_manager.cc:1434] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 12:26:55.499181 22711 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.498732 22713 consensus_queue.cc:260] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.500059 22590 raft_consensus.cc:2468] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:55.500789 22768 raft_consensus.cc:493] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.501317 22768 raft_consensus.cc:515] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.503374 22768 leader_election.cc:290] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.504568 22667 raft_consensus.cc:3060] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.505779 22825 raft_consensus.cc:493] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.506306 22825 raft_consensus.cc:515] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.501077 22713 ts_tablet_manager.cc:1434] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:26:55.511300 22713 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.511651 22664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.512274 22664 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:55.509891 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.514176 22559 leader_election.cc:304] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
W20260709 12:26:55.515336 22410 leader_election.cc:343] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.509940 22825 leader_election.cc:290] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.517551 22711 tablet_bootstrap.cc:654] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.518766 22768 raft_consensus.cc:2804] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.519171 22768 raft_consensus.cc:493] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.519510 22768 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.519702 22713 tablet_bootstrap.cc:654] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.530046 22711 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.529822 22861 consensus_queue.cc:1048] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.530543 22711 ts_tablet_manager.cc:1403] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:26:55.532231 22713 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.532681 22713 ts_tablet_manager.cc:1403] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 12:26:55.533336 22711 raft_consensus.cc:359] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.534019 22711 raft_consensus.cc:385] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.534289 22711 raft_consensus.cc:740] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.535126 22711 consensus_queue.cc:260] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.537541 22711 ts_tablet_manager.cc:1434] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:55.538033 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.538688 22519 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:55.539531 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.540863 22712 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
W20260709 12:26:55.540915 22410 leader_election.cc:343] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.545882 22410 leader_election.cc:304] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:55.546482 22714 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:55.546736 22667 raft_consensus.cc:2468] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 1.
I20260709 12:26:55.528435 22768 raft_consensus.cc:515] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.547166 22825 raft_consensus.cc:2749] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.547592 22714 ts_tablet_manager.cc:1403] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.000s
I20260709 12:26:55.550419 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:55.551013 22515 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.541082 22713 raft_consensus.cc:359] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.552407 22713 raft_consensus.cc:385] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.552680 22713 raft_consensus.cc:740] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.547880 22410 leader_election.cc:304] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:55.553596 22825 raft_consensus.cc:2804] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.553350 22713 consensus_queue.cc:260] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.554126 22825 raft_consensus.cc:697] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:26:55.554677 22714 raft_consensus.cc:359] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.555007 22825 consensus_queue.cc:237] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.556967 22714 raft_consensus.cc:385] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.557192 22711 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.557364 22714 raft_consensus.cc:740] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.558235 22714 consensus_queue.cc:260] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.549381 22768 leader_election.cc:290] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.556595 22712 tablet_bootstrap.cc:654] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.559290 22515 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.555913 22713 ts_tablet_manager.cc:1434] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:26:55.560797 22713 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.561960 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:55.562572 22665 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.570523 22714 ts_tablet_manager.cc:1434] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:55.573315 22665 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.575138 22559 leader_election.cc:304] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.576822 22768 raft_consensus.cc:2804] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.577672 22768 raft_consensus.cc:697] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:55.578444 22714 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:55.578765 22768 consensus_queue.cc:237] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.590474 22711 tablet_bootstrap.cc:654] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.601919 22896 raft_consensus.cc:493] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.602471 22341 catalog_manager.cc:5697] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 1 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:55.602607 22896 raft_consensus.cc:515] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.606412 22821 raft_consensus.cc:493] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.606859 22821 raft_consensus.cc:515] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.609009 22821 leader_election.cc:290] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.611191 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8474847f8e04fd58b6b04a2bce93bee" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.611820 22515 raft_consensus.cc:2468] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:55.612195 22713 tablet_bootstrap.cc:654] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.612859 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8474847f8e04fd58b6b04a2bce93bee" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:55.614655 22559 leader_election.cc:343] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.615371 22559 leader_election.cc:304] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:55.617023 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.617897 22590 raft_consensus.cc:2393] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1704a791486d41aca21c226c48b00d89 in current term 1: Already voted for candidate 7b50b6c210724c66b6ee01c04ab9676d in this term.
I20260709 12:26:55.618623 22821 raft_consensus.cc:2804] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.619014 22821 raft_consensus.cc:493] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.619318 22821 raft_consensus.cc:3060] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.619454 22711 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.619901 22711 ts_tablet_manager.cc:1403] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.002s
I20260709 12:26:55.622640 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:55.624485 22713 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.624306 22631 leader_election.cc:304] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:55.624935 22713 ts_tablet_manager.cc:1403] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.015s
I20260709 12:26:55.625162 22854 raft_consensus.cc:3060] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.625764 22821 raft_consensus.cc:515] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.627653 22713 raft_consensus.cc:359] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.628315 22713 raft_consensus.cc:385] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.628403 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8474847f8e04fd58b6b04a2bce93bee" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:55.628639 22713 raft_consensus.cc:740] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.629072 22515 raft_consensus.cc:3060] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.622655 22711 raft_consensus.cc:359] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.629962 22711 raft_consensus.cc:385] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.629577 22896 leader_election.cc:290] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:55.630255 22711 raft_consensus.cc:740] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.630952 22711 consensus_queue.cc:260] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.634204 22711 ts_tablet_manager.cc:1434] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:26:55.632414 22338 catalog_manager.cc:5697] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.634943 22713 consensus_queue.cc:260] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.636554 22713 ts_tablet_manager.cc:1434] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 12:26:55.637566 22713 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.639386 22711 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.639837 22515 raft_consensus.cc:2468] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.643404 22559 leader_election.cc:304] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.644233 22721 raft_consensus.cc:2804] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.644714 22721 raft_consensus.cc:697] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:55.645653 22711 tablet_bootstrap.cc:654] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.645543 22721 consensus_queue.cc:237] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:55.651507 22861 raft_consensus.cc:493] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.652262 22861 raft_consensus.cc:515] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.652279 22713 tablet_bootstrap.cc:654] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.654270 22861 leader_election.cc:290] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:55.655174 22854 raft_consensus.cc:2749] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.655998 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.658493 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:55.659545 22441 raft_consensus.cc:2468] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:55.661336 22483 leader_election.cc:304] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
W20260709 12:26:55.663116 22485 leader_election.cc:343] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.664283 22861 raft_consensus.cc:2804] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.664790 22861 raft_consensus.cc:493] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.665244 22861 raft_consensus.cc:3060] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.665755 22712 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.666378 22712 ts_tablet_manager.cc:1403] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.000s
I20260709 12:26:55.670307 22712 raft_consensus.cc:359] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.671168 22712 raft_consensus.cc:385] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.671535 22712 raft_consensus.cc:740] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.672386 22712 consensus_queue.cc:260] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.673688 22714 tablet_bootstrap.cc:654] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.679517 22712 ts_tablet_manager.cc:1434] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:26:55.682469 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8474847f8e04fd58b6b04a2bce93bee" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:55.683483 22711 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.683954 22711 ts_tablet_manager.cc:1403] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.014s
W20260709 12:26:55.684325 22559 leader_election.cc:343] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.685319 22821 leader_election.cc:290] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.686676 22711 raft_consensus.cc:359] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.687348 22711 raft_consensus.cc:385] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.687613 22711 raft_consensus.cc:740] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.688174 22711 consensus_queue.cc:260] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.690227 22711 ts_tablet_manager.cc:1434] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:55.692160 22714 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:55.692622 22714 ts_tablet_manager.cc:1403] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.116s	user 0.005s	sys 0.007s
I20260709 12:26:55.695189 22712 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.697813 22711 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.701071 22340 catalog_manager.cc:5697] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.706485 22882 raft_consensus.cc:493] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.707005 22882 raft_consensus.cc:515] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.708269 22712 tablet_bootstrap.cc:654] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.709919 22825 consensus_queue.cc:1048] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.703440 22711 tablet_bootstrap.cc:654] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.717900 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed4a7e6a404436dafc8fa216c27bbb4" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:55.719347 22409 leader_election.cc:343] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.716745 22882 leader_election.cc:290] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:55.721105 22768 raft_consensus.cc:493] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.721793 22768 raft_consensus.cc:515] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.723624 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed4a7e6a404436dafc8fa216c27bbb4" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.723868 22768 leader_election.cc:290] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.725896 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b620a48e004eb98b5a6e7b1872a55b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:55.726541 22444 raft_consensus.cc:2468] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
W20260709 12:26:55.726598 22410 leader_election.cc:343] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.727190 22410 leader_election.cc:304] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:55.728685 22882 raft_consensus.cc:2749] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.728807 22557 leader_election.cc:304] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.730675 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b620a48e004eb98b5a6e7b1872a55b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:55.731452 22515 raft_consensus.cc:2468] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:55.730651 22821 raft_consensus.cc:2804] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.732379 22821 raft_consensus.cc:493] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.732757 22821 raft_consensus.cc:3060] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.733246 22714 raft_consensus.cc:359] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.734110 22714 raft_consensus.cc:385] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.734508 22714 raft_consensus.cc:740] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.735388 22714 consensus_queue.cc:260] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.738834 22714 ts_tablet_manager.cc:1434] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:26:55.741534 22712 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.742010 22712 ts_tablet_manager.cc:1403] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.011s
I20260709 12:26:55.744624 22712 raft_consensus.cc:359] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.745286 22712 raft_consensus.cc:385] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.745558 22712 raft_consensus.cc:740] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.748551 22712 consensus_queue.cc:260] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.750085 22714 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:55.755327 22712 ts_tablet_manager.cc:1434] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:55.756338 22712 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.768826 22712 tablet_bootstrap.cc:654] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.771486 22861 raft_consensus.cc:515] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.777396 22885 consensus_queue.cc:1048] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.777833 22861 leader_election.cc:290] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:55.778891 22711 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.779384 22711 ts_tablet_manager.cc:1403] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.026s
I20260709 12:26:55.779899 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:55.780476 22667 raft_consensus.cc:3060] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.781368 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:55.781865 22821 raft_consensus.cc:515] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.784113 22712 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:55.784695 22712 ts_tablet_manager.cc:1403] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:26:55.785336 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b620a48e004eb98b5a6e7b1872a55b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:55.785928 22515 raft_consensus.cc:3060] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.786430 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08b620a48e004eb98b5a6e7b1872a55b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:55.786999 22444 raft_consensus.cc:3060] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.787279 22712 raft_consensus.cc:359] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.787928 22712 raft_consensus.cc:385] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.788187 22712 raft_consensus.cc:740] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.782016 22711 raft_consensus.cc:359] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.788820 22711 raft_consensus.cc:385] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.789126 22711 raft_consensus.cc:740] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.789765 22711 consensus_queue.cc:260] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.781929 22441 raft_consensus.cc:3060] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.792021 22711 ts_tablet_manager.cc:1434] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:26:55.793008 22711 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.793205 22515 raft_consensus.cc:2468] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.794355 22559 leader_election.cc:304] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.795234 22721 raft_consensus.cc:2804] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.795708 22721 raft_consensus.cc:697] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:55.796501 22721 consensus_queue.cc:237] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.797333 22667 raft_consensus.cc:2468] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:55.798633 22485 leader_election.cc:304] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:55.799918 22861 raft_consensus.cc:2804] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.800174 22444 raft_consensus.cc:2468] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:55.800592 22861 raft_consensus.cc:697] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:55.800642 22712 consensus_queue.cc:260] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.801826 22861 consensus_queue.cc:237] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.810817 22441 raft_consensus.cc:2468] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:55.819676 22714 tablet_bootstrap.cc:654] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.804102 22821 leader_election.cc:290] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.803530 22713 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.836404 22713 ts_tablet_manager.cc:1403] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.199s	user 0.043s	sys 0.057s
I20260709 12:26:55.823911 22712 ts_tablet_manager.cc:1434] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 12:26:55.825215 22786 raft_consensus.cc:493] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.838197 22786 raft_consensus.cc:515] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.838766 22712 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:55.839083 22713 raft_consensus.cc:359] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.839715 22713 raft_consensus.cc:385] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.839975 22713 raft_consensus.cc:740] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.825825 22882 raft_consensus.cc:493] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.840492 22786 leader_election.cc:290] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:55.834673 22711 tablet_bootstrap.cc:654] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.826732 22721 consensus_queue.cc:1048] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:55.841342 22713 consensus_queue.cc:260] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.845193 22882 raft_consensus.cc:515] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.845974 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed4a7e6a404436dafc8fa216c27bbb4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:55.846763 22441 raft_consensus.cc:2468] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:55.847852 22483 leader_election.cc:304] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:55.849272 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed4a7e6a404436dafc8fa216c27bbb4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.849918 22593 raft_consensus.cc:2468] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:55.853202 22882 leader_election.cc:290] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:55.853793 22786 raft_consensus.cc:2804] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.853941 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcb63af1b654f0b8f361fb4bcf9a9a6" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:55.854276 22786 raft_consensus.cc:493] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.854619 22786 raft_consensus.cc:3060] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.855158 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcb63af1b654f0b8f361fb4bcf9a9a6" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:55.857095 22410 leader_election.cc:343] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:55.858321 22409 leader_election.cc:343] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.858759 22409 leader_election.cc:304] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:55.860405 22885 raft_consensus.cc:2749] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:55.861323 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:55.844103 22340 catalog_manager.cc:5697] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:55.872605 22341 catalog_manager.cc:5697] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:55.874487 22821 consensus_queue.cc:1048] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.883888 22713 ts_tablet_manager.cc:1434] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.006s
I20260709 12:26:55.886407 22711 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:55.886893 22711 ts_tablet_manager.cc:1403] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.094s	user 0.002s	sys 0.016s
I20260709 12:26:55.895035 22712 tablet_bootstrap.cc:654] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.898695 22713 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:55.906168 22711 raft_consensus.cc:359] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.906780 22711 raft_consensus.cc:385] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.906952 22711 raft_consensus.cc:740] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.893757 22786 raft_consensus.cc:515] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.908411 22711 consensus_queue.cc:260] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.909981 22714 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:55.910331 22714 ts_tablet_manager.cc:1403] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.161s	user 0.005s	sys 0.016s
I20260709 12:26:55.913525 22711 ts_tablet_manager.cc:1434] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 12:26:55.917488 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed4a7e6a404436dafc8fa216c27bbb4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:55.918074 22443 raft_consensus.cc:3060] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.928462 22711 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:55.930262 22714 raft_consensus.cc:359] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.930948 22714 raft_consensus.cc:385] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.931208 22714 raft_consensus.cc:740] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.931600 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed4a7e6a404436dafc8fa216c27bbb4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:55.932199 22590 raft_consensus.cc:3060] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.936197 22711 tablet_bootstrap.cc:654] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.931844 22714 consensus_queue.cc:260] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:55.944010 22882 consensus_queue.cc:1048] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.945863 22713 tablet_bootstrap.cc:654] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.948940 22714 ts_tablet_manager.cc:1434] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:26:55.953804 22714 tablet_bootstrap.cc:492] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:55.955338 22590 raft_consensus.cc:2468] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:55.956925 22484 leader_election.cc:304] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:55.927732 22786 leader_election.cc:290] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:55.971117 22713 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:55.971833 22713 ts_tablet_manager.cc:1403] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.003s
I20260709 12:26:55.977362 22882 raft_consensus.cc:493] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.977917 22882 raft_consensus.cc:515] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:55.980122 22882 leader_election.cc:290] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:55.981859 22934 raft_consensus.cc:2804] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:55.982578 22934 raft_consensus.cc:697] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:55.988276 22714 tablet_bootstrap.cc:654] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.983628 22934 consensus_queue.cc:237] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:55.986860 22882 raft_consensus.cc:493] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.985231 22443 raft_consensus.cc:2468] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:55.993758 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:55.996447 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
W20260709 12:26:55.997936 22410 leader_election.cc:343] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.992547 22882 raft_consensus.cc:515] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:26:55.998710 22410 leader_election.cc:343] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.999127 22410 leader_election.cc:304] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:55.999869 22885 raft_consensus.cc:2749] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.001102 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72f62885ce4d3b96f5b6e5e2f1b1a2" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.001245 22882 leader_election.cc:290] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:56.003458 22712 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
W20260709 12:26:56.003651 22409 leader_election.cc:343] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.003950 22712 ts_tablet_manager.cc:1403] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.165s	user 0.020s	sys 0.000s
I20260709 12:26:56.004158 22854 consensus_queue.cc:1048] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.005848 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72f62885ce4d3b96f5b6e5e2f1b1a2" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.007285 22713 raft_consensus.cc:359] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.007547 22712 raft_consensus.cc:359] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.007998 22713 raft_consensus.cc:385] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.008177 22712 raft_consensus.cc:385] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.008492 22712 raft_consensus.cc:740] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.008306 22713 raft_consensus.cc:740] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.010360 22712 consensus_queue.cc:260] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.011277 22713 consensus_queue.cc:260] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:26:56.012373 22410 leader_election.cc:343] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.013931 22712 ts_tablet_manager.cc:1434] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:56.013402 22410 leader_election.cc:304] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:56.016225 22885 raft_consensus.cc:2749] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.025961 22711 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.026554 22711 ts_tablet_manager.cc:1403] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.004s
I20260709 12:26:56.030186 22711 raft_consensus.cc:359] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.030815 22711 raft_consensus.cc:385] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.031072 22711 raft_consensus.cc:740] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.032043 22711 consensus_queue.cc:260] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.034039 22711 ts_tablet_manager.cc:1434] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:56.035022 22711 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.034727 22854 consensus_queue.cc:1048] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.041426 22713 ts_tablet_manager.cc:1434] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.002s
I20260709 12:26:56.037657 22712 tablet_bootstrap.cc:492] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:56.051503 22713 tablet_bootstrap.cc:492] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:56.047735 22935 raft_consensus.cc:493] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.053119 22935 raft_consensus.cc:515] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.055356 22935 leader_election.cc:290] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.056568 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.057224 22443 raft_consensus.cc:2468] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:56.059067 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.049804 22882 consensus_queue.cc:1048] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:26:56.061921 22483 leader_election.cc:304] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:56.062727 22934 raft_consensus.cc:2804] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.063148 22934 raft_consensus.cc:493] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.063526 22934 raft_consensus.cc:3060] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.063933 22340 catalog_manager.cc:5697] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.069864 22721 raft_consensus.cc:493] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.070333 22721 raft_consensus.cc:515] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.072295 22721 leader_election.cc:290] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.072402 22934 raft_consensus.cc:515] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.074682 22934 leader_election.cc:290] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
W20260709 12:26:56.075798 22485 leader_election.cc:343] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.078353 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:56.080711 22592 raft_consensus.cc:3060] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:56.085736 22485 leader_election.cc:343] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.086704 22896 raft_consensus.cc:493] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.087170 22896 raft_consensus.cc:515] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.090376 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcb63af1b654f0b8f361fb4bcf9a9a6" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.091169 22593 raft_consensus.cc:2468] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:56.092065 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.092235 22632 leader_election.cc:304] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
W20260709 12:26:56.094570 22559 leader_election.cc:343] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.095908 22721 consensus_queue.cc:1048] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.097530 22896 leader_election.cc:290] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.098819 22882 consensus_queue.cc:1048] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.099681 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcb63af1b654f0b8f361fb4bcf9a9a6" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.100299 22444 raft_consensus.cc:2468] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:56.103605 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:56.104188 22444 raft_consensus.cc:3060] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.098336 22896 raft_consensus.cc:2804] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.074604 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.106161 22896 raft_consensus.cc:493] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.116362 22443 raft_consensus.cc:2468] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.118971 22896 raft_consensus.cc:3060] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.123104 22557 leader_election.cc:304] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:56.126184 22721 raft_consensus.cc:2804] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.126578 22721 raft_consensus.cc:493] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.126924 22721 raft_consensus.cc:3060] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.128659 22713 tablet_bootstrap.cc:654] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.133592 22885 raft_consensus.cc:493] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.134064 22885 raft_consensus.cc:515] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.136149 22885 leader_election.cc:290] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:56.140280 22712 tablet_bootstrap.cc:654] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.140280 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:56.152830 22410 leader_election.cc:343] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.163420 22825 consensus_queue.cc:1048] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.164630 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.165004 22711 tablet_bootstrap.cc:654] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:56.175905 22409 leader_election.cc:343] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.176342 22409 leader_election.cc:304] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:56.180877 22885 raft_consensus.cc:2749] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.181856 22714 tablet_bootstrap.cc:492] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.182314 22714 ts_tablet_manager.cc:1403] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.008s
I20260709 12:26:56.177346 22896 raft_consensus.cc:515] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.200603 22768 consensus_queue.cc:1048] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:56.200941 22821 consensus_queue.cc:1048] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:56.205767 22768 consensus_queue.cc:1048] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.218593 22714 raft_consensus.cc:359] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.219511 22714 raft_consensus.cc:385] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.219848 22714 raft_consensus.cc:740] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.222563 22896 leader_election.cc:290] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.222695 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcb63af1b654f0b8f361fb4bcf9a9a6" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:56.223434 22593 raft_consensus.cc:3060] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.224362 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcb63af1b654f0b8f361fb4bcf9a9a6" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:56.224908 22861 raft_consensus.cc:493] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.225175 22443 raft_consensus.cc:3060] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.225637 22861 raft_consensus.cc:515] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.227773 22861 leader_election.cc:290] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.229730 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.230370 22442 raft_consensus.cc:2468] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:56.230405 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.231463 22882 raft_consensus.cc:493] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.231936 22882 raft_consensus.cc:515] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
W20260709 12:26:56.232306 22485 leader_election.cc:343] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.234107 22882 leader_election.cc:290] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:56.236052 22483 leader_election.cc:304] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:56.237846 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8232aac5b6cf43f79a9dcb0181721fb3" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:56.240231 22714 consensus_queue.cc:260] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.241900 22935 raft_consensus.cc:2804] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.242439 22935 raft_consensus.cc:493] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.242897 22935 raft_consensus.cc:3060] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:56.243902 22410 leader_election.cc:343] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.262089 22444 raft_consensus.cc:2468] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
W20260709 12:26:56.263820 22559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 63125.8us
I20260709 12:26:56.246263 22861 consensus_queue.cc:1048] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:26:56.270315 22713 tablet_bootstrap.cc:492] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:56.283217 22713 ts_tablet_manager.cc:1403] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.019s
I20260709 12:26:56.283388 22714 ts_tablet_manager.cc:1434] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 12:26:56.272456 22721 raft_consensus.cc:515] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.274802 22711 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.284013 22711 ts_tablet_manager.cc:1403] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.249s	user 0.009s	sys 0.014s
I20260709 12:26:56.285079 22714 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.286609 22711 raft_consensus.cc:359] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.286921 22713 raft_consensus.cc:359] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
W20260709 12:26:56.271552 22949 log.cc:927] Time spent T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:26:56.287269 22711 raft_consensus.cc:385] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.276975 22712 tablet_bootstrap.cc:492] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:56.288638 22712 ts_tablet_manager.cc:1403] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.261s	user 0.021s	sys 0.004s
I20260709 12:26:56.288177 22713 raft_consensus.cc:385] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.289482 22711 raft_consensus.cc:740] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.289212 22713 raft_consensus.cc:740] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.291801 22713 consensus_queue.cc:260] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.290230 22711 consensus_queue.cc:260] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.297550 22483 leader_election.cc:304] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:56.298700 22786 raft_consensus.cc:2804] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.299175 22786 raft_consensus.cc:697] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:56.299984 22786 consensus_queue.cc:237] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.301080 22593 raft_consensus.cc:2468] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
W20260709 12:26:56.301640 22945 log.cc:927] Time spent T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:26:56.300936 22712 raft_consensus.cc:359] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.303846 22711 ts_tablet_manager.cc:1434] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:26:56.304118 22712 raft_consensus.cc:385] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.288874 22443 raft_consensus.cc:2468] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:56.303031 22713 ts_tablet_manager.cc:1434] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 12:26:56.304390 22712 raft_consensus.cc:740] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.309139 22713 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:56.309049 22667 raft_consensus.cc:3060] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.309351 22631 leader_election.cc:304] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:56.311699 22854 raft_consensus.cc:2804] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.312150 22854 raft_consensus.cc:697] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:56.314962 22854 consensus_queue.cc:237] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.308777 22711 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.322623 22712 consensus_queue.cc:260] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.324810 22712 ts_tablet_manager.cc:1434] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:26:56.331329 22721 leader_election.cc:290] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.332581 22712 tablet_bootstrap.cc:492] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:56.332469 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:56.333139 22441 raft_consensus.cc:3060] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.341696 22934 consensus_queue.cc:1048] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.333710 22935 raft_consensus.cc:515] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.377913 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8232aac5b6cf43f79a9dcb0181721fb3" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.379243 22712 tablet_bootstrap.cc:654] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:56.380482 22633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 53463.7us
I20260709 12:26:56.383459 22342 catalog_manager.cc:5697] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.406124 22935 leader_election.cc:290] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.407426 22714 tablet_bootstrap.cc:654] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.407341 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
W20260709 12:26:56.397758 22409 leader_election.cc:343] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.409490 22409 leader_election.cc:304] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:56.409780 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:56.410246 22711 tablet_bootstrap.cc:654] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.410355 22443 raft_consensus.cc:3060] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.411087 22882 raft_consensus.cc:2749] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.411967 22954 consensus_queue.cc:1048] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.390513 22821 consensus_queue.cc:1048] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:26:56.394850 22896 raft_consensus.cc:493] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.420822 22713 tablet_bootstrap.cc:654] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.432346 22441 raft_consensus.cc:2468] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:56.439253 22712 tablet_bootstrap.cc:492] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:56.439710 22712 ts_tablet_manager.cc:1403] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.003s
I20260709 12:26:56.423221 22896 raft_consensus.cc:515] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.441689 22443 raft_consensus.cc:2468] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:56.442772 22896 leader_election.cc:290] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:56.445174 22712 raft_consensus.cc:359] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.451257 22712 raft_consensus.cc:385] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.451604 22712 raft_consensus.cc:740] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.449997 22557 leader_election.cc:304] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:56.457046 22954 raft_consensus.cc:2804] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.464102 22712 consensus_queue.cc:260] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.467306 22711 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.459868 22768 raft_consensus.cc:493] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.468108 22768 raft_consensus.cc:515] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.469193 22711 ts_tablet_manager.cc:1403] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.014s
I20260709 12:26:56.470085 22713 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:56.449947 22483 leader_election.cc:304] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:56.478560 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8474847f8e04fd58b6b04a2bce93bee" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:56.480996 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8474847f8e04fd58b6b04a2bce93bee" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.482110 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
W20260709 12:26:56.484053 22559 leader_election.cc:343] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.477267 22713 ts_tablet_manager.cc:1403] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.008s
I20260709 12:26:56.494418 22934 raft_consensus.cc:2804] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.500485 22934 raft_consensus.cc:697] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:56.501605 22712 ts_tablet_manager.cc:1434] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.003s
I20260709 12:26:56.490530 22768 leader_election.cc:290] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:56.506067 22934 consensus_queue.cc:237] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.500033 22954 raft_consensus.cc:697] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:56.512379 22954 consensus_queue.cc:237] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.518332 22515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:56.518988 22515 raft_consensus.cc:2468] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.521397 22713 raft_consensus.cc:359] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.522059 22713 raft_consensus.cc:385] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.522500 22713 raft_consensus.cc:740] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.522007 22825 raft_consensus.cc:493] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.523202 22713 consensus_queue.cc:260] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.511564 22711 raft_consensus.cc:359] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.525276 22711 raft_consensus.cc:385] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.525635 22711 raft_consensus.cc:740] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.526456 22711 consensus_queue.cc:260] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.532770 22342 catalog_manager.cc:5697] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.523520 22825 raft_consensus.cc:515] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.539472 22711 ts_tablet_manager.cc:1434] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 12:26:56.540803 22825 leader_election.cc:290] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:56.541754 22712 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:56.545914 22559 leader_election.cc:304] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:56.547446 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.548009 22712 tablet_bootstrap.cc:654] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.549505 22713 ts_tablet_manager.cc:1434] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.003s
I20260709 12:26:56.550146 22891 raft_consensus.cc:2804] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.550482 22713 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:56.550547 22891 raft_consensus.cc:493] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.551016 22891 raft_consensus.cc:3060] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.552672 22714 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.553150 22714 ts_tablet_manager.cc:1403] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.268s	user 0.020s	sys 0.011s
I20260709 12:26:56.555747 22714 raft_consensus.cc:359] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.556376 22714 raft_consensus.cc:385] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.556676 22714 raft_consensus.cc:740] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.556449 22664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.557420 22633 leader_election.cc:304] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:56.563071 22714 consensus_queue.cc:260] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.564821 22711 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.565152 22714 ts_tablet_manager.cc:1434] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:56.597150 22714 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.562426 22713 tablet_bootstrap.cc:654] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:56.589008 22409 leader_election.cc:343] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.602619 22711 tablet_bootstrap.cc:654] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.591612 22935 consensus_queue.cc:1048] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:56.602619 22714 tablet_bootstrap.cc:654] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:56.614034 22559 leader_election.cc:343] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.633124 22961 raft_consensus.cc:2749] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.628965 22891 raft_consensus.cc:515] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.642714 22891 leader_election.cc:290] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:56.649777 22340 catalog_manager.cc:5697] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:56.655879 22342 catalog_manager.cc:5697] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.662855 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
W20260709 12:26:56.663461 22485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 161064us
I20260709 12:26:56.663548 22516 raft_consensus.cc:3060] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.665103 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
W20260709 12:26:56.667776 22559 leader_election.cc:343] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.667977 22711 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.668557 22711 ts_tablet_manager.cc:1403] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.001s
I20260709 12:26:56.671281 22711 raft_consensus.cc:359] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.671902 22711 raft_consensus.cc:385] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.672178 22711 raft_consensus.cc:740] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.673223 22711 consensus_queue.cc:260] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.678658 22711 ts_tablet_manager.cc:1434] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:26:56.679589 22711 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.680792 22935 consensus_queue.cc:1048] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.690250 22712 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:56.690711 22712 ts_tablet_manager.cc:1403] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.001s
I20260709 12:26:56.695214 22711 tablet_bootstrap.cc:654] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.697702 22516 raft_consensus.cc:2468] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:56.698997 22559 leader_election.cc:304] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:56.699115 22934 raft_consensus.cc:493] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.699795 22821 raft_consensus.cc:2804] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.699734 22934 raft_consensus.cc:515] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.700440 22821 raft_consensus.cc:697] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:56.701346 22821 consensus_queue.cc:237] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
W20260709 12:26:56.702399 22485 leader_election.cc:343] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.703584 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:56.704962 22712 raft_consensus.cc:359] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.705657 22712 raft_consensus.cc:385] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.705932 22712 raft_consensus.cc:740] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
W20260709 12:26:56.706998 22410 leader_election.cc:343] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.705822 22934 leader_election.cc:290] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:56.707579 22713 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:56.707494 22410 leader_election.cc:304] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:56.708765 22713 ts_tablet_manager.cc:1403] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.006s
I20260709 12:26:56.705989 22714 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.709148 22882 raft_consensus.cc:2749] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.709460 22714 ts_tablet_manager.cc:1403] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.004s
I20260709 12:26:56.711164 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e663a8692ca14cefbe1c5e449bcdd818" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.712010 22712 consensus_queue.cc:260] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.712062 22714 raft_consensus.cc:359] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.712925 22714 raft_consensus.cc:385] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.713225 22714 raft_consensus.cc:740] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.713905 22714 consensus_queue.cc:260] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.716073 22714 ts_tablet_manager.cc:1434] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
W20260709 12:26:56.716687 22485 leader_election.cc:343] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.714249 22712 ts_tablet_manager.cc:1434] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:26:56.718837 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e663a8692ca14cefbe1c5e449bcdd818" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:56.719703 22713 raft_consensus.cc:359] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:26:56.720041 22484 leader_election.cc:343] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.720386 22713 raft_consensus.cc:385] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.720494 22484 leader_election.cc:304] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:56.721087 22712 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:56.723709 22934 raft_consensus.cc:2749] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.728456 22712 tablet_bootstrap.cc:654] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.720706 22713 raft_consensus.cc:740] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.738763 22713 consensus_queue.cc:260] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.740795 22961 consensus_queue.cc:1048] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:56.747659 22711 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.748311 22711 ts_tablet_manager.cc:1403] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.004s
I20260709 12:26:56.751981 22711 raft_consensus.cc:359] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.752661 22711 raft_consensus.cc:385] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.753010 22711 raft_consensus.cc:740] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.753870 22711 consensus_queue.cc:260] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.755914 22711 ts_tablet_manager.cc:1434] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 12:26:56.760227 22713 ts_tablet_manager.cc:1434] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:26:56.761260 22713 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:56.756716 22342 catalog_manager.cc:5697] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.766603 22713 tablet_bootstrap.cc:654] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.768838 22714 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.775300 22714 tablet_bootstrap.cc:654] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.756899 22711 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.781414 22711 tablet_bootstrap.cc:654] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.785544 22896 consensus_queue.cc:1048] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.795473 22712 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:56.796006 22712 ts_tablet_manager.cc:1403] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.075s	user 0.030s	sys 0.013s
I20260709 12:26:56.796592 22714 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.797070 22714 ts_tablet_manager.cc:1403] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.001s
I20260709 12:26:56.798887 22712 raft_consensus.cc:359] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.803478 22712 raft_consensus.cc:385] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.803809 22712 raft_consensus.cc:740] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.804440 22711 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.805385 22711 ts_tablet_manager.cc:1403] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 12:26:56.805531 22712 consensus_queue.cc:260] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.807669 22712 ts_tablet_manager.cc:1434] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:26:56.807753 22711 raft_consensus.cc:359] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.808467 22711 raft_consensus.cc:385] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.808733 22712 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:56.808709 22711 raft_consensus.cc:740] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.799608 22714 raft_consensus.cc:359] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.811419 22714 raft_consensus.cc:385] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.811724 22714 raft_consensus.cc:740] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.812498 22714 consensus_queue.cc:260] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.814785 22714 ts_tablet_manager.cc:1434] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:26:56.815526 22712 tablet_bootstrap.cc:654] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.815721 22714 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.822849 22713 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:56.823295 22713 ts_tablet_manager.cc:1403] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.011s
I20260709 12:26:56.827207 22711 consensus_queue.cc:260] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.829105 22711 ts_tablet_manager.cc:1434] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:26:56.829921 22711 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.833830 22714 tablet_bootstrap.cc:654] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.833591 22713 raft_consensus.cc:359] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.834290 22713 raft_consensus.cc:385] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.834582 22713 raft_consensus.cc:740] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.835278 22713 consensus_queue.cc:260] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.840502 22821 raft_consensus.cc:493] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.840962 22821 raft_consensus.cc:515] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.843526 22821 leader_election.cc:290] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.850476 22713 ts_tablet_manager.cc:1434] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:26:56.850870 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:56.853016 22559 leader_election.cc:343] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.854854 22713 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:56.856964 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.857887 22443 raft_consensus.cc:2468] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.859484 22557 leader_election.cc:304] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:56.860983 22821 raft_consensus.cc:2804] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.861492 22821 raft_consensus.cc:493] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.861958 22821 raft_consensus.cc:3060] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.864248 22711 tablet_bootstrap.cc:654] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.869803 22713 tablet_bootstrap.cc:654] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.877955 22714 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.878364 22714 ts_tablet_manager.cc:1403] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.018s
I20260709 12:26:56.880188 22714 raft_consensus.cc:359] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.880684 22714 raft_consensus.cc:385] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.880964 22714 raft_consensus.cc:740] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.881662 22714 consensus_queue.cc:260] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.883092 22714 ts_tablet_manager.cc:1434] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:56.883981 22714 tablet_bootstrap.cc:492] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.887660 22711 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.888234 22711 ts_tablet_manager.cc:1403] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.000s
I20260709 12:26:56.889676 22714 tablet_bootstrap.cc:654] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.891765 22711 raft_consensus.cc:359] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.895299 22711 raft_consensus.cc:385] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.894876 22713 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:56.896682 22713 ts_tablet_manager.cc:1403] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:26:56.895771 22711 raft_consensus.cc:740] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.899339 22711 consensus_queue.cc:260] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.900666 22666 raft_consensus.cc:3060] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.901755 22714 tablet_bootstrap.cc:492] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.902228 22714 ts_tablet_manager.cc:1403] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:26:56.903311 22713 raft_consensus.cc:359] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.904770 22713 raft_consensus.cc:385] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.905133 22713 raft_consensus.cc:740] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.905028 22714 raft_consensus.cc:359] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.904433 22711 ts_tablet_manager.cc:1434] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:56.905855 22714 raft_consensus.cc:385] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.906172 22714 raft_consensus.cc:740] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.906962 22711 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:56.906915 22714 consensus_queue.cc:260] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:56.912449 22713 consensus_queue.cc:260] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.912508 22721 raft_consensus.cc:493] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.908986 22714 ts_tablet_manager.cc:1434] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:56.914469 22713 ts_tablet_manager.cc:1434] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:56.914180 22721 raft_consensus.cc:515] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.915174 22714 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.915640 22713 tablet_bootstrap.cc:492] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:56.916476 22721 leader_election.cc:290] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.928992 22711 tablet_bootstrap.cc:654] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.934016 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.934693 22441 raft_consensus.cc:2468] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.935890 22557 leader_election.cc:304] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:56.929545 22714 tablet_bootstrap.cc:654] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.936733 22954 raft_consensus.cc:2804] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.937286 22954 raft_consensus.cc:493] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.937691 22954 raft_consensus.cc:3060] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.933830 22713 tablet_bootstrap.cc:654] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.938691 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:56.940686 22559 leader_election.cc:343] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.943661 22935 consensus_queue.cc:1048] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:56.916992 22721 raft_consensus.cc:493] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.953775 22721 raft_consensus.cc:515] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.955390 22711 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:56.955910 22711 ts_tablet_manager.cc:1403] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.002s
I20260709 12:26:56.957001 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72f62885ce4d3b96f5b6e5e2f1b1a2" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.957680 22442 raft_consensus.cc:2468] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.958701 22711 raft_consensus.cc:359] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.959061 22557 leader_election.cc:304] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:56.959407 22711 raft_consensus.cc:385] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.959690 22711 raft_consensus.cc:740] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.959933 22891 raft_consensus.cc:2804] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.960321 22891 raft_consensus.cc:493] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.960702 22891 raft_consensus.cc:3060] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.961277 22954 raft_consensus.cc:515] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.962054 22714 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:56.963726 22714 ts_tablet_manager.cc:1403] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.001s
I20260709 12:26:56.965677 22768 raft_consensus.cc:493] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.966164 22768 raft_consensus.cc:515] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.966315 22664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72f62885ce4d3b96f5b6e5e2f1b1a2" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.967870 22934 raft_consensus.cc:493] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.962499 22711 consensus_queue.cc:260] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.967662 22714 raft_consensus.cc:359] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.971351 22714 raft_consensus.cc:385] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.967312 22664 raft_consensus.cc:2468] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.971736 22714 raft_consensus.cc:740] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.968413 22934 raft_consensus.cc:515] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.971168 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8232aac5b6cf43f79a9dcb0181721fb3" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:56.972985 22441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8232aac5b6cf43f79a9dcb0181721fb3" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.973804 22441 raft_consensus.cc:2468] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:56.974879 22557 leader_election.cc:304] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:56.972935 22714 consensus_queue.cc:260] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:56.975749 22966 raft_consensus.cc:2804] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.976143 22966 raft_consensus.cc:493] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.976470 22966 raft_consensus.cc:3060] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.976622 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2027b04cc47c4770a74b4e67e631780b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:56.977958 22485 leader_election.cc:343] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.978945 22664 raft_consensus.cc:3060] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.980218 22954 leader_election.cc:290] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.981698 22714 ts_tablet_manager.cc:1434] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:56.984692 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2027b04cc47c4770a74b4e67e631780b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:56.983835 22721 leader_election.cc:290] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.985351 22440 raft_consensus.cc:2468] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:56.985702 22721 consensus_queue.cc:1048] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.986137 22714 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:56.987937 22885 raft_consensus.cc:493] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.988559 22885 raft_consensus.cc:515] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:56.991101 22885 leader_election.cc:290] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:56.991016 22966 raft_consensus.cc:515] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:56.968291 22768 leader_election.cc:290] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:56.993376 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01570c53874f495494092ddc9bb43c05" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:56.995087 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8232aac5b6cf43f79a9dcb0181721fb3" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:56.995723 22443 raft_consensus.cc:3060] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:56.997943 22410 leader_election.cc:343] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.003288 22786 consensus_queue.cc:1048] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:56.983649 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.005059 22442 raft_consensus.cc:3060] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.011104 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:57.012460 22442 raft_consensus.cc:2468] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.012624 22483 leader_election.cc:304] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:56.983393 22934 leader_election.cc:290] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.999557 22821 raft_consensus.cc:515] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.000613 22861 raft_consensus.cc:493] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.017812 22861 raft_consensus.cc:515] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.001641 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01570c53874f495494092ddc9bb43c05" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.020552 22896 raft_consensus.cc:493] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.021109 22896 raft_consensus.cc:515] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
W20260709 12:26:57.022642 22410 leader_election.cc:343] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.023137 22896 leader_election.cc:290] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:56.959095 22713 tablet_bootstrap.cc:492] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:57.020542 22861 leader_election.cc:290] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.025100 22713 ts_tablet_manager.cc:1403] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.003s
I20260709 12:26:57.023169 22410 leader_election.cc:304] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.027592 22885 raft_consensus.cc:2749] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.027798 22713 raft_consensus.cc:359] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.028298 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.028563 22713 raft_consensus.cc:385] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:26:57.015837 22559 leader_election.cc:343] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.017087 22935 raft_consensus.cc:2804] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.030658 22935 raft_consensus.cc:493] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.031091 22935 raft_consensus.cc:3060] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.031527 22966 leader_election.cc:290] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.031773 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.032590 22438 raft_consensus.cc:3060] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.026741 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a056e813b794e0bb9f0055705fc192a" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.038221 22631 leader_election.cc:304] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.028834 22713 raft_consensus.cc:740] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.039151 22713 consensus_queue.cc:260] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.039565 22896 raft_consensus.cc:2749] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.044185 22557 leader_election.cc:304] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:57.045455 22439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.046154 22439 raft_consensus.cc:2468] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:57.050624 22861 consensus_queue.cc:1048] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.051613 22891 raft_consensus.cc:515] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.058525 22891 leader_election.cc:290] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:56.970983 22711 ts_tablet_manager.cc:1434] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:26:57.062140 22714 tablet_bootstrap.cc:654] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.054548 22483 leader_election.cc:304] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:57.062966 22934 raft_consensus.cc:2804] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.063153 22711 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:57.063354 22934 raft_consensus.cc:493] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.063906 22934 raft_consensus.cc:3060] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.067080 22954 raft_consensus.cc:2804] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.067737 22954 raft_consensus.cc:697] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:57.068807 22954 consensus_queue.cc:237] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.073939 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72f62885ce4d3b96f5b6e5e2f1b1a2" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.074743 22440 raft_consensus.cc:3060] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.075641 22712 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:57.076138 22712 ts_tablet_manager.cc:1403] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.268s	user 0.082s	sys 0.121s
W20260709 12:26:57.076026 22559 leader_election.cc:343] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.026374 22821 leader_election.cc:290] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:57.077724 22825 raft_consensus.cc:493] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.078194 22825 raft_consensus.cc:515] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.079869 22667 raft_consensus.cc:3060] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.080096 22825 leader_election.cc:290] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.060928 22438 raft_consensus.cc:2468] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.016923 22443 raft_consensus.cc:2468] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.082861 22557 leader_election.cc:304] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:57.084034 22557 leader_election.cc:304] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:57.085175 22966 raft_consensus.cc:2804] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.085888 22768 raft_consensus.cc:2804] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.085963 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347648ceea81494ab02439c3c0cbb346" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:57.086421 22768 raft_consensus.cc:697] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:57.087263 22768 consensus_queue.cc:237] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.088950 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347648ceea81494ab02439c3c0cbb346" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.089541 22966 raft_consensus.cc:697] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
W20260709 12:26:57.090560 22410 leader_election.cc:343] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.071446 22713 ts_tablet_manager.cc:1434] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
W20260709 12:26:57.091568 22410 leader_election.cc:343] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.091889 22713 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:57.092042 22410 leader_election.cc:304] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.092912 22825 raft_consensus.cc:2749] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.090425 22966 consensus_queue.cc:237] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.099017 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:57.099622 22665 raft_consensus.cc:3060] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.101501 22712 raft_consensus.cc:359] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.102334 22712 raft_consensus.cc:385] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.102589 22712 raft_consensus.cc:740] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.103246 22712 consensus_queue.cc:260] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.110942 22934 raft_consensus.cc:515] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.111625 22896 raft_consensus.cc:493] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.112185 22896 raft_consensus.cc:515] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.113760 22712 ts_tablet_manager.cc:1434] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:26:57.114085 22440 raft_consensus.cc:2468] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.114733 22961 raft_consensus.cc:493] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.115302 22557 leader_election.cc:304] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:57.115195 22961 raft_consensus.cc:515] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.117252 22961 leader_election.cc:290] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:57.118125 22896 leader_election.cc:290] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.119154 22768 raft_consensus.cc:2804] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.119201 22861 consensus_queue.cc:1048] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:57.119472 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.119801 22768 raft_consensus.cc:697] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:57.121421 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.121877 22713 tablet_bootstrap.cc:654] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.121759 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e9a4f6e8ed40e5a1854b3462b79964" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.120738 22768 consensus_queue.cc:237] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.123389 22631 leader_election.cc:304] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:57.124527 22896 raft_consensus.cc:2749] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.125093 22712 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:57.125403 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf37be188fc415084a391ababe64d34" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.125864 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72f62885ce4d3b96f5b6e5e2f1b1a2" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:57.126475 22663 raft_consensus.cc:3060] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.126873 22631 leader_election.cc:304] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.127203 22934 leader_election.cc:290] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.128194 22896 raft_consensus.cc:2749] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.136646 22663 raft_consensus.cc:2468] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.138209 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8232aac5b6cf43f79a9dcb0181721fb3" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:57.138801 22516 raft_consensus.cc:3060] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.145391 22665 raft_consensus.cc:2468] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.148744 22713 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:57.149252 22713 ts_tablet_manager.cc:1403] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.000s
W20260709 12:26:57.146227 22410 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 54691.3us
I20260709 12:26:57.059206 22935 raft_consensus.cc:515] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.156889 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.157354 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2027b04cc47c4770a74b4e67e631780b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
W20260709 12:26:57.158561 22485 leader_election.cc:343] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.161972 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:57.162595 22714 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:57.163067 22714 ts_tablet_manager.cc:1403] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.013s
I20260709 12:26:57.163401 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.164002 22440 raft_consensus.cc:3060] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.165699 22714 raft_consensus.cc:359] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.166378 22714 raft_consensus.cc:385] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.166640 22714 raft_consensus.cc:740] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.167373 22714 consensus_queue.cc:260] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.169777 22714 ts_tablet_manager.cc:1434] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:26:57.170706 22714 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:57.171011 22713 raft_consensus.cc:359] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
W20260709 12:26:57.173197 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:57.175945 22713 raft_consensus.cc:385] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.176575 22713 raft_consensus.cc:740] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
W20260709 12:26:57.174737 22484 leader_election.cc:343] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.177388 22714 tablet_bootstrap.cc:654] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.178301 22821 consensus_queue.cc:1048] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.174724 22712 tablet_bootstrap.cc:654] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:57.178483 22484 leader_election.cc:343] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.174017 22665 raft_consensus.cc:3060] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.181592 22713 consensus_queue.cc:260] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.187924 22713 ts_tablet_manager.cc:1434] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 12:26:57.191730 22713 tablet_bootstrap.cc:492] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:57.192215 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2027b04cc47c4770a74b4e67e631780b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.193648 22714 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:57.194041 22443 raft_consensus.cc:3060] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.146394 22516 raft_consensus.cc:2468] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.194131 22714 ts_tablet_manager.cc:1403] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:26:57.198192 22821 consensus_queue.cc:1048] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.199414 22714 raft_consensus.cc:359] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.200078 22714 raft_consensus.cc:385] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.200368 22714 raft_consensus.cc:740] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.202450 22712 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:57.202915 22712 ts_tablet_manager.cc:1403] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.001s
I20260709 12:26:57.184669 22935 leader_election.cc:290] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:57.205736 22712 raft_consensus.cc:359] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.206600 22712 raft_consensus.cc:385] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.206933 22712 raft_consensus.cc:740] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.208585 22712 consensus_queue.cc:260] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.200959 22443 raft_consensus.cc:2468] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:57.207986 22714 consensus_queue.cc:260] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.212258 22712 ts_tablet_manager.cc:1434] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:57.212366 22714 ts_tablet_manager.cc:1434] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:26:57.213372 22714 tablet_bootstrap.cc:492] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:57.219449 22714 tablet_bootstrap.cc:654] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.222122 22712 tablet_bootstrap.cc:492] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:57.210489 22440 raft_consensus.cc:2468] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:57.229739 22483 leader_election.cc:304] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:57.231351 22483 leader_election.cc:304] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:57.231526 22934 raft_consensus.cc:2804] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.232842 22935 raft_consensus.cc:2804] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.233234 22711 tablet_bootstrap.cc:654] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.233336 22935 raft_consensus.cc:697] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:57.234337 22935 consensus_queue.cc:237] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.235549 22825 raft_consensus.cc:493] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.236053 22825 raft_consensus.cc:515] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.238068 22825 leader_election.cc:290] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:57.238890 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.212234 22713 tablet_bootstrap.cc:654] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.240648 22934 raft_consensus.cc:697] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:57.241806 22934 consensus_queue.cc:237] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.244576 22712 tablet_bootstrap.cc:654] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.247514 22711 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:57.248003 22711 ts_tablet_manager.cc:1403] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.186s	user 0.008s	sys 0.002s
I20260709 12:26:57.251405 22342 catalog_manager.cc:5697] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.251746 22711 raft_consensus.cc:359] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.252687 22711 raft_consensus.cc:385] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.253079 22711 raft_consensus.cc:740] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.253003 22342 catalog_manager.cc:5697] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.254220 22711 consensus_queue.cc:260] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.257916 22714 tablet_bootstrap.cc:492] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:57.258384 22714 ts_tablet_manager.cc:1403] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.001s
W20260709 12:26:57.260076 22409 leader_election.cc:343] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.259994 22342 catalog_manager.cc:5697] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.262326 22338 catalog_manager.cc:5697] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.262372 22342 catalog_manager.cc:5697] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.263253 22714 raft_consensus.cc:359] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.263984 22714 raft_consensus.cc:385] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.264225 22714 raft_consensus.cc:740] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.266721 22714 consensus_queue.cc:260] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.268682 22714 ts_tablet_manager.cc:1434] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:57.260747 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:57.273159 22711 ts_tablet_manager.cc:1434] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:26:57.269481 22854 raft_consensus.cc:493] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.276072 22714 tablet_bootstrap.cc:492] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:57.290107 22713 tablet_bootstrap.cc:492] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:57.290720 22713 ts_tablet_manager.cc:1403] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.002s
I20260709 12:26:57.292433 22711 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:57.276818 22854 raft_consensus.cc:515] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
W20260709 12:26:57.289484 22410 leader_election.cc:343] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.305431 22410 leader_election.cc:304] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:57.310413 22885 raft_consensus.cc:2749] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.324956 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e663a8692ca14cefbe1c5e449bcdd818" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.325665 22516 raft_consensus.cc:2468] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:57.326699 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e663a8692ca14cefbe1c5e449bcdd818" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.327312 22713 raft_consensus.cc:359] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.327951 22713 raft_consensus.cc:385] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.328224 22713 raft_consensus.cc:740] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.329460 22713 consensus_queue.cc:260] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.328765 22633 leader_election.cc:304] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:57.335652 22961 raft_consensus.cc:493] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.340327 22713 ts_tablet_manager.cc:1434] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 12:26:57.333552 22854 leader_election.cc:290] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.341537 22896 raft_consensus.cc:2804] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.343556 22896 raft_consensus.cc:493] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.339500 22961 raft_consensus.cc:515] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
W20260709 12:26:57.338559 22632 leader_election.cc:343] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.344169 22896 raft_consensus.cc:3060] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.338274 22821 consensus_queue.cc:1048] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:26:57.353088 22961 leader_election.cc:290] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.354185 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347648ceea81494ab02439c3c0cbb346" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.354806 22443 raft_consensus.cc:2468] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:57.355175 22711 tablet_bootstrap.cc:654] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.355629 22714 tablet_bootstrap.cc:654] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.356097 22631 leader_election.cc:304] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:57.357281 22961 raft_consensus.cc:2804] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.358093 22961 raft_consensus.cc:493] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.358489 22961 raft_consensus.cc:3060] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.359992 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347648ceea81494ab02439c3c0cbb346" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
W20260709 12:26:57.372123 22633 leader_election.cc:343] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.374261 22896 raft_consensus.cc:515] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.376381 22713 tablet_bootstrap.cc:492] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:57.381464 22712 tablet_bootstrap.cc:492] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:57.382176 22712 ts_tablet_manager.cc:1403] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.160s	user 0.030s	sys 0.010s
I20260709 12:26:57.383631 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e663a8692ca14cefbe1c5e449bcdd818" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:57.384419 22590 raft_consensus.cc:3060] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.378643 22896 leader_election.cc:290] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.392196 22712 raft_consensus.cc:359] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.394034 22712 raft_consensus.cc:385] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.394385 22712 raft_consensus.cc:740] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.400738 22712 consensus_queue.cc:260] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.405937 22714 tablet_bootstrap.cc:492] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:57.406437 22714 ts_tablet_manager.cc:1403] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.010s
I20260709 12:26:57.408974 22714 raft_consensus.cc:359] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.409610 22714 raft_consensus.cc:385] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.409861 22714 raft_consensus.cc:740] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.412128 22714 consensus_queue.cc:260] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.414398 22714 ts_tablet_manager.cc:1434] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:57.415410 22714 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:57.406008 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e663a8692ca14cefbe1c5e449bcdd818" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:57.417949 22519 raft_consensus.cc:3060] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.421128 22714 tablet_bootstrap.cc:654] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.414413 22712 ts_tablet_manager.cc:1434] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:26:57.424612 22712 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:57.432183 22712 tablet_bootstrap.cc:654] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.440863 22338 catalog_manager.cc:5697] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.457978 22934 raft_consensus.cc:493] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.461344 22713 tablet_bootstrap.cc:654] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.458575 22934 raft_consensus.cc:515] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.483708 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01570c53874f495494092ddc9bb43c05" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:57.484623 22665 raft_consensus.cc:2468] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:57.500283 22896 raft_consensus.cc:493] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.500981 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01570c53874f495494092ddc9bb43c05" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.491950 22934 leader_election.cc:290] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:57.501690 22443 raft_consensus.cc:2468] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:57.500834 22896 raft_consensus.cc:515] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.494557 22821 raft_consensus.cc:493] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.507529 22821 raft_consensus.cc:515] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.509536 22821 leader_election.cc:290] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.510915 22440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.511579 22440 raft_consensus.cc:2468] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:57.504745 22483 leader_election.cc:304] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:57.505468 22896 leader_election.cc:290] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.506228 22954 raft_consensus.cc:493] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.506779 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae0b622804545ada0418c3cd4bfa2b5" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.512802 22711 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:57.513903 22714 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:57.514171 22711 ts_tablet_manager.cc:1403] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.029s
I20260709 12:26:57.514403 22714 ts_tablet_manager.cc:1403] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.099s	user 0.025s	sys 0.037s
W20260709 12:26:57.529953 22559 consensus_peers.cc:597] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b -> Peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Couldn't send request to peer 1704a791486d41aca21c226c48b00d89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:57.530239 22519 raft_consensus.cc:2468] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:57.531590 22961 raft_consensus.cc:515] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.517354 22557 leader_election.cc:304] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:57.533164 22590 raft_consensus.cc:2468] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:57.533452 22633 leader_election.cc:304] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:57.513525 22821 consensus_queue.cc:1048] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:26:57.534366 23020 raft_consensus.cc:2804] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.534842 23020 raft_consensus.cc:697] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:57.534885 22768 raft_consensus.cc:2804] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.515691 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.535399 22768 raft_consensus.cc:493] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.535801 22768 raft_consensus.cc:3060] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.535787 23020 consensus_queue.cc:237] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
W20260709 12:26:57.536263 22559 leader_election.cc:343] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.515779 22934 raft_consensus.cc:2804] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.537308 22934 raft_consensus.cc:493] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.537432 22712 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:57.537703 22934 raft_consensus.cc:3060] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.538307 22712 ts_tablet_manager.cc:1403] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.114s	user 0.024s	sys 0.025s
I20260709 12:26:57.532823 22714 raft_consensus.cc:359] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.540120 22714 raft_consensus.cc:385] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.540426 22714 raft_consensus.cc:740] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.541115 22714 consensus_queue.cc:260] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.542667 22712 raft_consensus.cc:359] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.543387 22712 raft_consensus.cc:385] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.543717 22712 raft_consensus.cc:740] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.544514 22712 consensus_queue.cc:260] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.551425 22934 raft_consensus.cc:515] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.554145 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01570c53874f495494092ddc9bb43c05" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:57.543207 22714 ts_tablet_manager.cc:1434] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:57.554733 22665 raft_consensus.cc:3060] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:57.554844 22632 leader_election.cc:343] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.556674 22712 ts_tablet_manager.cc:1434] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:57.558712 22712 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:57.557744 22714 tablet_bootstrap.cc:492] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:57.519989 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae0b622804545ada0418c3cd4bfa2b5" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.565174 22518 raft_consensus.cc:2468] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:57.566286 22633 leader_election.cc:304] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:57.567099 22854 raft_consensus.cc:2804] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.567492 22854 raft_consensus.cc:493] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.567816 22854 raft_consensus.cc:3060] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.567770 22721 consensus_queue.cc:1048] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:57.568612 22665 raft_consensus.cc:2468] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:57.569787 22485 leader_election.cc:304] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:57.570475 22714 tablet_bootstrap.cc:654] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.570611 22786 raft_consensus.cc:2804] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.571179 22786 raft_consensus.cc:697] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:57.515127 22954 raft_consensus.cc:515] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.572036 22786 consensus_queue.cc:237] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.552649 22711 raft_consensus.cc:359] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.578440 22711 raft_consensus.cc:385] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.578783 22711 raft_consensus.cc:740] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.580605 22711 consensus_queue.cc:260] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.584348 22954 leader_election.cc:290] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:57.585721 22712 tablet_bootstrap.cc:654] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.586781 22713 tablet_bootstrap.cc:492] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:57.586505 22854 raft_consensus.cc:515] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.587244 22713 ts_tablet_manager.cc:1403] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.211s	user 0.006s	sys 0.007s
I20260709 12:26:57.588580 22854 leader_election.cc:290] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.590638 22713 raft_consensus.cc:359] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.592540 22713 raft_consensus.cc:385] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.595115 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae0b622804545ada0418c3cd4bfa2b5" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:57.595688 22518 raft_consensus.cc:3060] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.599363 22768 raft_consensus.cc:515] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.601065 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.592921 22713 raft_consensus.cc:740] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.605363 22711 ts_tablet_manager.cc:1434] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
W20260709 12:26:57.606875 22559 leader_election.cc:343] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.607112 22713 consensus_queue.cc:260] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.614888 22711 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:57.612583 22885 raft_consensus.cc:493] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.615562 22885 raft_consensus.cc:515] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.615864 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347648ceea81494ab02439c3c0cbb346" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.616417 22443 raft_consensus.cc:3060] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.617584 22885 leader_election.cc:290] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.620009 22713 ts_tablet_manager.cc:1434] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260709 12:26:57.623584 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
W20260709 12:26:57.625001 22410 leader_election.cc:343] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.626986 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:57.628397 22410 leader_election.cc:343] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.628822 22410 leader_election.cc:304] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.629822 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01570c53874f495494092ddc9bb43c05" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.630505 22438 raft_consensus.cc:3060] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.630820 22882 raft_consensus.cc:2749] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.633726 22713 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:57.639031 22891 consensus_queue.cc:1048] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.614149 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:57.652993 22338 catalog_manager.cc:5697] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.643509 22934 leader_election.cc:290] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:57.658800 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae0b622804545ada0418c3cd4bfa2b5" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:57.659447 22590 raft_consensus.cc:3060] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.654438 22954 consensus_queue.cc:1048] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:26:57.665942 22712 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:57.666443 22712 ts_tablet_manager.cc:1403] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.005s
I20260709 12:26:57.677223 22342 catalog_manager.cc:5697] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.670984 22961 leader_election.cc:290] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:57.673730 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347648ceea81494ab02439c3c0cbb346" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:57.688479 22712 raft_consensus.cc:359] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.689006 22712 raft_consensus.cc:385] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.689317 22712 raft_consensus.cc:740] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.693925 22518 raft_consensus.cc:2468] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:57.694058 22768 leader_election.cc:290] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
W20260709 12:26:57.690457 22559 leader_election.cc:343] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.699712 22559 leader_election.cc:304] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.700878 22768 raft_consensus.cc:2749] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.701633 22712 consensus_queue.cc:260] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.702044 22768 consensus_queue.cc:1048] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:57.704420 22714 tablet_bootstrap.cc:492] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:57.704911 22714 ts_tablet_manager.cc:1403] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.148s	user 0.025s	sys 0.020s
I20260709 12:26:57.691727 22519 raft_consensus.cc:3060] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:57.722117 23030 log.cc:927] Time spent T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:57.724607 22443 raft_consensus.cc:2468] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:57.725342 22633 leader_election.cc:304] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:57.727195 22961 raft_consensus.cc:2804] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.727658 22961 raft_consensus.cc:697] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:57.727691 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:57.728621 22961 consensus_queue.cc:237] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.731380 22631 leader_election.cc:304] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:57.732188 23020 raft_consensus.cc:2804] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.732654 23020 raft_consensus.cc:697] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:57.733455 23020 consensus_queue.cc:237] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:57.734004 22954 consensus_queue.cc:1048] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 12:26:57.734477 22559 leader_election.cc:343] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.735337 22712 ts_tablet_manager.cc:1434] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:26:57.747982 22713 tablet_bootstrap.cc:654] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.748477 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:57.740818 22714 raft_consensus.cc:359] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.750077 22438 raft_consensus.cc:2468] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:57.749522 22443 raft_consensus.cc:3060] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.752424 22712 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:57.749516 22714 raft_consensus.cc:385] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.758715 22714 raft_consensus.cc:740] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.761008 22714 consensus_queue.cc:260] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.763607 22768 consensus_queue.cc:1048] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.776659 22714 ts_tablet_manager.cc:1434] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.071s	user 0.001s	sys 0.005s
I20260709 12:26:57.773101 22590 raft_consensus.cc:2468] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:57.774978 22896 raft_consensus.cc:493] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.777984 22896 raft_consensus.cc:515] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.778638 22786 consensus_queue.cc:1048] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.782102 22896 leader_election.cc:290] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.798978 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.803812 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.804451 22593 raft_consensus.cc:2468] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
W20260709 12:26:57.808115 22633 leader_election.cc:343] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.827921 22896 raft_consensus.cc:493] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.828553 22896 raft_consensus.cc:515] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:57.831238 22896 leader_election.cc:290] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:57.816025 22632 leader_election.cc:304] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.853914 22896 raft_consensus.cc:2804] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.854323 22896 raft_consensus.cc:493] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.854684 22896 raft_consensus.cc:3060] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.858592 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:57.863477 23035 log.cc:927] Time spent T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:26:57.864813 22484 consensus_peers.cc:597] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:57.868671 22885 raft_consensus.cc:493] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.871951 22439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8051a982a56c4bd6a92fe0fcc84095e6" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:57.879956 22714 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:57.890031 22519 raft_consensus.cc:2468] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:57.890161 22631 leader_election.cc:304] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:57.895098 22854 raft_consensus.cc:2749] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.904556 22712 tablet_bootstrap.cc:654] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.907037 22341 catalog_manager.cc:5697] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.907228 22711 tablet_bootstrap.cc:654] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.910436 22443 raft_consensus.cc:2468] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:57.909974 22341 catalog_manager.cc:5697] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.876974 22885 raft_consensus.cc:515] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.919692 22557 leader_election.cc:304] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:57.930502 22821 raft_consensus.cc:2804] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.931007 22821 raft_consensus.cc:697] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:57.931983 22821 consensus_queue.cc:237] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.941929 22666 raft_consensus.cc:3060] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.943646 22713 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:57.945689 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:57.943715 22885 leader_election.cc:290] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.920547 22896 raft_consensus.cc:515] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:57.944944 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:57.945696 22713 ts_tablet_manager.cc:1403] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.312s	user 0.015s	sys 0.011s
W20260709 12:26:57.948660 22410 leader_election.cc:343] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:57.949286 22409 leader_election.cc:343] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.949775 22409 leader_election.cc:304] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:57.952416 22786 consensus_queue.cc:1048] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.952946 22713 raft_consensus.cc:359] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.953639 22713 raft_consensus.cc:385] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.953908 22713 raft_consensus.cc:740] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.954586 22713 consensus_queue.cc:260] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:57.956933 22713 ts_tablet_manager.cc:1434] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:26:57.950850 22885 raft_consensus.cc:2749] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.957473 22896 leader_election.cc:290] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:57.983319 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:57.993324 22713 tablet_bootstrap.cc:492] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
W20260709 12:26:57.970168 22632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:33639, user_credentials={real_user=slave}} blocked reactor thread for 92047.6us
W20260709 12:26:58.004863 22633 leader_election.cc:343] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:58.017390 22485 consensus_peers.cc:597] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 -> Peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Couldn't send request to peer 1704a791486d41aca21c226c48b00d89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:58.021710 22711 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:58.022258 22711 ts_tablet_manager.cc:1403] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.413s	user 0.012s	sys 0.005s
I20260709 12:26:58.024257 22714 tablet_bootstrap.cc:654] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.024948 22711 raft_consensus.cc:359] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.032281 22711 raft_consensus.cc:385] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.032536 22711 raft_consensus.cc:740] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.033221 22711 consensus_queue.cc:260] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.038246 22711 ts_tablet_manager.cc:1434] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:58.026863 23047 consensus_queue.cc:1048] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:26:58.029484 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:58.115151 22713 tablet_bootstrap.cc:654] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.116604 22712 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:58.117187 22712 ts_tablet_manager.cc:1403] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.365s	user 0.015s	sys 0.001s
W20260709 12:26:58.121413 22632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:33639, user_credentials={real_user=slave}} blocked reactor thread for 71912.8us
I20260709 12:26:58.125921 22934 raft_consensus.cc:493] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.126386 22934 raft_consensus.cc:515] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.128476 22934 leader_election.cc:290] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:58.129282 22711 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:58.047215 22342 catalog_manager.cc:5697] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:58.129027 22485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 59457.6us
I20260709 12:26:58.120642 22712 raft_consensus.cc:359] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.113221 22592 raft_consensus.cc:3060] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.141175 22712 raft_consensus.cc:385] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.142350 22712 raft_consensus.cc:740] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.144152 22712 consensus_queue.cc:260] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.147442 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:58.148094 22437 raft_consensus.cc:2468] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:58.160447 22483 leader_election.cc:304] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:58.161201 22861 consensus_queue.cc:1048] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.162431 22711 tablet_bootstrap.cc:654] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.163429 22971 raft_consensus.cc:2804] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.163363 23047 consensus_queue.cc:1048] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.163923 22971 raft_consensus.cc:493] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.164309 22971 raft_consensus.cc:3060] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.171257 22934 consensus_queue.cc:1048] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.179867 22712 ts_tablet_manager.cc:1434] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:26:58.204591 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:58.212308 22712 tablet_bootstrap.cc:492] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:58.226600 22713 tablet_bootstrap.cc:492] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:58.227138 22713 ts_tablet_manager.cc:1403] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.251s	user 0.013s	sys 0.010s
I20260709 12:26:58.229877 22713 raft_consensus.cc:359] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.230525 22713 raft_consensus.cc:385] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.230791 22713 raft_consensus.cc:740] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.231412 22713 consensus_queue.cc:260] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.232890 22713 ts_tablet_manager.cc:1434] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:26:58.233788 22713 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:58.239446 22713 tablet_bootstrap.cc:654] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.262233 22768 raft_consensus.cc:493] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.262917 22768 raft_consensus.cc:515] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.266562 22768 leader_election.cc:290] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:58.268863 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.273655 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:58.286398 22557 leader_election.cc:304] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:58.289752 22821 raft_consensus.cc:2749] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.295184 22592 raft_consensus.cc:2468] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:58.297343 22971 raft_consensus.cc:515] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.301419 22712 tablet_bootstrap.cc:654] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.318318 22854 consensus_queue.cc:1048] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.335417 22632 leader_election.cc:304] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:58.335903 22854 consensus_queue.cc:1048] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.336692 23047 raft_consensus.cc:2804] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:58.337414 23047 raft_consensus.cc:697] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:58.322372 23048 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.339608 23048 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:26:58.332329 22485 leader_election.cc:343] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.338647 23047 consensus_queue.cc:237] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.340813 22714 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:58.342259 22714 ts_tablet_manager.cc:1403] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.471s	user 0.011s	sys 0.016s
I20260709 12:26:58.354053 23048 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:58.359742 22713 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:58.360319 22713 ts_tablet_manager.cc:1403] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.127s	user 0.023s	sys 0.071s
I20260709 12:26:58.354816 22592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:58.367434 22409 leader_election.cc:343] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.369446 22713 raft_consensus.cc:359] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.370390 22713 raft_consensus.cc:385] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.370640 22713 raft_consensus.cc:740] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.371553 22713 consensus_queue.cc:260] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.369231 22714 raft_consensus.cc:359] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.372705 22714 raft_consensus.cc:385] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.373070 22714 raft_consensus.cc:740] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.378515 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:58.379371 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:58.379492 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:58.379947 22444 raft_consensus.cc:3060] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.382094 22711 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:58.382309 22854 consensus_queue.cc:1048] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:58.384016 22410 leader_election.cc:343] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.384542 22410 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:58.385610 23048 raft_consensus.cc:2749] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.374385 22714 consensus_queue.cc:260] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.382614 22711 ts_tablet_manager.cc:1403] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.317s	user 0.025s	sys 0.048s
I20260709 12:26:58.387454 22714 ts_tablet_manager.cc:1434] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 12:26:58.387689 22821 raft_consensus.cc:493] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.388408 22714 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:58.388155 22821 raft_consensus.cc:515] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.389997 22821 leader_election.cc:290] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:58.389021 22711 raft_consensus.cc:359] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.394222 22711 raft_consensus.cc:385] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.394531 22711 raft_consensus.cc:740] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.395493 22711 consensus_queue.cc:260] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.397601 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323fb614c73f476e882fd71e0015db18" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.398689 22713 ts_tablet_manager.cc:1434] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 12:26:58.397603 22896 consensus_queue.cc:1048] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.399838 22713 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:58.394834 22971 leader_election.cc:290] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:58.405643 22444 raft_consensus.cc:2468] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
W20260709 12:26:58.408666 22559 leader_election.cc:343] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.410445 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323fb614c73f476e882fd71e0015db18" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:58.389547 22485 leader_election.cc:343] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.419942 22711 ts_tablet_manager.cc:1434] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:26:58.416620 22341 catalog_manager.cc:5697] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:58.433344 22559 leader_election.cc:343] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.433764 22559 leader_election.cc:304] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:58.434419 22768 raft_consensus.cc:2749] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.442075 22712 tablet_bootstrap.cc:492] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:58.442571 22712 ts_tablet_manager.cc:1403] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.016s
I20260709 12:26:58.443755 22711 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
W20260709 12:26:58.446060 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:58.437569 22483 leader_election.cc:304] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:58.456590 22519 raft_consensus.cc:3060] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.458134 22971 raft_consensus.cc:2804] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:58.458684 22971 raft_consensus.cc:697] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:58.459475 22971 consensus_queue.cc:237] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.473872 22590 raft_consensus.cc:3060] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.475106 22714 tablet_bootstrap.cc:654] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.480422 22713 tablet_bootstrap.cc:654] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.488159 22711 tablet_bootstrap.cc:654] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.505371 22786 raft_consensus.cc:493] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.506090 22786 raft_consensus.cc:515] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.520752 23047 raft_consensus.cc:493] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.521239 23047 raft_consensus.cc:515] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.523360 23047 leader_election.cc:290] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:58.525135 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2027b04cc47c4770a74b4e67e631780b" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.527993 22768 consensus_queue.cc:1048] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.527993 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2027b04cc47c4770a74b4e67e631780b" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:58.533226 22631 leader_election.cc:304] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:58.534606 23047 raft_consensus.cc:2749] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.544360 22786 leader_election.cc:290] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:58.546787 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:58.547953 22437 raft_consensus.cc:2468] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:58.549664 22483 leader_election.cc:304] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:58.552654 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:58.552814 22861 raft_consensus.cc:2804] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:58.553881 22861 raft_consensus.cc:493] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.554289 22861 raft_consensus.cc:3060] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.560882 22712 raft_consensus.cc:359] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.561594 22712 raft_consensus.cc:385] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.561842 22712 raft_consensus.cc:740] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.562567 22712 consensus_queue.cc:260] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.566371 22861 raft_consensus.cc:515] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.569636 22519 raft_consensus.cc:1240] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Rejecting Update request from peer b662aaf197d344acbc951b9da5cebf2b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:58.574222 22861 leader_election.cc:290] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:58.574123 22891 consensus_queue.cc:1048] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.582906 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:58.583974 22444 raft_consensus.cc:3060] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.588830 22768 consensus_queue.cc:1059] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:58.591176 22821 raft_consensus.cc:3055] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.591616 22821 raft_consensus.cc:740] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:58.592576 22821 consensus_queue.cc:260] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.593739 22821 raft_consensus.cc:3060] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.604899 23048 raft_consensus.cc:493] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.605597 23048 raft_consensus.cc:515] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.612754 22934 raft_consensus.cc:493] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.613945 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e50879db9d44aaaac554d982fb8377" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.614256 22934 raft_consensus.cc:515] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
W20260709 12:26:58.615727 22410 leader_election.cc:343] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.617017 23048 leader_election.cc:290] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:58.624878 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:58.627233 22341 catalog_manager.cc:5697] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:58.630436 22934 leader_election.cc:290] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:58.640987 22711 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:58.641656 22711 ts_tablet_manager.cc:1403] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.010s
I20260709 12:26:58.641902 22712 ts_tablet_manager.cc:1434] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.199s	user 0.003s	sys 0.002s
I20260709 12:26:58.642962 22712 tablet_bootstrap.cc:492] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:58.644277 22711 raft_consensus.cc:359] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.644989 22711 raft_consensus.cc:385] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.645493 22711 raft_consensus.cc:740] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.646302 22711 consensus_queue.cc:260] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.648406 22711 ts_tablet_manager.cc:1434] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:58.649780 22711 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:58.655397 22711 tablet_bootstrap.cc:654] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.659914 22444 raft_consensus.cc:2468] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 2.
I20260709 12:26:58.661155 22483 leader_election.cc:304] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:58.661934 22437 raft_consensus.cc:1240] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Rejecting Update request from peer b662aaf197d344acbc951b9da5cebf2b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:58.662032 22934 raft_consensus.cc:2804] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.664201 22714 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:58.669428 22714 ts_tablet_manager.cc:1403] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.281s	user 0.023s	sys 0.000s
I20260709 12:26:58.671428 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7825c613d9040b1bd0b0a76c9ab864e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:58.672341 22591 raft_consensus.cc:2410] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:26:58.673139 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be715b16cb41ebbc7dd26ce297706b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:58.673913 22589 raft_consensus.cc:2393] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:26:58.675453 22714 raft_consensus.cc:359] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.676107 22714 raft_consensus.cc:385] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.676355 22714 raft_consensus.cc:740] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.677291 22934 raft_consensus.cc:697] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:58.678222 22934 consensus_queue.cc:237] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.679646 22711 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:58.680109 22711 ts_tablet_manager.cc:1403] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.008s
I20260709 12:26:58.682204 22484 leader_election.cc:304] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:58.682652 22711 raft_consensus.cc:359] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.683017 22861 raft_consensus.cc:3060] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.683327 22711 raft_consensus.cc:385] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.683665 22711 raft_consensus.cc:740] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.686431 22711 consensus_queue.cc:260] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.687903 22711 ts_tablet_manager.cc:1434] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:58.689087 22711 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:58.690994 22861 raft_consensus.cc:2749] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.694626 22711 tablet_bootstrap.cc:654] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.695549 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e50879db9d44aaaac554d982fb8377" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:58.696908 22409 leader_election.cc:343] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.697449 22409 leader_election.cc:304] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:58.698453 23048 raft_consensus.cc:2749] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.699519 22714 consensus_queue.cc:260] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.702454 22714 ts_tablet_manager.cc:1434] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 12:26:58.704043 22712 tablet_bootstrap.cc:654] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.707957 22714 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:58.707988 22711 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:58.708591 22711 ts_tablet_manager.cc:1403] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:26:58.713107 22711 raft_consensus.cc:359] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.713717 22711 raft_consensus.cc:385] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.713984 22711 raft_consensus.cc:740] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.714679 22711 consensus_queue.cc:260] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.716434 22711 ts_tablet_manager.cc:1434] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:26:58.716997 22713 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:58.717532 22713 ts_tablet_manager.cc:1403] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.318s	user 0.013s	sys 0.010s
I20260709 12:26:58.722852 22711 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:58.728603 22714 tablet_bootstrap.cc:654] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.731458 22712 tablet_bootstrap.cc:492] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:58.732015 22712 ts_tablet_manager.cc:1403] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.001s
I20260709 12:26:58.732653 22711 tablet_bootstrap.cc:654] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.743326 22768 raft_consensus.cc:493] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.743953 22714 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:58.743798 22768 raft_consensus.cc:515] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.752125 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.757225 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:58.757848 22444 raft_consensus.cc:2468] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:58.758612 22342 catalog_manager.cc:5697] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:58.759388 22559 leader_election.cc:343] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.760456 22557 leader_election.cc:304] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:58.761895 22891 raft_consensus.cc:2804] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.762396 22891 raft_consensus.cc:493] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.762815 22891 raft_consensus.cc:3060] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.763252 22768 leader_election.cc:290] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:58.769579 22666 raft_consensus.cc:3060] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.785259 22714 ts_tablet_manager.cc:1403] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.011s
I20260709 12:26:58.786558 22712 raft_consensus.cc:359] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.787549 22712 raft_consensus.cc:385] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.787904 22712 raft_consensus.cc:740] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.788725 22712 consensus_queue.cc:260] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:58.788679 22714 raft_consensus.cc:359] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.791256 22712 ts_tablet_manager.cc:1434] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:26:58.793355 23047 consensus_queue.cc:1048] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.794379 22712 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:58.800827 22714 raft_consensus.cc:385] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.801251 22714 raft_consensus.cc:740] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.801885 22714 consensus_queue.cc:260] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.804565 22714 ts_tablet_manager.cc:1434] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:26:58.809650 22714 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:58.800534 22712 tablet_bootstrap.cc:654] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.817063 23020 consensus_queue.cc:1048] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.818295 22714 tablet_bootstrap.cc:654] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.850044 22713 raft_consensus.cc:359] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.851083 22713 raft_consensus.cc:385] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.854383 22713 raft_consensus.cc:740] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.886525 22666 raft_consensus.cc:3060] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.907107 23048 raft_consensus.cc:493] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.907879 23048 raft_consensus.cc:515] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.909315 22713 consensus_queue.cc:260] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:58.911751 22934 consensus_queue.cc:1048] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.915199 22713 ts_tablet_manager.cc:1434] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.197s	user 0.007s	sys 0.000s
I20260709 12:26:58.916174 22713 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:58.923311 23048 leader_election.cc:290] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:58.924253 22713 tablet_bootstrap.cc:654] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.924157 22891 raft_consensus.cc:515] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.924857 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:58.927976 22891 leader_election.cc:290] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:58.928263 22711 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
W20260709 12:26:58.928433 22409 leader_election.cc:343] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.928704 22711 ts_tablet_manager.cc:1403] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.206s	user 0.070s	sys 0.107s
I20260709 12:26:58.929281 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:58.929930 22444 raft_consensus.cc:3060] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.933348 22712 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:58.933790 22712 ts_tablet_manager.cc:1403] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.037s
I20260709 12:26:58.933729 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
W20260709 12:26:58.935438 22559 leader_election.cc:343] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.936435 22712 raft_consensus.cc:359] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.937112 22712 raft_consensus.cc:385] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.937433 22712 raft_consensus.cc:740] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.938055 22712 consensus_queue.cc:260] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.938208 22711 raft_consensus.cc:359] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.938803 22711 raft_consensus.cc:385] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.939061 22711 raft_consensus.cc:740] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.940094 22712 ts_tablet_manager.cc:1434] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:58.939749 22711 consensus_queue.cc:260] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.940990 22712 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:58.941996 22711 ts_tablet_manager.cc:1434] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:26:58.946705 22711 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:58.946966 22712 tablet_bootstrap.cc:654] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.951143 22713 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:58.951586 22713 ts_tablet_manager.cc:1403] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:26:58.952369 22711 tablet_bootstrap.cc:654] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.954114 22713 raft_consensus.cc:359] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.954785 22713 raft_consensus.cc:385] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.955075 22713 raft_consensus.cc:740] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.925624 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.955924 22713 consensus_queue.cc:260] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.959444 22934 consensus_queue.cc:1048] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:58.962044 22410 leader_election.cc:343] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.962478 22410 leader_election.cc:304] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:58.963763 22885 raft_consensus.cc:2749] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.964210 22714 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:58.964905 22714 ts_tablet_manager.cc:1403] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.160s	user 0.022s	sys 0.026s
I20260709 12:26:58.966538 22713 ts_tablet_manager.cc:1434] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:58.967595 22713 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:58.967939 22714 raft_consensus.cc:359] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.968678 22714 raft_consensus.cc:385] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.969012 22714 raft_consensus.cc:740] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.969673 22714 consensus_queue.cc:260] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.971977 22714 ts_tablet_manager.cc:1434] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:26:58.978534 22713 tablet_bootstrap.cc:654] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.979770 22891 raft_consensus.cc:493] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.980252 22891 raft_consensus.cc:515] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:58.982375 22891 leader_election.cc:290] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:58.983757 22885 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.984221 22885 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:58.984651 22714 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:58.986225 22885 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:58.986274 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e50879db9d44aaaac554d982fb8377" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:58.989559 22516 raft_consensus.cc:2468] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:58.990105 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e50879db9d44aaaac554d982fb8377" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:58.990676 22443 raft_consensus.cc:2468] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:58.990937 22559 leader_election.cc:304] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:58.993779 22821 raft_consensus.cc:2804] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.993965 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:58.994705 22714 tablet_bootstrap.cc:654] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.994797 22663 raft_consensus.cc:2468] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 0.
I20260709 12:26:58.994128 22821 raft_consensus.cc:493] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.995502 22821 raft_consensus.cc:3060] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.005371 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.008118 22410 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:59.009227 23048 raft_consensus.cc:2804] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.009621 23048 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.009995 23048 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:59.010541 22410 leader_election.cc:343] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.010908 22444 raft_consensus.cc:2468] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.005352 22711 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:59.012303 22557 leader_election.cc:304] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.013653 22891 raft_consensus.cc:2804] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.014972 22891 raft_consensus.cc:697] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.015983 22891 consensus_queue.cc:237] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.036449 22711 ts_tablet_manager.cc:1403] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.005s
I20260709 12:26:59.030557 22821 raft_consensus.cc:515] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.039628 22711 raft_consensus.cc:359] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.041836 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e50879db9d44aaaac554d982fb8377" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.040474 22711 raft_consensus.cc:385] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.042443 22443 raft_consensus.cc:3060] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.042629 22711 raft_consensus.cc:740] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.043367 22711 consensus_queue.cc:260] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.047583 22711 ts_tablet_manager.cc:1434] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:59.051343 22443 raft_consensus.cc:2468] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.069816 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e50879db9d44aaaac554d982fb8377" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:59.070605 22518 raft_consensus.cc:3060] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.071345 22711 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:59.074168 22557 leader_election.cc:304] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.076804 22721 raft_consensus.cc:2804] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.084772 22713 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.085299 22713 ts_tablet_manager.cc:1403] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.028s
I20260709 12:26:59.087832 22713 raft_consensus.cc:359] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.088497 22713 raft_consensus.cc:385] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.088759 22713 raft_consensus.cc:740] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.093636 22821 leader_election.cc:290] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.094450 22713 consensus_queue.cc:260] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.095700 22518 raft_consensus.cc:2468] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.105104 22885 raft_consensus.cc:493] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.105724 22885 raft_consensus.cc:515] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.109215 22713 ts_tablet_manager.cc:1434] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:26:59.111027 22342 catalog_manager.cc:5697] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.117957 22885 leader_election.cc:290] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.098575 23048 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.124225 22721 raft_consensus.cc:697] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.125015 22821 raft_consensus.cc:493] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.125730 22713 tablet_bootstrap.cc:492] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:59.125552 22821 raft_consensus.cc:515] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.125083 22721 consensus_queue.cc:237] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.127645 23020 raft_consensus.cc:493] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.128168 23020 raft_consensus.cc:515] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.129166 22821 leader_election.cc:290] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.130352 23020 leader_election.cc:290] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.131431 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.131937 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.132041 22443 raft_consensus.cc:2468] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:59.121132 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.135560 22631 leader_election.cc:304] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:26:59.135726 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.136337 22667 raft_consensus.cc:2468] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.139918 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.140514 22443 raft_consensus.cc:2468] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.140544 22559 leader_election.cc:304] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.142977 22711 tablet_bootstrap.cc:654] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.132647 22589 raft_consensus.cc:2468] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:59.144701 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.147097 23048 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
W20260709 12:26:59.144990 22409 leader_election.cc:343] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.163635 22410 leader_election.cc:343] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.164026 22410 leader_election.cc:304] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:59.165055 23048 raft_consensus.cc:2749] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.151243 22713 tablet_bootstrap.cc:654] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.153620 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:59.166280 22667 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.154368 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:59.142127 23020 raft_consensus.cc:2804] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.158005 22714 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:59.173273 22714 ts_tablet_manager.cc:1403] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.189s	user 0.021s	sys 0.014s
W20260709 12:26:59.175314 22410 leader_election.cc:343] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.172621 23020 raft_consensus.cc:493] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.180627 23020 raft_consensus.cc:3060] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.160036 22340 catalog_manager.cc:5697] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.158568 22712 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:59.184652 22712 ts_tablet_manager.cc:1403] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.244s	user 0.012s	sys 0.049s
I20260709 12:26:59.186084 22721 raft_consensus.cc:2804] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.188383 22721 raft_consensus.cc:493] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.189312 22721 raft_consensus.cc:3060] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.196420 23048 raft_consensus.cc:493] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.197011 22437 raft_consensus.cc:1275] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:59.201526 23077 consensus_queue.cc:1048] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.197055 23048 raft_consensus.cc:515] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.237959 23048 leader_election.cc:290] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:59.238241 23020 raft_consensus.cc:515] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.239878 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.243296 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:59.244604 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
W20260709 12:26:59.244763 22409 leader_election.cc:343] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.246363 22714 raft_consensus.cc:359] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.247059 22714 raft_consensus.cc:385] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.247344 22714 raft_consensus.cc:740] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.247839 22721 raft_consensus.cc:515] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.251597 22589 raft_consensus.cc:2393] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1704a791486d41aca21c226c48b00d89 in current term 1: Already voted for candidate b662aaf197d344acbc951b9da5cebf2b in this term.
I20260709 12:26:59.256592 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.257154 22438 raft_consensus.cc:3060] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.262946 22667 raft_consensus.cc:2468] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 1.
I20260709 12:26:59.263725 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:59.264303 22721 leader_election.cc:290] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.264530 22663 raft_consensus.cc:2393] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b662aaf197d344acbc951b9da5cebf2b in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
W20260709 12:26:59.246377 22410 leader_election.cc:343] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.265303 22410 leader_election.cc:304] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:59.266431 22589 raft_consensus.cc:1275] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:26:59.266901 22589 pending_rounds.cc:85] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: Aborting all ops after (but not including) 0
I20260709 12:26:59.266455 22711 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:59.267220 22589 pending_rounds.cc:107] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:59.267114 22410 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.267918 22589 raft_consensus.cc:2889] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:59.267742 22711 ts_tablet_manager.cc:1403] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.219s	user 0.042s	sys 0.056s
I20260709 12:26:59.268153 23097 raft_consensus.cc:2749] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.268988 23097 raft_consensus.cc:2804] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.269434 23097 raft_consensus.cc:697] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:26:59.269968 22713 tablet_bootstrap.cc:492] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.269908 23077 consensus_queue.cc:1048] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:59.270556 22713 ts_tablet_manager.cc:1403] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.000s
I20260709 12:26:59.270202 23097 consensus_queue.cc:237] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.270937 22711 raft_consensus.cc:359] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.271757 22711 raft_consensus.cc:385] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.272017 22711 raft_consensus.cc:740] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.272631 22711 consensus_queue.cc:260] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.274205 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2354de9b29b94e98875230231b43cf19" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.274678 22711 ts_tablet_manager.cc:1434] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:59.275722 22711 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:26:59.275786 22631 leader_election.cc:304] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:59.276684 23020 leader_election.cc:290] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.277282 23047 raft_consensus.cc:2749] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.278796 22713 raft_consensus.cc:359] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.279474 22713 raft_consensus.cc:385] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.279820 22713 raft_consensus.cc:740] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.247956 22712 raft_consensus.cc:359] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.263847 22438 raft_consensus.cc:2468] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.283197 22712 raft_consensus.cc:385] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.283197 22861 raft_consensus.cc:493] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.285969 22861 raft_consensus.cc:515] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.286221 22557 leader_election.cc:304] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:59.287277 23098 raft_consensus.cc:2804] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.287725 23098 raft_consensus.cc:697] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.288472 23098 consensus_queue.cc:237] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.293370 22861 leader_election.cc:290] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.293550 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323fb614c73f476e882fd71e0015db18" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.248747 22714 consensus_queue.cc:260] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.295028 22712 raft_consensus.cc:740] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.298406 22712 consensus_queue.cc:260] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.300772 22713 consensus_queue.cc:260] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.303921 22714 ts_tablet_manager.cc:1434] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.130s	user 0.007s	sys 0.000s
I20260709 12:26:59.306476 22712 ts_tablet_manager.cc:1434] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:26:59.307770 22712 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:59.313668 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323fb614c73f476e882fd71e0015db18" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.315930 22713 ts_tablet_manager.cc:1434] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:26:59.314023 22340 catalog_manager.cc:5697] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 1 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.310077 22589 raft_consensus.cc:2468] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:59.331791 22713 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:59.332070 23077 raft_consensus.cc:493] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:59.329957 22485 leader_election.cc:343] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.342512 22714 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:59.348976 22484 leader_election.cc:304] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:59.349849 22861 raft_consensus.cc:2804] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.350224 22861 raft_consensus.cc:493] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.350572 22861 raft_consensus.cc:3060] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.350838 22711 tablet_bootstrap.cc:654] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.342720 23077 raft_consensus.cc:515] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.353718 23077 leader_election.cc:290] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:59.354712 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.354712 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.357834 22437 raft_consensus.cc:2393] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 in current term 1: Already voted for candidate b662aaf197d344acbc951b9da5cebf2b in this term.
I20260709 12:26:59.359583 22483 leader_election.cc:304] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:59.363348 22786 raft_consensus.cc:3060] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.368952 23048 raft_consensus.cc:493] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.372344 23048 raft_consensus.cc:515] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.379316 22712 tablet_bootstrap.cc:654] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.383890 22713 tablet_bootstrap.cc:654] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.387960 22861 raft_consensus.cc:515] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.388478 22714 tablet_bootstrap.cc:654] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.398420 23048 leader_election.cc:290] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.399621 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.400877 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.405117 22712 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:59.434816 22712 ts_tablet_manager.cc:1403] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.127s	user 0.020s	sys 0.003s
I20260709 12:26:59.437485 22712 raft_consensus.cc:359] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.439882 22712 raft_consensus.cc:385] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.440158 22712 raft_consensus.cc:740] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.440769 22712 consensus_queue.cc:260] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.444152 22712 ts_tablet_manager.cc:1434] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:59.445470 22712 tablet_bootstrap.cc:492] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
W20260709 12:26:59.436029 22410 leader_election.cc:343] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.450292 22410 leader_election.cc:343] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.450735 22410 leader_election.cc:304] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.451969 23048 raft_consensus.cc:2749] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.456473 22711 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: No bootstrap required, opened a new log
I20260709 12:26:59.409966 22786 raft_consensus.cc:2749] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.405424 22341 catalog_manager.cc:5697] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.459759 22861 leader_election.cc:290] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.457072 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323fb614c73f476e882fd71e0015db18" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:59.459956 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323fb614c73f476e882fd71e0015db18" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:59.465158 22593 raft_consensus.cc:3060] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:59.466085 22485 leader_election.cc:343] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.467375 22714 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:59.467820 22714 ts_tablet_manager.cc:1403] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.012s
I20260709 12:26:59.456969 22711 ts_tablet_manager.cc:1403] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.181s	user 0.031s	sys 0.033s
I20260709 12:26:59.472328 22593 raft_consensus.cc:2468] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:26:59.473443 22484 leader_election.cc:304] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:59.474220 23077 raft_consensus.cc:2804] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.474725 23077 raft_consensus.cc:697] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:26:59.475585 23077 consensus_queue.cc:237] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.474802 22714 raft_consensus.cc:359] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.478649 22714 raft_consensus.cc:385] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.478907 22714 raft_consensus.cc:740] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.479669 22714 consensus_queue.cc:260] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.480764 22711 raft_consensus.cc:359] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.483050 22711 raft_consensus.cc:385] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.483768 22711 raft_consensus.cc:740] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.484380 22711 consensus_queue.cc:260] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.482570 22713 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.483328 23020 raft_consensus.cc:493] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.485366 23020 raft_consensus.cc:515] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.486246 22714 ts_tablet_manager.cc:1434] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:59.487182 22714 tablet_bootstrap.cc:492] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:59.487226 23020 leader_election.cc:290] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.488298 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.488631 22713 ts_tablet_manager.cc:1403] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.157s	user 0.029s	sys 0.015s
I20260709 12:26:59.487828 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.491377 22437 raft_consensus.cc:2468] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:59.464561 22712 tablet_bootstrap.cc:654] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:59.489811 22633 leader_election.cc:343] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.493460 23020 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.493978 23020 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.496644 23020 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.497048 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.497824 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
W20260709 12:26:59.498420 22632 leader_election.cc:343] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.498623 22438 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 0.
I20260709 12:26:59.501453 22631 leader_election.cc:304] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.502519 22711 ts_tablet_manager.cc:1434] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:26:59.502694 22631 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:59.503897 22713 raft_consensus.cc:359] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.504552 22713 raft_consensus.cc:385] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.503914 22854 raft_consensus.cc:2804] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.505314 22854 raft_consensus.cc:493] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.505688 22854 raft_consensus.cc:3060] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.504804 22713 raft_consensus.cc:740] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.509639 22713 consensus_queue.cc:260] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.511783 22713 ts_tablet_manager.cc:1434] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:26:59.513384 22713 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:59.513762 23020 raft_consensus.cc:2804] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.514254 23020 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.516040 22340 catalog_manager.cc:5697] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.518792 22713 tablet_bootstrap.cc:654] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.528404 22712 tablet_bootstrap.cc:492] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:59.533293 22713 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.533742 22713 ts_tablet_manager.cc:1403] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 12:26:59.536307 22713 raft_consensus.cc:359] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.538074 22768 raft_consensus.cc:493] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.538586 22768 raft_consensus.cc:515] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.528900 22712 ts_tablet_manager.cc:1403] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.002s
I20260709 12:26:59.543105 22712 raft_consensus.cc:359] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.543792 22712 raft_consensus.cc:385] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.544104 22712 raft_consensus.cc:740] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.545523 22768 leader_election.cc:290] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.536912 22713 raft_consensus.cc:385] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.546386 22713 raft_consensus.cc:740] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.547145 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.547041 22713 consensus_queue.cc:260] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.548722 22713 ts_tablet_manager.cc:1434] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
W20260709 12:26:59.548964 22559 leader_election.cc:343] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.549633 22713 tablet_bootstrap.cc:492] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:59.549517 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.550269 22438 raft_consensus.cc:2468] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.550472 22854 raft_consensus.cc:515] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.553392 22557 leader_election.cc:304] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.554385 22768 raft_consensus.cc:2804] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.563176 22891 consensus_queue.cc:1048] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:59.565388 22390 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:59.565979 23098 consensus_queue.cc:1048] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.566382 22768 raft_consensus.cc:493] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.567675 23048 raft_consensus.cc:493] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.568023 22768 raft_consensus.cc:3060] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.568271 23048 raft_consensus.cc:515] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.570583 23048 leader_election.cc:290] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.573452 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:59.574877 22410 leader_election.cc:343] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.576465 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:26:59.578275 22409 leader_election.cc:343] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.578755 22409 leader_election.cc:304] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:26:59.579599 22713 tablet_bootstrap.cc:654] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.579741 23097 raft_consensus.cc:2749] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.548990 23020 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.589681 22891 raft_consensus.cc:493] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.590157 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.590873 22437 raft_consensus.cc:3060] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.590132 22891 raft_consensus.cc:515] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.592010 22854 leader_election.cc:290] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.592724 22891 leader_election.cc:290] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.594544 22714 tablet_bootstrap.cc:654] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.592965 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:59.594064 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9971a97d734f6195685a52c3a70d69" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.594205 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9971a97d734f6195685a52c3a70d69" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:59.595798 22633 leader_election.cc:343] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.595798 22559 leader_election.cc:343] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.590091 22821 consensus_queue.cc:1048] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:59.596735 22559 leader_election.cc:343] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.597203 22559 leader_election.cc:304] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.598104 22821 raft_consensus.cc:2749] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.603941 22713 tablet_bootstrap.cc:492] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.604493 22713 ts_tablet_manager.cc:1403] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:26:59.544767 22712 consensus_queue.cc:260] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.607093 22713 raft_consensus.cc:359] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.607772 22713 raft_consensus.cc:385] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.608047 22713 raft_consensus.cc:740] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.609586 22437 raft_consensus.cc:2468] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:59.612118 22631 leader_election.cc:304] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.612946 22854 raft_consensus.cc:2804] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.613451 22713 consensus_queue.cc:260] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.613656 22854 raft_consensus.cc:697] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:59.615456 22713 ts_tablet_manager.cc:1434] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:59.614699 22854 consensus_queue.cc:237] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.616739 22713 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:59.622180 22713 tablet_bootstrap.cc:654] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.632524 23098 raft_consensus.cc:493] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.633056 23098 raft_consensus.cc:515] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.635118 23098 leader_election.cc:290] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.637924 22721 consensus_queue.cc:1048] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.641700 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:59.642978 22559 leader_election.cc:343] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.643402 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.643990 22443 raft_consensus.cc:2468] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.650398 22557 leader_election.cc:304] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:59.651132 23098 raft_consensus.cc:2804] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.651527 23098 raft_consensus.cc:493] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.651865 23098 raft_consensus.cc:3060] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.657400 22713 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.657888 22713 ts_tablet_manager.cc:1403] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 12:26:59.625169 22712 ts_tablet_manager.cc:1434] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 12:26:59.660643 22712 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:59.692557 23020 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.695389 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:26:59.700961 22712 tablet_bootstrap.cc:654] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.702060 23020 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.663300 22713 raft_consensus.cc:359] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.745877 22713 raft_consensus.cc:385] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.746191 22713 raft_consensus.cc:740] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.746898 22713 consensus_queue.cc:260] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.748088 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.748713 22438 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.748886 22713 ts_tablet_manager.cc:1434] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.001s
I20260709 12:26:59.751233 22714 tablet_bootstrap.cc:492] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:59.749238 22593 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.763937 22713 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: Bootstrap starting.
I20260709 12:26:59.672896 22821 consensus_queue.cc:1048] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.095s
I20260709 12:26:59.770143 22713 tablet_bootstrap.cc:654] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.672222 23098 raft_consensus.cc:515] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.749755 22341 catalog_manager.cc:5697] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.774995 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
W20260709 12:26:59.776357 22559 leader_election.cc:343] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.763790 22714 ts_tablet_manager.cc:1403] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.277s	user 0.032s	sys 0.074s
I20260709 12:26:59.778033 22721 consensus_queue.cc:1048] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.779560 22714 raft_consensus.cc:359] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.780256 22714 raft_consensus.cc:385] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.780542 23098 leader_election.cc:290] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.780521 22714 raft_consensus.cc:740] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.781828 22714 consensus_queue.cc:260] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.781865 22437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.782842 22437 raft_consensus.cc:3060] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.784118 22714 ts_tablet_manager.cc:1434] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:59.785105 22714 tablet_bootstrap.cc:492] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:59.785771 22713 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: No bootstrap required, opened a new log
I20260709 12:26:59.786306 22713 ts_tablet_manager.cc:1403] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 12:26:59.789125 22713 raft_consensus.cc:359] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.789788 22713 raft_consensus.cc:385] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.790163 22713 raft_consensus.cc:740] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.790959 22713 consensus_queue.cc:260] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.793017 22713 ts_tablet_manager.cc:1434] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:59.662000 22768 raft_consensus.cc:515] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.802503 22437 raft_consensus.cc:2468] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.804028 22557 leader_election.cc:304] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89
I20260709 12:26:59.804839 22721 raft_consensus.cc:2804] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.805375 22721 raft_consensus.cc:697] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.802572 22593 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:59.806376 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.806958 22444 raft_consensus.cc:3060] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.808044 22768 leader_election.cc:290] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.806414 22891 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.809827 22891 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.811564 22714 tablet_bootstrap.cc:654] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:59.820122 22410 consensus_peers.cc:597] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:59.820657 22821 raft_consensus.cc:493] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.821148 22821 raft_consensus.cc:515] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.822912 22821 leader_election.cc:290] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.825317 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.825336 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:59.826016 22442 raft_consensus.cc:2468] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.827546 22557 leader_election.cc:304] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.828613 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:59.830137 22559 leader_election.cc:343] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.833142 22559 leader_election.cc:343] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.833199 23098 raft_consensus.cc:2804] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.840853 23098 raft_consensus.cc:493] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.841301 23098 raft_consensus.cc:3060] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.842172 22712 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:26:59.842670 22712 ts_tablet_manager.cc:1403] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.182s	user 0.028s	sys 0.017s
I20260709 12:26:59.842739 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.845443 22712 raft_consensus.cc:359] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.846117 22712 raft_consensus.cc:385] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.846398 22712 raft_consensus.cc:740] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.847282 22667 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.835820 22442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.840328 22438 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:26:59.834134 22891 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.835587 22444 raft_consensus.cc:2468] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.806191 22721 consensus_queue.cc:237] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.850538 22559 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.852212 22891 raft_consensus.cc:2804] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:59.852634 22891 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.853052 22891 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.856874 23098 raft_consensus.cc:515] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.858565 22557 leader_election.cc:304] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.859342 22768 raft_consensus.cc:2804] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.859771 22768 raft_consensus.cc:697] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.859874 22632 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.860765 22854 raft_consensus.cc:2804] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.862632 22854 raft_consensus.cc:697] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:26:59.863431 22854 consensus_queue.cc:237] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.864665 23098 leader_election.cc:290] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.865226 23098 raft_consensus.cc:493] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.865661 23098 raft_consensus.cc:515] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.860533 22768 consensus_queue.cc:237] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.867511 23098 leader_election.cc:290] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.847955 22712 consensus_queue.cc:260] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.870266 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.870919 22444 raft_consensus.cc:3060] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.872161 22891 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.879153 22444 raft_consensus.cc:2468] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.880035 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:26:59.880259 22557 leader_election.cc:304] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.880628 22438 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:59.881249 22721 raft_consensus.cc:2804] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.881736 22721 raft_consensus.cc:697] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.885442 22342 catalog_manager.cc:5697] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 1 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.890224 22891 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.889178 22438 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 2.
I20260709 12:26:59.889703 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:59.891716 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337431b8a27e4b17ac0a96ce4f9bfa1f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.892352 22519 raft_consensus.cc:2468] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.892324 22721 consensus_queue.cc:237] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.893275 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337431b8a27e4b17ac0a96ce4f9bfa1f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.893895 22663 raft_consensus.cc:2468] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.895676 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:59.896962 22557 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.900542 23048 consensus_queue.cc:1048] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.900873 22768 raft_consensus.cc:2804] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:59.900987 22712 ts_tablet_manager.cc:1434] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:26:59.896185 22714 tablet_bootstrap.cc:492] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:26:59.901404 22768 raft_consensus.cc:697] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:26:59.901779 22714 ts_tablet_manager.cc:1403] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 12:26:59.902137 22768 consensus_queue.cc:237] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:26:59.904466 22714 raft_consensus.cc:359] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.905172 22714 raft_consensus.cc:385] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.905503 22714 raft_consensus.cc:740] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.906005 23048 raft_consensus.cc:493] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.906237 22714 consensus_queue.cc:260] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.906520 23048 raft_consensus.cc:515] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.906875 22341 catalog_manager.cc:5697] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.908389 22714 ts_tablet_manager.cc:1434] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:59.908468 23048 leader_election.cc:290] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
W20260709 12:26:59.899148 22559 leader_election.cc:343] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.909435 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf3648f5b74bf6a70e11f336dc788e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.909693 22559 leader_election.cc:304] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.910427 23098 raft_consensus.cc:2804] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.910784 23098 raft_consensus.cc:493] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.911092 23098 raft_consensus.cc:3060] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.911374 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf3648f5b74bf6a70e11f336dc788e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
W20260709 12:26:59.912763 22410 leader_election.cc:343] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.913439 22410 leader_election.cc:343] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.913798 22410 leader_election.cc:304] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d; no voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868
I20260709 12:26:59.914752 23048 raft_consensus.cc:2749] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.916813 22665 raft_consensus.cc:3060] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.926826 22712 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:26:59.930310 22861 raft_consensus.cc:493] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.930876 22861 raft_consensus.cc:515] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.934450 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.935040 22444 raft_consensus.cc:2468] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:59.938535 22483 leader_election.cc:304] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:26:59.938776 22891 raft_consensus.cc:493] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.939375 23077 raft_consensus.cc:2804] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.939245 22891 raft_consensus.cc:515] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:26:59.939781 23077 raft_consensus.cc:493] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.940140 23077 raft_consensus.cc:3060] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.941381 22891 leader_election.cc:290] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:26:59.924480 23098 raft_consensus.cc:515] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:26:59.944325 23098 leader_election.cc:290] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:26:59.946175 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:26:59.947067 22714 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:26:59.947077 22593 raft_consensus.cc:2468] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:26:59.948189 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337431b8a27e4b17ac0a96ce4f9bfa1f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:26:59.948768 22666 raft_consensus.cc:3060] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.949656 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.950450 22444 raft_consensus.cc:2468] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 0.
I20260709 12:26:59.951826 22712 tablet_bootstrap.cc:654] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.953755 22557 leader_election.cc:304] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:26:59.955185 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:26:59.956549 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337431b8a27e4b17ac0a96ce4f9bfa1f" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:26:59.957335 22516 raft_consensus.cc:3060] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.959709 22714 tablet_bootstrap.cc:654] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.960022 22786 consensus_queue.cc:1048] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.959888 22342 catalog_manager.cc:5697] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.967178 22342 catalog_manager.cc:5697] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.968626 22342 catalog_manager.cc:5697] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 1 to 2, leader changed from 1704a791486d41aca21c226c48b00d89 (127.14.78.68) to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 2 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.972677 23098 raft_consensus.cc:2804] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.973134 23098 raft_consensus.cc:493] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.973464 23098 raft_consensus.cc:3060] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.978190 22861 leader_election.cc:290] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:26:59.986615 22516 raft_consensus.cc:2468] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:26:59.993256 22786 raft_consensus.cc:493] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.993783 22786 raft_consensus.cc:515] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:26:59.995760 22786 leader_election.cc:290] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:26:59.997483 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:26:59.997879 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00fa50014add43a18981a5a1af88f89c" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:26:59.998565 22444 raft_consensus.cc:2393] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 in current term 1: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:26:59.999825 22483 leader_election.cc:304] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:00.001475 22786 raft_consensus.cc:3060] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.002750 22559 leader_election.cc:304] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:00.003691 22721 raft_consensus.cc:2804] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.005687 22721 raft_consensus.cc:697] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:00.006497 22721 consensus_queue.cc:237] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.006899 22666 raft_consensus.cc:2468] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:27:00.027477 22786 raft_consensus.cc:2749] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.011484 23098 raft_consensus.cc:515] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:00.014834 22712 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:27:00.028667 22712 ts_tablet_manager.cc:1403] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.008s
I20260709 12:27:00.029875 23098 leader_election.cc:290] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:00.031525 22712 raft_consensus.cc:359] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.032212 22712 raft_consensus.cc:385] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.032471 22712 raft_consensus.cc:740] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.033182 22712 consensus_queue.cc:260] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.023041 22342 catalog_manager.cc:5697] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.026101 22854 consensus_queue.cc:1048] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.035130 23020 consensus_queue.cc:1048] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.037266 22712 ts_tablet_manager.cc:1434] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:00.038208 22712 tablet_bootstrap.cc:492] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:27:00.048285 23077 raft_consensus.cc:515] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:00.052523 22519 raft_consensus.cc:2393] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b662aaf197d344acbc951b9da5cebf2b in current term 1: Already voted for candidate b3766de80037442fbcfbef7158ad1868 in this term.
I20260709 12:27:00.055970 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:00.056635 22519 raft_consensus.cc:2393] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b662aaf197d344acbc951b9da5cebf2b in current term 1: Already voted for candidate b3766de80037442fbcfbef7158ad1868 in this term.
I20260709 12:27:00.056672 22712 tablet_bootstrap.cc:654] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.049702 22438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:00.057375 22438 raft_consensus.cc:3060] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.063721 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:00.094713 22438 raft_consensus.cc:2468] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:27:00.096412 22557 leader_election.cc:304] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:00.097626 23098 raft_consensus.cc:2804] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.098094 23098 raft_consensus.cc:697] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:00.098873 23098 consensus_queue.cc:237] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:00.121348 23077 leader_election.cc:290] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:00.137069 23077 consensus_queue.cc:1048] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.141736 22714 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:27:00.142266 22714 ts_tablet_manager.cc:1403] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.195s	user 0.030s	sys 0.038s
I20260709 12:27:00.144958 22714 raft_consensus.cc:359] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.145607 22714 raft_consensus.cc:385] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.145650 22593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b957090ae4e240fdbd7eeca1dc5f62fd" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:00.145915 22714 raft_consensus.cc:740] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.148923 22712 tablet_bootstrap.cc:492] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:27:00.149629 22712 ts_tablet_manager.cc:1403] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.014s
I20260709 12:27:00.152757 22712 raft_consensus.cc:359] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.153394 22712 raft_consensus.cc:385] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.153643 22712 raft_consensus.cc:740] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.153788 22861 raft_consensus.cc:493] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.154217 22861 raft_consensus.cc:515] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.154363 22714 consensus_queue.cc:260] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.155975 22861 leader_election.cc:290] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:00.158221 22443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf3648f5b74bf6a70e11f336dc788e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:00.158807 22443 raft_consensus.cc:2468] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:27:00.159271 22664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf3648f5b74bf6a70e11f336dc788e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:27:00.159915 22664 raft_consensus.cc:2468] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:27:00.160282 22714 ts_tablet_manager.cc:1434] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:27:00.161232 22714 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:27:00.160100 22483 leader_election.cc:304] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:00.162732 22339 catalog_manager.cc:5697] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 0 to 1, leader changed from <none> to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 1 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.163986 22712 consensus_queue.cc:260] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.165088 23145 raft_consensus.cc:2804] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.165442 23145 raft_consensus.cc:493] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.165627 22712 ts_tablet_manager.cc:1434] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:27:00.165738 23145 raft_consensus.cc:3060] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.169466 22484 leader_election.cc:304] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:27:00.184903 22861 raft_consensus.cc:2749] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.177850 22714 tablet_bootstrap.cc:654] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.187729 22712 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:27:00.194429 23145 raft_consensus.cc:515] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.195188 22712 tablet_bootstrap.cc:654] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.197592 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf3648f5b74bf6a70e11f336dc788e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:00.198171 22666 raft_consensus.cc:3060] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.211663 22666 raft_consensus.cc:2468] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:27:00.214018 22485 leader_election.cc:304] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:00.217113 23077 raft_consensus.cc:2804] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.220634 23077 raft_consensus.cc:697] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:00.221740 23077 consensus_queue.cc:237] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.226791 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bf3648f5b74bf6a70e11f336dc788e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:00.227442 22444 raft_consensus.cc:3060] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.231043 22712 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:27:00.231634 22712 ts_tablet_manager.cc:1403] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.044s	user 0.029s	sys 0.012s
I20260709 12:27:00.233160 23145 leader_election.cc:290] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:00.234314 22712 raft_consensus.cc:359] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:00.234984 22712 raft_consensus.cc:385] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.235249 22712 raft_consensus.cc:740] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.236099 22712 consensus_queue.cc:260] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:00.237670 22712 ts_tablet_manager.cc:1434] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:27:00.239348 22444 raft_consensus.cc:2468] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:27:00.253746 22712 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: Bootstrap starting.
I20260709 12:27:00.255932 22714 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:27:00.256424 22714 ts_tablet_manager.cc:1403] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.014s
I20260709 12:27:00.260227 22712 tablet_bootstrap.cc:654] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.259591 22342 catalog_manager.cc:5697] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.262336 23098 consensus_queue.cc:1048] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.264411 22714 raft_consensus.cc:359] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:00.265128 22714 raft_consensus.cc:385] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.265403 22714 raft_consensus.cc:740] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.266161 22714 consensus_queue.cc:260] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:00.267614 22519 raft_consensus.cc:3060] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.278723 22712 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: No bootstrap required, opened a new log
I20260709 12:27:00.279240 22712 ts_tablet_manager.cc:1403] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 12:27:00.281970 22712 raft_consensus.cc:359] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:00.282555 22712 raft_consensus.cc:385] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.282801 22712 raft_consensus.cc:740] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.283432 22712 consensus_queue.cc:260] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
W20260709 12:27:00.285712 22559 consensus_peers.cc:597] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b -> Peer 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965): Couldn't send request to peer 1704a791486d41aca21c226c48b00d89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:00.287868 22714 ts_tablet_manager.cc:1434] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:27:00.291648 22712 ts_tablet_manager.cc:1434] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:27:00.294046 22821 consensus_queue.cc:1048] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.297061 22714 tablet_bootstrap.cc:492] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:27:00.303254 22714 tablet_bootstrap.cc:654] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.324659 22714 tablet_bootstrap.cc:492] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:27:00.325150 22714 ts_tablet_manager.cc:1403] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.003s
I20260709 12:27:00.325392 22786 raft_consensus.cc:493] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.325901 22786 raft_consensus.cc:515] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.327247 22714 raft_consensus.cc:359] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.327750 22786 leader_election.cc:290] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:00.327932 22714 raft_consensus.cc:385] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.328348 22714 raft_consensus.cc:740] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.328533 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9971a97d734f6195685a52c3a70d69" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:27:00.329164 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9971a97d734f6195685a52c3a70d69" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:27:00.331235 22714 consensus_queue.cc:260] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.329228 22590 raft_consensus.cc:2468] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:27:00.333956 22484 leader_election.cc:304] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:00.334237 22714 ts_tablet_manager.cc:1434] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:27:00.331983 22666 raft_consensus.cc:2468] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 0.
I20260709 12:27:00.334710 22786 raft_consensus.cc:2804] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.335094 22786 raft_consensus.cc:493] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.335279 22714 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89: Bootstrap starting.
I20260709 12:27:00.335394 22786 raft_consensus.cc:3060] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.344113 22519 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.345156 22714 tablet_bootstrap.cc:654] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.349596 22786 raft_consensus.cc:515] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.345180 22590 raft_consensus.cc:1240] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Rejecting Update request from peer 1704a791486d41aca21c226c48b00d89 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:00.351976 22714 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89: No bootstrap required, opened a new log
I20260709 12:27:00.352531 23047 consensus_queue.cc:1059] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.352941 22714 ts_tablet_manager.cc:1403] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:27:00.353315 23047 consensus_queue.cc:1243] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Peer b662aaf197d344acbc951b9da5cebf2b log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:27:00.353876 23047 raft_consensus.cc:3055] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:00.354183 23047 raft_consensus.cc:740] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:00.354954 23047 consensus_queue.cc:260] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:00.356082 23047 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.356950 22714 raft_consensus.cc:359] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:00.357957 22714 raft_consensus.cc:385] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.358355 22714 raft_consensus.cc:740] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.359021 22714 consensus_queue.cc:260] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:00.361850 22714 ts_tablet_manager.cc:1434] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:00.366109 22786 leader_election.cc:290] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:00.366261 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9971a97d734f6195685a52c3a70d69" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:00.366875 22590 raft_consensus.cc:3060] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.367094 22664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9971a97d734f6195685a52c3a70d69" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:00.367640 22664 raft_consensus.cc:3060] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.372686 22666 raft_consensus.cc:1275] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:27:00.373239 22666 pending_rounds.cc:85] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: Aborting all ops after (but not including) 0
I20260709 12:27:00.373487 22666 pending_rounds.cc:107] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:27:00.373720 22666 raft_consensus.cc:2889] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.373895 22664 raft_consensus.cc:2468] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:27:00.374127 22590 raft_consensus.cc:2468] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:27:00.375278 22484 leader_election.cc:304] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:00.376523 22786 raft_consensus.cc:2804] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.376965 22786 raft_consensus.cc:697] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:00.377699 22786 consensus_queue.cc:237] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:00.384167 22821 consensus_queue.cc:1048] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.401515 22342 catalog_manager.cc:5697] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.403043 22444 raft_consensus.cc:1275] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:00.405592 22721 consensus_queue.cc:1048] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.464351 22665 raft_consensus.cc:3060] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.471987 23098 consensus_queue.cc:1048] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.482720 22768 consensus_queue.cc:1048] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.491362 22768 consensus_queue.cc:1048] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.511778 22768 consensus_queue.cc:1048] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.520154 22768 consensus_queue.cc:1048] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.529814 23047 raft_consensus.cc:493] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.530390 23047 raft_consensus.cc:515] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:00.532218 23047 leader_election.cc:290] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:00.533306 22444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:00.533286 23130 consensus_queue.cc:1048] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.535336 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e0af41092c454cb010bef793f8ee91" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:27:00.536644 22632 leader_election.cc:304] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:27:00.537808 23020 raft_consensus.cc:2749] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.539057 23130 consensus_queue.cc:1048] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.607339 23145 consensus_queue.cc:1048] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.618543 22861 consensus_queue.cc:1048] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.700416 22664 raft_consensus.cc:3060] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.940034 22786 consensus_queue.cc:1048] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.961620 22861 consensus_queue.cc:1048] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.485275 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
W20260709 12:27:01.490054 22557 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 157 similar messages]
W20260709 12:27:01.497080 22557 consensus_peers.cc:597] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.502005 22557 consensus_peers.cc:597] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.526747 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:01.527918 14649 tablet_replica.cc:333] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.528673 14649 raft_consensus.cc:2243] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.529335 14649 raft_consensus.cc:2272] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.531736 14649 tablet_replica.cc:333] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.532430 14649 raft_consensus.cc:2243] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.532925 14649 raft_consensus.cc:2272] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.535611 14649 tablet_replica.cc:333] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.536230 14649 raft_consensus.cc:2243] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.536633 14649 raft_consensus.cc:2272] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.538528 14649 tablet_replica.cc:333] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.539171 14649 raft_consensus.cc:2243] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.539646 14649 raft_consensus.cc:2272] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.541672 14649 tablet_replica.cc:333] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
W20260709 12:27:01.541846 22557 consensus_peers.cc:597] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.542785 14649 raft_consensus.cc:2243] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.543319 14649 raft_consensus.cc:2272] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.545457 14649 tablet_replica.cc:333] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.546063 14649 raft_consensus.cc:2243] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:01.546757 14649 raft_consensus.cc:2272] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.548454 14649 tablet_replica.cc:333] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.549013 14649 raft_consensus.cc:2243] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:01.549022 22631 consensus_peers.cc:597] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.549551 14649 raft_consensus.cc:2272] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.551540 14649 tablet_replica.cc:333] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.552310 14649 raft_consensus.cc:2243] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.552784 14649 raft_consensus.cc:2272] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.555099 14649 tablet_replica.cc:333] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.555711 14649 raft_consensus.cc:2243] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.556167 14649 raft_consensus.cc:2272] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.558290 14649 tablet_replica.cc:333] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
W20260709 12:27:01.558480 22557 consensus_peers.cc:597] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.559021 14649 raft_consensus.cc:2243] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.559429 14649 raft_consensus.cc:2272] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.561123 14649 tablet_replica.cc:333] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.561936 14649 raft_consensus.cc:2243] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.562366 14649 raft_consensus.cc:2272] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:01.563356 22557 consensus_peers.cc:597] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.564361 14649 tablet_replica.cc:333] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.565222 14649 raft_consensus.cc:2243] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.565565 14649 raft_consensus.cc:2272] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.567061 14649 tablet_replica.cc:333] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.567576 14649 raft_consensus.cc:2243] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.567919 14649 raft_consensus.cc:2272] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.569730 14649 tablet_replica.cc:333] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.570279 14649 raft_consensus.cc:2243] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.570698 14649 raft_consensus.cc:2272] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:01.571722 22557 consensus_peers.cc:597] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.572300 14649 tablet_replica.cc:333] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.572898 14649 raft_consensus.cc:2243] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:01.573632 14649 raft_consensus.cc:2272] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.575373 14649 tablet_replica.cc:333] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.576090 14649 raft_consensus.cc:2243] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.576575 14649 raft_consensus.cc:2272] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.579860 14649 tablet_replica.cc:333] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.580634 14649 raft_consensus.cc:2243] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.581133 14649 raft_consensus.cc:2272] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.584494 14649 tablet_replica.cc:333] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.585273 14649 raft_consensus.cc:2243] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.585749 14649 raft_consensus.cc:2272] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.588119 14649 tablet_replica.cc:333] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.588831 14649 raft_consensus.cc:2243] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.589314 14649 raft_consensus.cc:2272] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.592053 14649 tablet_replica.cc:333] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.592752 14649 raft_consensus.cc:2243] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.593240 14649 raft_consensus.cc:2272] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.595312 14649 tablet_replica.cc:333] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.596015 14649 raft_consensus.cc:2243] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.596531 14649 raft_consensus.cc:2272] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.598963 14649 tablet_replica.cc:333] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.599668 14649 raft_consensus.cc:2243] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.600152 14649 raft_consensus.cc:2272] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.602366 14649 tablet_replica.cc:333] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.603050 14649 raft_consensus.cc:2243] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.603493 14649 raft_consensus.cc:2272] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.606614 14649 tablet_replica.cc:333] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.607432 14649 raft_consensus.cc:2243] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.607942 14649 raft_consensus.cc:2272] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:01.609970 22557 consensus_peers.cc:597] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.610464 14649 tablet_replica.cc:333] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.611388 14649 raft_consensus.cc:2243] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:01.611716 22483 consensus_peers.cc:597] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.611941 14649 raft_consensus.cc:2272] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.614897 14649 tablet_replica.cc:333] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
W20260709 12:27:01.615386 22631 consensus_peers.cc:597] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.615674 14649 raft_consensus.cc:2243] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:01.616647 14649 raft_consensus.cc:2272] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:01.618639 22631 consensus_peers.cc:597] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.618795 14649 tablet_replica.cc:333] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.619560 14649 raft_consensus.cc:2243] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.619975 14649 raft_consensus.cc:2272] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.622154 14649 tablet_replica.cc:333] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.622880 14649 raft_consensus.cc:2243] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.623359 14649 raft_consensus.cc:2272] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.625489 14649 tablet_replica.cc:333] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.626207 14649 raft_consensus.cc:2243] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:01.626284 22483 consensus_peers.cc:597] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.626740 14649 raft_consensus.cc:2272] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.629007 14649 tablet_replica.cc:333] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.629753 14649 raft_consensus.cc:2243] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.630226 14649 raft_consensus.cc:2272] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.632917 14649 tablet_replica.cc:333] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.633695 14649 raft_consensus.cc:2243] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:01.634588 14649 raft_consensus.cc:2272] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:01.636130 22631 consensus_peers.cc:597] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.636826 14649 tablet_replica.cc:333] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.637581 14649 raft_consensus.cc:2243] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.638053 14649 raft_consensus.cc:2272] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.640247 14649 tablet_replica.cc:333] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.640947 14649 raft_consensus.cc:2243] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:01.641808 14649 raft_consensus.cc:2272] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.643776 14649 tablet_replica.cc:333] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.644251 14649 raft_consensus.cc:2243] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.644646 14649 raft_consensus.cc:2272] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.646696 14649 tablet_replica.cc:333] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.647487 14649 raft_consensus.cc:2243] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.647964 14649 raft_consensus.cc:2272] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.649821 14649 tablet_replica.cc:333] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.650421 14649 raft_consensus.cc:2243] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:01.651160 14649 raft_consensus.cc:2272] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.653133 14649 tablet_replica.cc:333] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.653633 14649 raft_consensus.cc:2243] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.654026 14649 raft_consensus.cc:2272] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.655634 14649 tablet_replica.cc:333] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.656122 14649 raft_consensus.cc:2243] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.656515 14649 raft_consensus.cc:2272] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.658432 14649 tablet_replica.cc:333] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.658936 14649 raft_consensus.cc:2243] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.659335 14649 raft_consensus.cc:2272] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.661022 14649 tablet_replica.cc:333] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.661567 14649 raft_consensus.cc:2243] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.661947 14649 raft_consensus.cc:2272] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.663848 14649 tablet_replica.cc:333] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.664397 14649 raft_consensus.cc:2243] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.664817 14649 raft_consensus.cc:2272] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.666642 14649 tablet_replica.cc:333] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.667146 14649 raft_consensus.cc:2243] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.667580 14649 raft_consensus.cc:2272] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.669175 14649 tablet_replica.cc:333] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.669651 14649 raft_consensus.cc:2243] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.670085 14649 raft_consensus.cc:2272] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.672684 14649 tablet_replica.cc:333] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.673296 14649 raft_consensus.cc:2243] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.673776 14649 raft_consensus.cc:2272] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.676210 14649 tablet_replica.cc:333] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: stopping tablet replica
I20260709 12:27:01.676817 14649 raft_consensus.cc:2243] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.677250 14649 raft_consensus.cc:2272] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:01.684924 22557 consensus_peers.cc:597] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.688937 22557 consensus_peers.cc:597] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.696492 22483 consensus_peers.cc:597] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.705426 22631 consensus_peers.cc:597] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.708997 22557 consensus_peers.cc:597] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.714934 22557 consensus_peers.cc:597] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.727245 22483 consensus_peers.cc:597] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.732347 22557 consensus_peers.cc:597] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.735132 22483 consensus_peers.cc:597] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.745366 22483 consensus_peers.cc:597] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.752229 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
W20260709 12:27:01.774400 22483 consensus_peers.cc:597] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.794719 22483 consensus_peers.cc:597] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.797963 22483 consensus_peers.cc:597] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.802546 22483 consensus_peers.cc:597] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.812723 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:01.820361 23181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:01.823576 23184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:01.826057 23182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:01.828150 14649 server_base.cc:1061] running on GCE node
W20260709 12:27:01.828531 22557 consensus_peers.cc:597] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.829499 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:01.829733 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:01.829880 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600021829868 us; error 0 us; skew 500 ppm
I20260709 12:27:01.830499 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:01.833128 14649 webserver.cc:533] Webserver started at http://127.14.78.65:39989/ using document root <none> and password file <none>
I20260709 12:27:01.833707 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:01.833904 14649 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:01.838542 14649 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:27:01.845930 23191 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:01.846771 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:27:01.847091 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "7b50b6c210724c66b6ee01c04ab9676d"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-vrh7"
I20260709 12:27:01.847489 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:01.876878 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:01.878489 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:27:01.879299 22631 consensus_peers.cc:597] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.879925 22557 consensus_peers.cc:597] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.881384 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:01.886598 23199 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:27:01.894994 22483 consensus_peers.cc:597] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.906132 22483 consensus_peers.cc:597] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.914525 22557 consensus_peers.cc:597] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.921322 22557 consensus_peers.cc:597] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.937897 22483 consensus_peers.cc:597] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.979094 22483 consensus_peers.cc:597] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:01.999055 22557 consensus_peers.cc:597] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:02.006242 22631 consensus_peers.cc:597] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:02.079773 22557 consensus_peers.cc:597] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.153120 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:27:02.153651 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.268s	user 0.007s	sys 0.001s
I20260709 12:27:02.154052 14649 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:27:02.164600 23199 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.177711 23199 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.178385 23199 tablet_bootstrap.cc:492] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.178984 23199 ts_tablet_manager.cc:1403] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:27:02.181378 23199 raft_consensus.cc:359] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.182031 23199 raft_consensus.cc:740] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.182690 23199 consensus_queue.cc:260] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.184908 23199 ts_tablet_manager.cc:1434] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:02.185534 23199 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.196430 23199 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.197155 23199 tablet_bootstrap.cc:492] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.197661 23199 ts_tablet_manager.cc:1403] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.010s
I20260709 12:27:02.199244 23199 raft_consensus.cc:359] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.199749 23199 raft_consensus.cc:740] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.200384 23199 consensus_queue.cc:260] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.202271 23199 ts_tablet_manager.cc:1434] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:27:02.202966 23199 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.212528 23199 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.213241 23199 tablet_bootstrap.cc:492] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.213716 23199 ts_tablet_manager.cc:1403] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:27:02.215325 23199 raft_consensus.cc:359] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.215783 23199 raft_consensus.cc:740] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.216274 23199 consensus_queue.cc:260] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.217604 23199 ts_tablet_manager.cc:1434] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:27:02.218250 23199 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.243305 23199 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.244176 23199 tablet_bootstrap.cc:492] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.244764 23199 ts_tablet_manager.cc:1403] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 12:27:02.261260 23199 raft_consensus.cc:359] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:02.261929 23199 raft_consensus.cc:740] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.262655 23199 consensus_queue.cc:260] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:02.264740 23199 ts_tablet_manager.cc:1434] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:27:02.265725 23199 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.278683 23199 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.279556 23199 tablet_bootstrap.cc:492] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.280061 23199 ts_tablet_manager.cc:1403] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 12:27:02.281824 23199 raft_consensus.cc:359] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.282330 23199 raft_consensus.cc:740] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.282899 23199 consensus_queue.cc:260] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.284945 23199 ts_tablet_manager.cc:1434] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:27:02.285682 23199 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.301716 23199 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.302583 23199 tablet_bootstrap.cc:492] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.303186 23199 ts_tablet_manager.cc:1403] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:27:02.305241 23199 raft_consensus.cc:359] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.305918 23199 raft_consensus.cc:740] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.308389 23199 consensus_queue.cc:260] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.311484 23199 ts_tablet_manager.cc:1434] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:27:02.312410 23199 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.360078 23199 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.360838 23199 tablet_bootstrap.cc:492] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.361402 23199 ts_tablet_manager.cc:1403] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.020s
I20260709 12:27:02.362972 23199 raft_consensus.cc:359] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.363478 23199 raft_consensus.cc:740] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.364068 23199 consensus_queue.cc:260] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.365854 23199 ts_tablet_manager.cc:1434] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:02.366508 23199 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.375140 14649 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:27:02.375499 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.221s	user 0.204s	sys 0.007s
I20260709 12:27:02.376782 23199 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.377652 23199 tablet_bootstrap.cc:492] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.378201 23199 ts_tablet_manager.cc:1403] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:27:02.380391 23199 raft_consensus.cc:359] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.381073 23199 raft_consensus.cc:740] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.381814 23199 consensus_queue.cc:260] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.383800 23199 ts_tablet_manager.cc:1434] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:02.384527 23199 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.396836 23199 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.397718 23199 tablet_bootstrap.cc:492] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.398290 23199 ts_tablet_manager.cc:1403] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:27:02.400249 23199 raft_consensus.cc:359] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.400946 23199 raft_consensus.cc:740] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.401810 23199 consensus_queue.cc:260] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.403913 23199 ts_tablet_manager.cc:1434] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:02.404626 23199 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
W20260709 12:27:02.496879 22633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 55605.7us
I20260709 12:27:02.540099 23199 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.540956 23199 tablet_bootstrap.cc:492] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.541572 23199 ts_tablet_manager.cc:1403] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.137s	user 0.060s	sys 0.048s
I20260709 12:27:02.543778 23199 raft_consensus.cc:359] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.544485 23199 raft_consensus.cc:740] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.545332 23199 consensus_queue.cc:260] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.546897 23199 ts_tablet_manager.cc:1434] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:02.547600 23199 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.558724 23199 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.559424 23199 tablet_bootstrap.cc:492] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.560055 23199 ts_tablet_manager.cc:1403] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:27:02.561766 23199 raft_consensus.cc:359] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.562338 23199 raft_consensus.cc:740] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.563057 23199 consensus_queue.cc:260] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.564601 23199 ts_tablet_manager.cc:1434] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:02.565337 23199 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.578693 23199 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.579551 23199 tablet_bootstrap.cc:492] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.580135 23199 ts_tablet_manager.cc:1403] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:27:02.585400 23199 raft_consensus.cc:359] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.586031 23199 raft_consensus.cc:740] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.586745 23199 consensus_queue.cc:260] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.588948 23199 ts_tablet_manager.cc:1434] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:02.589674 23199 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.602844 23199 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.603677 23199 tablet_bootstrap.cc:492] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.604225 23199 ts_tablet_manager.cc:1403] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:27:02.605969 23199 raft_consensus.cc:359] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.606451 23199 raft_consensus.cc:740] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.607013 23199 consensus_queue.cc:260] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.609001 23199 ts_tablet_manager.cc:1434] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:27:02.609719 23199 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.616410 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:34885
I20260709 12:27:02.616521 23273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:34885 every 8 connection(s)
I20260709 12:27:02.634029 23199 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.634961 23199 tablet_bootstrap.cc:492] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.635612 23199 ts_tablet_manager.cc:1403] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 12:27:02.637966 23199 raft_consensus.cc:359] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.638581 23199 raft_consensus.cc:740] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.639329 23199 consensus_queue.cc:260] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.641624 23199 ts_tablet_manager.cc:1434] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:02.642393 23199 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.683079 22786 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.683843 22786 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.698537 23201 raft_consensus.cc:493] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.699314 23201 raft_consensus.cc:515] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.712888 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.713201 23174 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.713724 23174 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.715781 23174 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:02.718083 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
W20260709 12:27:02.719417 22557 leader_election.cc:343] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.722434 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:27:02.723205 22518 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 2.
W20260709 12:27:02.724784 22483 leader_election.cc:343] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.738297 22559 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:02.739950 23174 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:02.740319 23174 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.740684 23174 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.752079 23225 raft_consensus.cc:493] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.752296 23174 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.752657 23225 raft_consensus.cc:515] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.754344 22786 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:02.755048 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
W20260709 12:27:02.756610 22557 leader_election.cc:343] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.756959 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:27:02.757565 23174 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 3 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:02.758065 22589 raft_consensus.cc:2393] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3766de80037442fbcfbef7158ad1868 in current term 3: Already voted for candidate b662aaf197d344acbc951b9da5cebf2b in this term.
I20260709 12:27:02.767616 23200 raft_consensus.cc:493] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.768355 23200 raft_consensus.cc:515] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.771620 23200 leader_election.cc:290] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:02.772725 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.773285 22484 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
W20260709 12:27:02.774163 22557 leader_election.cc:343] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.775923 23177 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.781018 22861 raft_consensus.cc:493] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.781550 22861 raft_consensus.cc:515] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.784608 23225 leader_election.cc:290] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:02.789837 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:27:02.790723 22589 raft_consensus.cc:2468] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 1.
I20260709 12:27:02.795094 22632 leader_election.cc:304] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:02.795855 23225 raft_consensus.cc:2804] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:02.802716 22861 leader_election.cc:290] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:02.796216 23225 raft_consensus.cc:493] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.803614 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:27:02.803565 23225 raft_consensus.cc:3060] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.807698 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.809316 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:02.810884 23201 leader_election.cc:290] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
W20260709 12:27:02.813122 22559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 46059.6us
I20260709 12:27:02.814890 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:27:02.815846 23225 raft_consensus.cc:515] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.818616 22666 raft_consensus.cc:2393] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b662aaf197d344acbc951b9da5cebf2b in current term 2: Already voted for candidate 1704a791486d41aca21c226c48b00d89 in this term.
I20260709 12:27:02.824004 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:02.824514 22590 raft_consensus.cc:3060] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.826234 23179 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.826915 23179 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.830034 23179 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:02.831162 22590 raft_consensus.cc:2468] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:02.832237 22632 leader_election.cc:304] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:02.832269 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:27:02.833025 23179 raft_consensus.cc:2804] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:02.833501 23179 raft_consensus.cc:697] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:02.834250 23179 consensus_queue.cc:237] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.837986 22861 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.838469 22861 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.839346 23225 leader_election.cc:290] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:02.840647 22861 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:02.844873 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.859485 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
W20260709 12:27:02.864549 22483 leader_election.cc:343] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:02.866657 22483 leader_election.cc:343] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.871459 23199 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:02.874284 23199 tablet_bootstrap.cc:492] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:02.879259 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.876330 22559 leader_election.cc:304] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b662aaf197d344acbc951b9da5cebf2b; no voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:02.880852 23200 raft_consensus.cc:2749] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.885670 23177 raft_consensus.cc:2749] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.886430 23199 ts_tablet_manager.cc:1403] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.244s	user 0.051s	sys 0.065s
I20260709 12:27:02.886310 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
W20260709 12:27:02.892890 22631 leader_election.cc:343] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.888216 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.889169 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afb9c110162141dbbeb161a2aaa00e82" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:02.904013 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:27:02.900018 23174 raft_consensus.cc:493] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.904630 22666 raft_consensus.cc:2468] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 1.
I20260709 12:27:02.904798 23174 raft_consensus.cc:515] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
W20260709 12:27:02.907352 22631 leader_election.cc:343] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.907788 22631 leader_election.cc:304] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
W20260709 12:27:02.908842 22631 leader_election.cc:343] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.909286 22631 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
W20260709 12:27:02.910481 22631 leader_election.cc:343] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.911615 23225 raft_consensus.cc:2749] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.912474 23225 raft_consensus.cc:2749] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.912650 23275 heartbeater.cc:344] Connected to a master server at 127.14.78.126:38407
I20260709 12:27:02.913187 23275 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:02.914141 23275 heartbeater.cc:507] Master 127.14.78.126:38407 requested a full tablet report, sending...
I20260709 12:27:02.915799 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:02.915995 23174 leader_election.cc:290] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:02.916112 22339 catalog_manager.cc:5697] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 1 to 2, leader changed from 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65) to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:02.917163 22557 leader_election.cc:343] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.917066 23199 raft_consensus.cc:359] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.919041 23199 raft_consensus.cc:740] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.919821 23199 consensus_queue.cc:260] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.921391 23199 ts_tablet_manager.cc:1434] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:27:02.922349 23199 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:02.929181 22516 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 3.
I20260709 12:27:02.934029 23174 raft_consensus.cc:493] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.934729 23174 raft_consensus.cc:515] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.938625 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
W20260709 12:27:02.939951 22557 leader_election.cc:343] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.940064 23174 leader_election.cc:290] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:02.939977 22664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89" is_pre_election: true
I20260709 12:27:02.940774 22485 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:02.941264 22664 raft_consensus.cc:2468] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:27:02.941893 23281 raft_consensus.cc:2804] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:02.942291 23281 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.942353 22559 leader_election.cc:304] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:02.943881 23174 raft_consensus.cc:2804] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:02.944433 23174 raft_consensus.cc:493] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.944898 23174 raft_consensus.cc:3060] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.947454 23177 raft_consensus.cc:493] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:02.942703 23281 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.947968 23177 raft_consensus.cc:515] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.950191 23177 leader_election.cc:290] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
W20260709 12:27:02.951465 22484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:33639, user_credentials={real_user=slave}} blocked reactor thread for 56536.3us
I20260709 12:27:02.952942 22484 leader_election.cc:304] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:27:02.953600 22786 raft_consensus.cc:2749] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.957461 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b662aaf197d344acbc951b9da5cebf2b" is_pre_election: true
I20260709 12:27:02.960342 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:27:02.960994 22516 raft_consensus.cc:2468] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:27:02.962834 22559 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:02.963550 23098 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:02.963985 23098 raft_consensus.cc:697] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:02.964779 23098 consensus_queue.cc:237] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:02.968245 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
W20260709 12:27:02.971292 22483 leader_election.cc:343] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.972069 22339 ts_manager.cc:194] Re-registered known tserver with Master: 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:02.973616 23174 raft_consensus.cc:515] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:02.975423 23281 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:02.978719 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:02.979308 22484 leader_election.cc:304] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3766de80037442fbcfbef7158ad1868; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
W20260709 12:27:02.980084 22557 leader_election.cc:343] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.980381 22786 raft_consensus.cc:2749] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.977757 22559 leader_election.cc:304] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:02.981334 22666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:02.981889 22666 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.003436 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e68bab18985498ba50de54dca27ab78" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:03.004217 22665 raft_consensus.cc:3060] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.009119 22666 raft_consensus.cc:2468] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 2.
I20260709 12:27:03.013594 22485 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:03.014501 22786 raft_consensus.cc:2804] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.014921 22786 raft_consensus.cc:697] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:02.981180 23174 leader_election.cc:290] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:03.015632 22786 consensus_queue.cc:237] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.001582 23200 raft_consensus.cc:2804] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:03.023950 22665 raft_consensus.cc:2468] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 2.
W20260709 12:27:03.032665 22559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35239, user_credentials={real_user=slave}} blocked reactor thread for 43833.6us
I20260709 12:27:03.041571 22559 leader_election.cc:304] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:03.021127 23200 raft_consensus.cc:493] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:03.046931 23098 raft_consensus.cc:2804] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.047395 23098 raft_consensus.cc:697] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:03.041931 23281 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:03.084004 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:03.043459 23200 raft_consensus.cc:3060] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.085482 23098 consensus_queue.cc:237] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:27:03.099668 22483 leader_election.cc:343] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.113694 23199 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.114980 23199 tablet_bootstrap.cc:492] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.115813 23199 ts_tablet_manager.cc:1403] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.194s	user 0.030s	sys 0.012s
W20260709 12:27:03.115497 23288 log.cc:927] Time spent T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: Append to log took a long time: real 0.082s	user 0.002s	sys 0.003s
I20260709 12:27:03.120708 23200 raft_consensus.cc:515] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.133279 23293 raft_consensus.cc:493] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:03.137728 23199 raft_consensus.cc:359] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.137656 23293 raft_consensus.cc:515] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.139768 23293 leader_election.cc:290] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:03.144814 23199 raft_consensus.cc:740] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.151378 23245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d" is_pre_election: true
I20260709 12:27:03.154021 23247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
I20260709 12:27:03.160780 23199 consensus_queue.cc:260] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.162467 22342 catalog_manager.cc:5697] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 2 to 3, leader changed from 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65) to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 3 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:03.163407 22557 leader_election.cc:343] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:03.164085 22557 leader_election.cc:343] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.165961 23199 ts_tablet_manager.cc:1434] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:27:03.166782 23199 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.141407 23200 leader_election.cc:290] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:03.180913 22339 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50500
I20260709 12:27:03.186643 23275 heartbeater.cc:499] Master 127.14.78.126:38407 was elected leader, sending a full tablet report...
I20260709 12:27:03.196202 22339 catalog_manager.cc:5697] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 1 to 2, leader changed from 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65) to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.197505 22342 catalog_manager.cc:5697] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 1 to 2, leader changed from 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65) to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 2 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.212891 23199 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.213819 23199 tablet_bootstrap.cc:492] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.214445 23199 ts_tablet_manager.cc:1403] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.001s
I20260709 12:27:03.216948 23199 raft_consensus.cc:359] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.217608 23199 raft_consensus.cc:740] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.218375 23199 consensus_queue.cc:260] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.220732 23199 ts_tablet_manager.cc:1434] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:03.221477 23199 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.228296 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868" is_pre_election: true
I20260709 12:27:03.228583 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d8ff5add1411fb67886f3c197525e" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:03.228938 22518 raft_consensus.cc:2468] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 1.
I20260709 12:27:03.229269 22516 raft_consensus.cc:3060] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.240415 22516 raft_consensus.cc:2468] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 2.
I20260709 12:27:03.241361 22559 leader_election.cc:304] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:03.242161 23098 raft_consensus.cc:2804] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:03.242493 23098 raft_consensus.cc:493] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:03.242810 23098 raft_consensus.cc:3060] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.243490 22559 leader_election.cc:304] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:03.244277 23200 raft_consensus.cc:2804] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.244726 23200 raft_consensus.cc:697] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:03.245522 23200 consensus_queue.cc:237] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.247466 23199 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.249127 23098 raft_consensus.cc:515] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.250341 23199 tablet_bootstrap.cc:492] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.251317 23199 ts_tablet_manager.cc:1403] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.005s
I20260709 12:27:03.251824 23246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
W20260709 12:27:03.253234 22557 leader_election.cc:343] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.253785 23199 raft_consensus.cc:359] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.254467 23199 raft_consensus.cc:740] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.255259 23199 consensus_queue.cc:260] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.257233 22591 raft_consensus.cc:1275] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.258754 22516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c2cfe20d2945009689b68b54859bdc" candidate_uuid: "b662aaf197d344acbc951b9da5cebf2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:03.259459 22516 raft_consensus.cc:3060] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.259882 23199 ts_tablet_manager.cc:1434] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:27:03.260816 23199 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.258791 23298 consensus_queue.cc:1048] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:27:03.268430 22516 raft_consensus.cc:2468] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b662aaf197d344acbc951b9da5cebf2b in term 2.
I20260709 12:27:03.257885 23098 leader_election.cc:290] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Requested vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:03.271999 22559 leader_election.cc:304] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:03.273216 23098 raft_consensus.cc:2804] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:03.273768 23098 raft_consensus.cc:697] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Becoming Leader. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:03.274567 23098 consensus_queue.cc:237] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
W20260709 12:27:03.278265 22631 consensus_peers.cc:597] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.291759 23199 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.291069 22342 catalog_manager.cc:5697] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 1 to 2, leader changed from 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65) to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 2 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.292660 23199 tablet_bootstrap.cc:492] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.293299 23199 ts_tablet_manager.cc:1403] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.001s
I20260709 12:27:03.308144 23199 raft_consensus.cc:359] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.308797 23199 raft_consensus.cc:740] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.309552 23199 consensus_queue.cc:260] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.312126 23199 ts_tablet_manager.cc:1434] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:27:03.312937 23199 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.314779 22341 catalog_manager.cc:5697] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b reported cstate change: term changed from 1 to 2, leader changed from 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65) to b662aaf197d344acbc951b9da5cebf2b (127.14.78.67). New cstate: current_term: 2 leader_uuid: "b662aaf197d344acbc951b9da5cebf2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.335033 23199 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.335927 23199 tablet_bootstrap.cc:492] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.336577 23199 ts_tablet_manager.cc:1403] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.011s
I20260709 12:27:03.338950 23199 raft_consensus.cc:359] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.339607 23199 raft_consensus.cc:740] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.340317 23199 consensus_queue.cc:260] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.342327 23199 ts_tablet_manager.cc:1434] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:03.343060 23199 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.356772 23199 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.357489 23199 tablet_bootstrap.cc:492] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.357995 23199 ts_tablet_manager.cc:1403] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 12:27:03.360165 23199 raft_consensus.cc:359] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.360687 23199 raft_consensus.cc:740] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.361333 23199 consensus_queue.cc:260] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.363426 23199 ts_tablet_manager.cc:1434] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:03.364351 23199 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.378046 23199 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.378957 23199 tablet_bootstrap.cc:492] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.379513 23199 ts_tablet_manager.cc:1403] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:27:03.381207 23199 raft_consensus.cc:359] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.381654 23199 raft_consensus.cc:740] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.382066 23199 consensus_queue.cc:260] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.383689 23199 ts_tablet_manager.cc:1434] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:03.384637 23199 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.402364 23199 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.403239 23199 tablet_bootstrap.cc:492] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.403923 23199 ts_tablet_manager.cc:1403] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:27:03.406994 23199 raft_consensus.cc:359] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.407625 23199 raft_consensus.cc:740] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.408366 23199 consensus_queue.cc:260] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.410243 23199 ts_tablet_manager.cc:1434] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:03.411024 23199 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.423780 23199 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.424614 23199 tablet_bootstrap.cc:492] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.425261 23199 ts_tablet_manager.cc:1403] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.002s
I20260709 12:27:03.427650 23199 raft_consensus.cc:359] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.428370 23199 raft_consensus.cc:740] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.429152 23199 consensus_queue.cc:260] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.431242 23199 ts_tablet_manager.cc:1434] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
W20260709 12:27:03.431468 22557 consensus_peers.cc:597] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.432018 23199 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.436668 22516 raft_consensus.cc:1275] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:03.438856 23200 consensus_queue.cc:1048] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.451032 23199 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.451907 23199 tablet_bootstrap.cc:492] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.452522 23199 ts_tablet_manager.cc:1403] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:27:03.454818 23199 raft_consensus.cc:359] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.455462 23199 raft_consensus.cc:740] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.456177 23199 consensus_queue.cc:260] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.460381 23199 ts_tablet_manager.cc:1434] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:03.461198 23199 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.486631 23199 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.487576 23199 tablet_bootstrap.cc:492] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.488173 23199 ts_tablet_manager.cc:1403] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 12:27:03.490298 23199 raft_consensus.cc:359] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.490731 23199 raft_consensus.cc:740] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.491176 23199 consensus_queue.cc:260] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.492725 23199 ts_tablet_manager.cc:1434] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:03.497869 23199 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
W20260709 12:27:03.516287 22557 consensus_peers.cc:597] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.517606 23199 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.518579 23199 tablet_bootstrap.cc:492] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.519196 23199 ts_tablet_manager.cc:1403] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:27:03.521557 23199 raft_consensus.cc:359] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.522200 23199 raft_consensus.cc:740] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.522845 23199 consensus_queue.cc:260] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.524574 23199 ts_tablet_manager.cc:1434] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:03.525353 23199 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.536983 23199 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.537938 23199 tablet_bootstrap.cc:492] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.538532 23199 ts_tablet_manager.cc:1403] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:27:03.540800 23199 raft_consensus.cc:359] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.541326 23199 raft_consensus.cc:740] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.541754 23199 consensus_queue.cc:260] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.543466 23199 ts_tablet_manager.cc:1434] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:03.544392 23199 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.558161 23199 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.559082 23199 tablet_bootstrap.cc:492] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.559638 23199 ts_tablet_manager.cc:1403] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:27:03.561805 23199 raft_consensus.cc:359] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.562419 23199 raft_consensus.cc:740] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.563038 23199 consensus_queue.cc:260] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.564914 23199 ts_tablet_manager.cc:1434] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:03.565730 23199 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.566798 22667 raft_consensus.cc:1275] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.568203 23301 consensus_queue.cc:1048] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.579037 23199 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.579993 23199 tablet_bootstrap.cc:492] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.580631 23199 ts_tablet_manager.cc:1403] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
W20260709 12:27:03.581315 22483 consensus_peers.cc:597] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.583091 23199 raft_consensus.cc:359] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.583765 23199 raft_consensus.cc:740] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.584456 23199 consensus_queue.cc:260] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.586577 23199 ts_tablet_manager.cc:1434] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:03.587690 23199 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.601024 23199 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.601850 23199 tablet_bootstrap.cc:492] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.602360 23199 ts_tablet_manager.cc:1403] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:27:03.604125 23199 raft_consensus.cc:359] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.604581 23199 raft_consensus.cc:740] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.605146 23199 consensus_queue.cc:260] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.606529 23199 ts_tablet_manager.cc:1434] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:03.607298 23199 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.621501 23199 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.622352 23199 tablet_bootstrap.cc:492] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.623005 23199 ts_tablet_manager.cc:1403] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:27:03.625454 23199 raft_consensus.cc:359] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.626132 23199 raft_consensus.cc:740] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.626982 23199 consensus_queue.cc:260] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.628908 23199 ts_tablet_manager.cc:1434] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:03.629825 23199 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.644466 23199 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.645326 23199 tablet_bootstrap.cc:492] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.645823 23199 ts_tablet_manager.cc:1403] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:27:03.647338 23199 raft_consensus.cc:359] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.647782 23199 raft_consensus.cc:740] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.648216 23199 consensus_queue.cc:260] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.649915 23199 ts_tablet_manager.cc:1434] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:03.650890 23199 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.669688 22667 raft_consensus.cc:1275] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.670157 23199 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.670792 23200 consensus_queue.cc:1048] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.671412 23199 tablet_bootstrap.cc:492] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.672056 23199 ts_tablet_manager.cc:1403] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:27:03.674487 23199 raft_consensus.cc:359] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.690409 23199 raft_consensus.cc:740] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.691151 23199 consensus_queue.cc:260] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.704867 23199 ts_tablet_manager.cc:1434] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.033s	user 0.015s	sys 0.001s
I20260709 12:27:03.705652 23199 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.729310 23199 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.730252 23199 tablet_bootstrap.cc:492] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.730851 23199 ts_tablet_manager.cc:1403] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 12:27:03.733417 23199 raft_consensus.cc:359] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.734031 23199 raft_consensus.cc:740] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.734716 23199 consensus_queue.cc:260] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.735879 23199 ts_tablet_manager.cc:1434] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:03.736491 23199 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.765221 22519 raft_consensus.cc:1275] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.769299 23199 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.770257 23199 tablet_bootstrap.cc:492] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.770885 23199 ts_tablet_manager.cc:1403] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.012s
I20260709 12:27:03.773185 23199 raft_consensus.cc:359] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.773808 23199 raft_consensus.cc:740] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.774646 23246 raft_consensus.cc:3060] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.774456 23199 consensus_queue.cc:260] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.775290 23292 consensus_queue.cc:1048] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:03.776548 23199 ts_tablet_manager.cc:1434] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:03.777397 23199 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.777964 23247 raft_consensus.cc:3060] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:03.789371 22557 consensus_peers.cc:597] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.791764 23246 raft_consensus.cc:1275] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.793845 23293 consensus_queue.cc:1048] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.815558 22519 raft_consensus.cc:1275] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer b662aaf197d344acbc951b9da5cebf2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.817796 23200 consensus_queue.cc:1048] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.822175 23199 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.823285 23199 tablet_bootstrap.cc:492] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.823980 23199 ts_tablet_manager.cc:1403] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.023s
I20260709 12:27:03.827730 23199 raft_consensus.cc:359] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.828522 23199 raft_consensus.cc:740] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.831617 23199 consensus_queue.cc:260] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.833848 23199 ts_tablet_manager.cc:1434] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:27:03.834606 23199 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.856846 23199 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.857722 23199 tablet_bootstrap.cc:492] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.858374 23199 ts_tablet_manager.cc:1403] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.003s
I20260709 12:27:03.860183 23199 raft_consensus.cc:359] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.860637 23199 raft_consensus.cc:740] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.861305 23199 consensus_queue.cc:260] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.863109 23199 ts_tablet_manager.cc:1434] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:27:03.863729 23199 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.874909 23199 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.875963 23199 tablet_bootstrap.cc:492] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.876579 23199 ts_tablet_manager.cc:1403] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:27:03.878778 23199 raft_consensus.cc:359] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.879402 23199 raft_consensus.cc:740] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.880029 23199 consensus_queue.cc:260] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.881611 23199 ts_tablet_manager.cc:1434] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:03.882427 23199 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.894613 23199 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.895466 23199 tablet_bootstrap.cc:492] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.896075 23199 ts_tablet_manager.cc:1403] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:27:03.897924 23199 raft_consensus.cc:359] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.898419 23199 raft_consensus.cc:740] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.898927 23199 consensus_queue.cc:260] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.900640 23199 ts_tablet_manager.cc:1434] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:03.901434 23199 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.912828 23199 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.913714 23199 tablet_bootstrap.cc:492] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.914327 23199 ts_tablet_manager.cc:1403] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:27:03.916517 23199 raft_consensus.cc:359] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.917169 23199 raft_consensus.cc:740] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.917900 23199 consensus_queue.cc:260] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.919719 23199 ts_tablet_manager.cc:1434] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:03.920562 23199 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.932492 23199 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.933331 23199 tablet_bootstrap.cc:492] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.933939 23199 ts_tablet_manager.cc:1403] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 12:27:03.935895 23245 raft_consensus.cc:3060] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.936121 23199 raft_consensus.cc:359] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.936848 23199 raft_consensus.cc:740] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.937512 23199 consensus_queue.cc:260] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:03.939637 23199 ts_tablet_manager.cc:1434] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:27:03.941726 23199 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.953817 23199 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.954689 23199 tablet_bootstrap.cc:492] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.955332 23199 ts_tablet_manager.cc:1403] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:27:03.957513 23199 raft_consensus.cc:359] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.958123 23199 raft_consensus.cc:740] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.958860 23199 consensus_queue.cc:260] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:03.960835 23199 ts_tablet_manager.cc:1434] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:27:03.961593 23199 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.978497 23199 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.979403 23199 tablet_bootstrap.cc:492] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.980008 23199 ts_tablet_manager.cc:1403] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:27:03.982138 23199 raft_consensus.cc:359] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.982790 23199 raft_consensus.cc:740] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.983585 23199 consensus_queue.cc:260] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:03.985483 23199 ts_tablet_manager.cc:1434] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:03.986418 23199 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap starting.
I20260709 12:27:03.997511 23199 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.998409 23199 tablet_bootstrap.cc:492] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Bootstrap complete.
I20260709 12:27:03.999051 23199 ts_tablet_manager.cc:1403] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:27:04.001183 23199 raft_consensus.cc:359] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:04.001839 23199 raft_consensus.cc:740] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.002414 23199 consensus_queue.cc:260] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:04.004086 23199 ts_tablet_manager.cc:1434] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:27:04.161132 23245 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.223977 23245 raft_consensus.cc:3060] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.449222 23244 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:08.004006 22485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.68:43965, user_credentials={real_user=slave}} blocked reactor thread for 112693us
W20260709 12:27:08.856673 22614 debug-util.cc:398] Leaking SignalData structure 0x7b080013c120 after lost signal to thread 14652
W20260709 12:27:08.857650 22614 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd5c0 after lost signal to thread 22376
W20260709 12:27:08.858721 22614 debug-util.cc:398] Leaking SignalData structure 0x7b080003f5e0 after lost signal to thread 22543
W20260709 12:27:08.859602 22614 debug-util.cc:398] Leaking SignalData structure 0x7b0800234cc0 after lost signal to thread 22617
W20260709 12:27:08.860708 22614 debug-util.cc:398] Leaking SignalData structure 0x7b0800100c80 after lost signal to thread 22691
W20260709 12:27:08.861923 22614 debug-util.cc:398] Leaking SignalData structure 0x7b0800385440 after lost signal to thread 23273
I20260709 12:27:12.744901 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:12.792485 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eeef333a78947669db43fca25c58e78"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:12.793573 22590 raft_consensus.cc:606] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 1704a791486d41aca21c226c48b00d89
I20260709 12:27:12.796202 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:12.796788 22590 raft_consensus.cc:606] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:12.809373 22519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:49476
I20260709 12:27:12.809978 22519 raft_consensus.cc:606] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:12.813180 22519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:49476
I20260709 12:27:12.813616 22519 raft_consensus.cc:606] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:12.815757 22519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:49476
I20260709 12:27:12.816154 22519 raft_consensus.cc:606] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:12.817171 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:12.818464 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:12.819152 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:12.875909 23380 raft_consensus.cc:993] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:12.876533 23368 raft_consensus.cc:1081] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:12.878217 23244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52146
I20260709 12:27:12.878790 23244 raft_consensus.cc:493] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:12.879130 23244 raft_consensus.cc:3060] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.884424 23244 raft_consensus.cc:515] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:12.886677 23244 leader_election.cc:290] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:12.898896 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:12.899047 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e89b4817634267af8055d08a1b1f72" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:12.899523 22519 raft_consensus.cc:3055] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:12.899657 22590 raft_consensus.cc:3060] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.899806 22519 raft_consensus.cc:740] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:12.900611 22519 consensus_queue.cc:260] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:12.901894 22519 raft_consensus.cc:3060] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.906693 23380 raft_consensus.cc:993] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:12.907179 22590 raft_consensus.cc:2468] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:12.907195 23380 raft_consensus.cc:1081] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:12.908422 23194 leader_election.cc:304] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:12.910283 23244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52146
I20260709 12:27:12.910657 23387 raft_consensus.cc:2804] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:12.910795 23244 raft_consensus.cc:493] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:12.911187 23244 raft_consensus.cc:3060] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.914244 22519 raft_consensus.cc:2468] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:12.915419 23387 raft_consensus.cc:697] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:12.916877 23387 consensus_queue.cc:237] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:12.919307 23244 raft_consensus.cc:515] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:12.922276 23244 leader_election.cc:290] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:12.923962 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:12.925153 22519 raft_consensus.cc:3055] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:12.925421 22519 raft_consensus.cc:740] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:12.926113 22519 consensus_queue.cc:260] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:12.927376 22519 raft_consensus.cc:3060] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.933439 22519 raft_consensus.cc:2468] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:12.934480 23195 leader_election.cc:304] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:12.935439 23387 raft_consensus.cc:2804] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:12.935916 23387 raft_consensus.cc:697] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:12.936764 23387 consensus_queue.cc:237] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:12.937565 22339 catalog_manager.cc:5697] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b3766de80037442fbcfbef7158ad1868 (127.14.78.66) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:12.946746 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7389131679245b79dae4f4f256f4bd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:12.947283 22667 raft_consensus.cc:3060] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.954658 22667 raft_consensus.cc:2468] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:12.965873 22339 catalog_manager.cc:5697] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b3766de80037442fbcfbef7158ad1868 (127.14.78.66) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.035295 23380 raft_consensus.cc:993] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.035750 23368 raft_consensus.cc:1081] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.037148 23244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52146
I20260709 12:27:13.037599 23244 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.037943 23244 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.043001 23373 raft_consensus.cc:993] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.043555 23373 raft_consensus.cc:1081] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.044766 23244 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:13.045157 23243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:13.045751 23243 raft_consensus.cc:493] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.046068 23243 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.047561 23244 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 3 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:13.048269 22665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:13.048902 22665 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.049609 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6212b63ad2544469e53bc3d157e04a9" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:13.050177 22519 raft_consensus.cc:3055] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:13.050479 22519 raft_consensus.cc:740] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:13.051339 22519 consensus_queue.cc:260] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:13.052336 23243 raft_consensus.cc:515] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:13.052572 22519 raft_consensus.cc:3060] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.055078 23243 leader_election.cc:290] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 4 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:13.055061 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:13.055768 22518 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.057019 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c481bc7524854a8e81ad008f1c22b" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:13.057543 22590 raft_consensus.cc:3055] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:13.057771 22590 raft_consensus.cc:740] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:13.058347 22590 consensus_queue.cc:260] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:13.059532 22590 raft_consensus.cc:3060] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.059592 22519 raft_consensus.cc:2468] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 3.
I20260709 12:27:13.060628 23195 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:13.061437 23387 raft_consensus.cc:2804] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:13.061898 23387 raft_consensus.cc:697] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:13.062968 22665 raft_consensus.cc:2468] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 3.
I20260709 12:27:13.062791 23387 consensus_queue.cc:237] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:13.065748 22518 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 4.
I20260709 12:27:13.066833 23195 leader_election.cc:304] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:13.067620 23387 raft_consensus.cc:2804] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:13.068132 23387 raft_consensus.cc:697] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 4 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:13.068121 22590 raft_consensus.cc:2468] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 4.
I20260709 12:27:13.069319 23387 consensus_queue.cc:237] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:13.074366 22339 catalog_manager.cc:5697] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 2 to 3, leader changed from b3766de80037442fbcfbef7158ad1868 (127.14.78.66) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 3 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.091660 22339 catalog_manager.cc:5697] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 3 to 4, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 4 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.264171 23375 raft_consensus.cc:993] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:13.264635 23373 raft_consensus.cc:1081] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:13.266105 22665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eeef333a78947669db43fca25c58e78"
dest_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:46552
I20260709 12:27:13.266644 22665 raft_consensus.cc:493] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.267004 22665 raft_consensus.cc:3060] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.272446 22665 raft_consensus.cc:515] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:13.274578 22665 leader_election.cc:290] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:13.275180 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eeef333a78947669db43fca25c58e78" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:13.275835 22590 raft_consensus.cc:3055] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.275731 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eeef333a78947669db43fca25c58e78" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:13.276259 22590 raft_consensus.cc:740] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:13.276407 22518 raft_consensus.cc:3060] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.277146 22590 consensus_queue.cc:260] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:13.278371 22590 raft_consensus.cc:3060] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.283257 22518 raft_consensus.cc:2468] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:13.284665 22590 raft_consensus.cc:2468] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:13.284683 22633 leader_election.cc:304] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:13.285786 23376 raft_consensus.cc:2804] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.286233 23376 raft_consensus.cc:697] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:13.287058 23376 consensus_queue.cc:237] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:13.297561 22339 catalog_manager.cc:5697] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.372148 22518 raft_consensus.cc:1275] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.376104 22519 raft_consensus.cc:1275] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.377000 23387 consensus_queue.cc:1048] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:13.381412 23387 consensus_queue.cc:1048] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.392325 22590 raft_consensus.cc:1275] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.393857 23388 consensus_queue.cc:1048] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:13.406500 22665 raft_consensus.cc:1275] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.408449 23387 consensus_queue.cc:1048] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.465587 22516 raft_consensus.cc:1275] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 4 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:13.466756 23404 consensus_queue.cc:1048] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:13.478291 22590 raft_consensus.cc:1275] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 4 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:13.480403 23404 consensus_queue.cc:1048] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:13.559859 22665 raft_consensus.cc:1275] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:13.561014 23404 consensus_queue.cc:1048] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:13.572067 22516 raft_consensus.cc:1275] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:13.575105 23404 consensus_queue.cc:1048] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:13.784893 22591 raft_consensus.cc:1275] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.786353 23201 consensus_queue.cc:1048] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:13.798521 22516 raft_consensus.cc:1275] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:13.800084 23414 consensus_queue.cc:1048] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:13.868079 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:13.919292 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:13.919812 22591 raft_consensus.cc:606] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 1704a791486d41aca21c226c48b00d89
I20260709 12:27:13.922097 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37840b43da264e199e487917060afcd0"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:13.922501 22591 raft_consensus.cc:606] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:13.924777 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:13.925189 22591 raft_consensus.cc:606] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:13.927541 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:13.928069 22591 raft_consensus.cc:606] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:13.930608 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:13.931154 22591 raft_consensus.cc:606] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 1704a791486d41aca21c226c48b00d89
I20260709 12:27:13.932222 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:13.933785 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:13.934448 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:13.946369 23412 raft_consensus.cc:993] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.946972 23373 raft_consensus.cc:1081] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.948462 23244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37840b43da264e199e487917060afcd0"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:13.949002 23244 raft_consensus.cc:493] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.949383 23244 raft_consensus.cc:3060] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.956426 23244 raft_consensus.cc:515] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:13.958659 23244 leader_election.cc:290] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:13.958873 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:13.959467 22518 raft_consensus.cc:3060] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.959712 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37840b43da264e199e487917060afcd0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:13.960263 22591 raft_consensus.cc:3055] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.960492 22591 raft_consensus.cc:740] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:13.961220 22591 consensus_queue.cc:260] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:13.962040 22591 raft_consensus.cc:3060] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.965785 22518 raft_consensus.cc:2468] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:13.966847 23195 leader_election.cc:304] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:13.967131 22591 raft_consensus.cc:2468] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:13.967726 23388 raft_consensus.cc:2804] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:13.968194 23388 raft_consensus.cc:697] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:13.969024 23388 consensus_queue.cc:237] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:13.979053 22339 catalog_manager.cc:5697] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.981479 23373 raft_consensus.cc:993] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.982074 23412 raft_consensus.cc:1081] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:13.983546 23244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:13.984035 23244 raft_consensus.cc:493] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:13.984417 23244 raft_consensus.cc:3060] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.991168 23244 raft_consensus.cc:515] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:13.994015 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:13.994553 22591 raft_consensus.cc:3055] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.994848 22591 raft_consensus.cc:740] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:13.995555 22591 consensus_queue.cc:260] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:13.996284 22591 raft_consensus.cc:3060] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.997540 23244 leader_election.cc:290] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:13.998438 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f54eadf52a74cd88517b59b0c79507c" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:13.999037 22667 raft_consensus.cc:3060] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.002149 22591 raft_consensus.cc:2468] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:14.003190 23194 leader_election.cc:304] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:14.004173 23387 raft_consensus.cc:2804] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:14.004627 23387 raft_consensus.cc:697] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:14.005223 22667 raft_consensus.cc:2468] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:14.005479 23387 consensus_queue.cc:237] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:14.009645 23373 raft_consensus.cc:993] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:14.010125 23412 raft_consensus.cc:1081] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:14.011620 22667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4"
dest_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:46552
I20260709 12:27:14.011971 22667 raft_consensus.cc:493] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:14.012179 22667 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.017342 22667 raft_consensus.cc:515] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:14.017261 22339 catalog_manager.cc:5697] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.018944 22667 leader_election.cc:290] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:14.019706 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:14.020856 22518 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.020669 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:14.021649 22591 raft_consensus.cc:3055] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:14.021972 22591 raft_consensus.cc:740] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:14.025242 22591 consensus_queue.cc:260] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:14.026854 22591 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.030534 23373 raft_consensus.cc:993] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:14.031852 23375 raft_consensus.cc:1081] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:14.033473 22518 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:14.033378 22591 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:14.034782 22633 leader_election.cc:304] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:14.036087 23414 raft_consensus.cc:2804] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:14.036530 23414 raft_consensus.cc:697] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:14.038820 23414 consensus_queue.cc:237] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:14.040938 22665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514"
dest_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:46552
I20260709 12:27:14.041466 22665 raft_consensus.cc:493] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:14.041780 22665 raft_consensus.cc:3060] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.048401 22339 catalog_manager.cc:5697] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.048336 22665 raft_consensus.cc:515] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:14.051421 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:14.051959 22665 leader_election.cc:290] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:14.051976 22518 raft_consensus.cc:3060] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.052495 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc626c4c37b24f3eb817050fb30f6514" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:14.053097 22591 raft_consensus.cc:3055] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:14.053351 22591 raft_consensus.cc:740] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:14.056123 22591 consensus_queue.cc:260] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:14.058370 22518 raft_consensus.cc:2468] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:14.058972 22591 raft_consensus.cc:3060] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.059783 22633 leader_election.cc:304] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:14.060501 23414 raft_consensus.cc:2804] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:14.060917 23414 raft_consensus.cc:697] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:14.061702 23414 consensus_queue.cc:237] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:14.063652 22591 raft_consensus.cc:2468] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:14.070832 22339 catalog_manager.cc:5697] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.107295 23373 raft_consensus.cc:993] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:14.107766 23412 raft_consensus.cc:1081] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:14.109375 23244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:14.109834 23244 raft_consensus.cc:493] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:14.110105 23244 raft_consensus.cc:3060] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.114707 23244 raft_consensus.cc:515] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:14.116052 23244 leader_election.cc:290] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:14.116694 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:14.116948 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf864ca7eae4b90b7a573bcd2d4fe03" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:14.117405 22591 raft_consensus.cc:3055] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:14.117583 22667 raft_consensus.cc:3060] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.117723 22591 raft_consensus.cc:740] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:14.118563 22591 consensus_queue.cc:260] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:14.119740 22591 raft_consensus.cc:3060] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.123260 22667 raft_consensus.cc:2468] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:14.124265 23195 leader_election.cc:304] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:27:14.125097 23387 raft_consensus.cc:2804] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:14.125613 23387 raft_consensus.cc:697] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:14.126384 23387 consensus_queue.cc:237] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:14.126876 22591 raft_consensus.cc:2468] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:14.135900 22339 catalog_manager.cc:5697] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.360260 22518 raft_consensus.cc:1275] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.361589 23387 consensus_queue.cc:1048] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.371850 22591 raft_consensus.cc:1275] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.373210 23388 consensus_queue.cc:1048] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.421972 22519 raft_consensus.cc:1275] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.423132 23425 consensus_queue.cc:1048] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.440280 22591 raft_consensus.cc:1275] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.452157 23425 consensus_queue.cc:1048] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.482865 22591 raft_consensus.cc:1275] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.484297 23414 consensus_queue.cc:1048] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.493799 22519 raft_consensus.cc:1275] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.495225 23414 consensus_queue.cc:1048] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.557847 22591 raft_consensus.cc:1275] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.558949 23388 consensus_queue.cc:1048] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.569249 22665 raft_consensus.cc:1275] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.570848 23437 consensus_queue.cc:1048] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.571791 22665 raft_consensus.cc:1275] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.573766 23437 consensus_queue.cc:1048] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.587668 22591 raft_consensus.cc:1275] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.589078 23387 consensus_queue.cc:1048] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:14.980571 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:15.027933 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:15.029062 22590 raft_consensus.cc:606] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:15.032337 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:15.032847 22590 raft_consensus.cc:606] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:15.035302 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "b3766de80037442fbcfbef7158ad1868"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:15.035702 22590 raft_consensus.cc:606] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS b3766de80037442fbcfbef7158ad1868
I20260709 12:27:15.037930 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6050042789ac4564968285caf738cbfd"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:15.038409 22590 raft_consensus.cc:606] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:15.040633 22590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:15.041086 22590 raft_consensus.cc:606] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 1704a791486d41aca21c226c48b00d89
I20260709 12:27:15.042179 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:15.043313 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:15.044143 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:15.138863 23421 raft_consensus.cc:993] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:15.139277 23442 raft_consensus.cc:993] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:15.139464 23445 raft_consensus.cc:1081] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:15.140048 23421 raft_consensus.cc:1081] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 1704a791486d41aca21c226c48b00d89 to start an election
I20260709 12:27:15.141458 23247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6050042789ac4564968285caf738cbfd"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:15.141804 22665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66"
dest_uuid: "1704a791486d41aca21c226c48b00d89"
 from {username='slave'} at 127.0.0.1:46552
I20260709 12:27:15.142164 23247 raft_consensus.cc:493] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.142499 22665 raft_consensus.cc:493] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.142661 23247 raft_consensus.cc:3060] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.142935 22665 raft_consensus.cc:3060] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.153923 22665 raft_consensus.cc:515] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:15.154042 23247 raft_consensus.cc:515] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:15.156322 22665 leader_election.cc:290] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:15.156697 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:15.157155 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82e23baefcf48e78cfcbd3978804f66" candidate_uuid: "1704a791486d41aca21c226c48b00d89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:15.157368 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:15.157637 22518 raft_consensus.cc:3060] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.157807 22591 raft_consensus.cc:3055] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.158314 22591 raft_consensus.cc:740] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:15.159353 22591 consensus_queue.cc:260] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:15.160531 22591 raft_consensus.cc:3060] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.157929 22590 raft_consensus.cc:3055] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.161233 22590 raft_consensus.cc:740] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:15.162281 22590 consensus_queue.cc:260] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:15.163481 22590 raft_consensus.cc:3060] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.167128 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6050042789ac4564968285caf738cbfd" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:15.167769 22519 raft_consensus.cc:3060] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.169651 22518 raft_consensus.cc:2468] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:15.170238 22591 raft_consensus.cc:2468] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1704a791486d41aca21c226c48b00d89 in term 2.
I20260709 12:27:15.171352 22633 leader_election.cc:304] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:15.172374 23201 raft_consensus.cc:2804] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.172791 23201 raft_consensus.cc:697] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Becoming Leader. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:15.173671 23201 consensus_queue.cc:237] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:15.177277 23247 leader_election.cc:290] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:15.177340 22519 raft_consensus.cc:2468] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:15.178785 23195 leader_election.cc:304] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:15.179720 23388 raft_consensus.cc:2804] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.180163 23388 raft_consensus.cc:697] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:15.181026 23388 consensus_queue.cc:237] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:15.182147 22590 raft_consensus.cc:2468] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:15.193435 22340 catalog_manager.cc:5697] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.195113 22339 catalog_manager.cc:5697] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 1704a791486d41aca21c226c48b00d89 (127.14.78.68). New cstate: current_term: 2 leader_uuid: "1704a791486d41aca21c226c48b00d89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.198855 23445 raft_consensus.cc:993] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:15.200484 23445 raft_consensus.cc:1081] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:15.205493 23246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:15.206099 23246 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.206522 23246 raft_consensus.cc:3060] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.218057 23246 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:15.221624 23246 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:15.221907 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:15.222510 22590 raft_consensus.cc:3055] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.222767 22590 raft_consensus.cc:740] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:15.222883 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3faa19b604754a1382a3c631b4bb69ea" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:15.223413 22590 consensus_queue.cc:260] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:15.223789 22667 raft_consensus.cc:3060] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.224458 22590 raft_consensus.cc:3060] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.232594 22590 raft_consensus.cc:2468] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:15.233709 23194 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:15.235311 23388 raft_consensus.cc:2804] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.242139 23388 raft_consensus.cc:697] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:15.243039 23388 consensus_queue.cc:237] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:15.249917 23445 raft_consensus.cc:993] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower b3766de80037442fbcfbef7158ad1868 to start an election
I20260709 12:27:15.250705 23421 raft_consensus.cc:1081] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer b3766de80037442fbcfbef7158ad1868 to start an election
I20260709 12:27:15.252694 23373 raft_consensus.cc:993] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:15.253230 23373 raft_consensus.cc:1081] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:15.253903 22519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
 from {username='slave'} at 127.0.0.1:38682
I20260709 12:27:15.254491 22519 raft_consensus.cc:493] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.254829 22519 raft_consensus.cc:3060] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.255007 23246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:15.255643 23246 raft_consensus.cc:493] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.256042 23246 raft_consensus.cc:3060] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.255805 22667 raft_consensus.cc:2468] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:15.265650 22519 raft_consensus.cc:515] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:15.268270 22519 leader_election.cc:290] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:15.269153 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:15.268417 22339 catalog_manager.cc:5697] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.269511 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab59b0f3c2140c198fb8aeb30cf9389" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:15.269744 22590 raft_consensus.cc:3055] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.270040 22590 raft_consensus.cc:740] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:15.270059 22667 raft_consensus.cc:3060] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.270838 22590 consensus_queue.cc:260] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:15.272109 22590 raft_consensus.cc:3060] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.267831 23246 raft_consensus.cc:515] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:15.274668 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:15.275230 22591 raft_consensus.cc:3055] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.275527 22591 raft_consensus.cc:740] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:15.276345 22591 consensus_queue.cc:260] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:15.276906 22667 raft_consensus.cc:2468] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 2.
I20260709 12:27:15.277534 22591 raft_consensus.cc:3060] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.278865 22485 leader_election.cc:304] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:15.279790 23380 raft_consensus.cc:2804] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.280203 23380 raft_consensus.cc:697] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:15.280978 23380 consensus_queue.cc:237] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:15.281913 22590 raft_consensus.cc:2468] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 2.
I20260709 12:27:15.285831 23246 leader_election.cc:290] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:15.284610 22591 raft_consensus.cc:2468] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:15.287390 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1844b0368bfa419ca7922fd6c6d4a81f" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:15.287984 22667 raft_consensus.cc:3060] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.288219 23194 leader_election.cc:304] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:15.289016 23388 raft_consensus.cc:2804] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.289564 23388 raft_consensus.cc:697] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:15.290520 23388 consensus_queue.cc:237] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:15.297403 22667 raft_consensus.cc:2468] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:15.302109 22339 catalog_manager.cc:5697] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.312573 22340 catalog_manager.cc:5697] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.563165 22519 raft_consensus.cc:1275] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.564929 23425 consensus_queue.cc:1048] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:15.578727 22590 raft_consensus.cc:1275] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 1704a791486d41aca21c226c48b00d89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.579974 23459 consensus_queue.cc:1048] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:15.588515 22519 raft_consensus.cc:1275] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.589740 23388 consensus_queue.cc:1048] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.603952 22590 raft_consensus.cc:1275] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.608408 23404 consensus_queue.cc:1048] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.646507 22591 raft_consensus.cc:1275] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.647614 23387 consensus_queue.cc:1048] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.658262 22665 raft_consensus.cc:1275] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.659862 23388 consensus_queue.cc:1048] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.824744 22591 raft_consensus.cc:1275] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.826073 23388 consensus_queue.cc:1048] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.834961 22665 raft_consensus.cc:1275] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.836335 22591 raft_consensus.cc:1275] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.837718 23444 consensus_queue.cc:1048] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.837800 23404 consensus_queue.cc:1048] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.853790 22665 raft_consensus.cc:1275] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.855482 23462 consensus_queue.cc:1048] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.088774 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:16.146153 22665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4"
dest_uuid: "1704a791486d41aca21c226c48b00d89"
mode: GRACEFUL
new_leader_uuid: "b3766de80037442fbcfbef7158ad1868"
 from {username='slave'} at 127.0.0.1:54140
I20260709 12:27:16.146658 22665 raft_consensus.cc:606] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Received request to transfer leadership to TS b3766de80037442fbcfbef7158ad1868
I20260709 12:27:16.149940 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:16.150477 22591 raft_consensus.cc:606] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:16.153769 22591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52"
dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:27:16.154279 22591 raft_consensus.cc:606] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:16.161671 22519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:49476
I20260709 12:27:16.162184 22519 raft_consensus.cc:606] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:16.163745 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:27:16.165117 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:16.165719 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:16.292415 23442 raft_consensus.cc:993] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:16.292991 23412 raft_consensus.cc:1081] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:16.294559 23247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:16.295050 23247 raft_consensus.cc:493] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.295373 23247 raft_consensus.cc:3060] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.301051 23247 raft_consensus.cc:515] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:16.302902 23247 leader_election.cc:290] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:16.303602 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:16.304024 22591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dec979f13504b80853778e1e0e2f2c0" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:16.304395 22518 raft_consensus.cc:3060] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.304585 22591 raft_consensus.cc:3055] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.304900 22591 raft_consensus.cc:740] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:16.305671 22591 consensus_queue.cc:260] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:16.306878 22591 raft_consensus.cc:3060] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.310806 22518 raft_consensus.cc:2468] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:16.312048 23195 leader_election.cc:304] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868; no voters: 
I20260709 12:27:16.312908 23404 raft_consensus.cc:2804] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.313447 22591 raft_consensus.cc:2468] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:16.314184 23404 raft_consensus.cc:697] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:16.316082 23404 consensus_queue.cc:237] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:16.326627 22340 catalog_manager.cc:5697] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:16.437638 23425 raft_consensus.cc:993] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: : Instructing follower b3766de80037442fbcfbef7158ad1868 to start an election
I20260709 12:27:16.438074 23459 raft_consensus.cc:1081] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Signalling peer b3766de80037442fbcfbef7158ad1868 to start an election
I20260709 12:27:16.439527 22519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
 from {username='slave'} at 127.0.0.1:38692
I20260709 12:27:16.440057 22519 raft_consensus.cc:493] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.440354 22519 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.445367 22519 raft_consensus.cc:515] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:16.447314 22519 leader_election.cc:290] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 3 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:16.447829 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:16.447837 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b01a5d3d09f49098b1c8a295825a3e4" candidate_uuid: "b3766de80037442fbcfbef7158ad1868" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:16.448459 22667 raft_consensus.cc:3055] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:16.448557 22590 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.448822 22667 raft_consensus.cc:740] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1704a791486d41aca21c226c48b00d89, State: Running, Role: LEADER
I20260709 12:27:16.449692 22667 consensus_queue.cc:260] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:16.450956 22667 raft_consensus.cc:3060] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.455966 22590 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 3.
I20260709 12:27:16.457119 22484 leader_election.cc:304] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3766de80037442fbcfbef7158ad1868, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:16.457877 23444 raft_consensus.cc:2804] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:16.457913 22667 raft_consensus.cc:2468] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3766de80037442fbcfbef7158ad1868 in term 3.
I20260709 12:27:16.458451 23444 raft_consensus.cc:697] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 3 LEADER]: Becoming Leader. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:16.459395 23444 consensus_queue.cc:237] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } }
I20260709 12:27:16.468943 22340 catalog_manager.cc:5697] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 reported cstate change: term changed from 2 to 3, leader changed from 1704a791486d41aca21c226c48b00d89 (127.14.78.68) to b3766de80037442fbcfbef7158ad1868 (127.14.78.66). New cstate: current_term: 3 leader_uuid: "b3766de80037442fbcfbef7158ad1868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:16.549247 23444 raft_consensus.cc:993] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:16.549836 23444 raft_consensus.cc:1081] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:16.551332 23247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52146
I20260709 12:27:16.551769 23247 raft_consensus.cc:493] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.552047 23247 raft_consensus.cc:3060] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.559995 23247 raft_consensus.cc:515] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:16.561671 23247 leader_election.cc:290] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239), b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639)
I20260709 12:27:16.562752 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:16.563380 22590 raft_consensus.cc:3060] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.563503 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a24bc91e384d40a18eabd347212ba4" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:16.564036 22519 raft_consensus.cc:3055] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.564292 22519 raft_consensus.cc:740] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:16.564845 22519 consensus_queue.cc:260] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:16.565874 22519 raft_consensus.cc:3060] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.568912 22590 raft_consensus.cc:2468] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:16.569796 23194 leader_election.cc:304] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b; no voters: 
I20260709 12:27:16.570429 23404 raft_consensus.cc:2804] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.570858 23404 raft_consensus.cc:697] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:16.571842 23404 consensus_queue.cc:237] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } }
I20260709 12:27:16.573558 22519 raft_consensus.cc:2468] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:16.582718 22340 catalog_manager.cc:5697] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b3766de80037442fbcfbef7158ad1868 (127.14.78.66) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:16.585637 23412 raft_consensus.cc:993] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:16.586165 23442 raft_consensus.cc:1081] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:16.587779 23247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52126
I20260709 12:27:16.588276 23247 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.588608 23247 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.595220 23247 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:16.597517 23247 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 3 election: Requested vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965)
I20260709 12:27:16.598860 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:16.599468 22667 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.601523 22590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54217161e134ab3aeccf82f299bdf52" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b662aaf197d344acbc951b9da5cebf2b"
I20260709 12:27:16.602102 22590 raft_consensus.cc:3055] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:16.602385 22590 raft_consensus.cc:740] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b662aaf197d344acbc951b9da5cebf2b, State: Running, Role: LEADER
I20260709 12:27:16.602996 22590 consensus_queue.cc:260] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:16.603900 22590 raft_consensus.cc:3060] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.606051 22667 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 3.
I20260709 12:27:16.607252 23195 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:27:16.608114 23404 raft_consensus.cc:2804] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:16.608553 23404 raft_consensus.cc:697] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:16.608573 22590 raft_consensus.cc:2468] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 3.
I20260709 12:27:16.609510 23404 consensus_queue.cc:237] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:16.619761 22340 catalog_manager.cc:5697] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 2 to 3, leader changed from b662aaf197d344acbc951b9da5cebf2b (127.14.78.67) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 3 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.808660 22591 raft_consensus.cc:1275] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.809965 23404 consensus_queue.cc:1048] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.821094 22519 raft_consensus.cc:1275] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.822402 23388 consensus_queue.cc:1048] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.979089 22591 raft_consensus.cc:1275] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:16.981071 23380 consensus_queue.cc:1048] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:16.986191 22589 raft_consensus.cc:1275] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.989224 23388 consensus_queue.cc:1048] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.004762 22667 raft_consensus.cc:1275] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Refusing update from remote peer b3766de80037442fbcfbef7158ad1868: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:17.006285 23489 consensus_queue.cc:1048] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:17.026983 22518 raft_consensus.cc:1275] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.029968 23404 consensus_queue.cc:1048] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.123054 22590 raft_consensus.cc:1275] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:17.124643 23387 consensus_queue.cc:1048] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.136312 22665 raft_consensus.cc:1275] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:17.137780 23388 consensus_queue.cc:1048] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.204427 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:17.243172 22518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e"
dest_uuid: "b3766de80037442fbcfbef7158ad1868"
mode: GRACEFUL
new_leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:49476
I20260709 12:27:17.243919 22518 raft_consensus.cc:606] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Received request to transfer leadership to TS 7b50b6c210724c66b6ee01c04ab9676d
I20260709 12:27:17.245154 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:17.246218 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:17.246869 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:17.455955 23444 raft_consensus.cc:993] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: : Instructing follower 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:17.456459 23489 raft_consensus.cc:1081] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Signalling peer 7b50b6c210724c66b6ee01c04ab9676d to start an election
I20260709 12:27:17.457733 23246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e"
dest_uuid: "7b50b6c210724c66b6ee01c04ab9676d"
 from {username='slave'} at 127.0.0.1:52146
I20260709 12:27:17.458173 23246 raft_consensus.cc:493] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.458498 23246 raft_consensus.cc:3060] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.465435 23246 raft_consensus.cc:515] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:17.467344 23246 leader_election.cc:290] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Requested vote from peers 1704a791486d41aca21c226c48b00d89 (127.14.78.68:43965), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:17.467893 22667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1704a791486d41aca21c226c48b00d89"
I20260709 12:27:17.468277 22518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1533d020c6df4b0a969ce556adf9dc6e" candidate_uuid: "7b50b6c210724c66b6ee01c04ab9676d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3766de80037442fbcfbef7158ad1868"
I20260709 12:27:17.468515 22667 raft_consensus.cc:3060] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.468812 22518 raft_consensus.cc:3055] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.469200 22518 raft_consensus.cc:740] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3766de80037442fbcfbef7158ad1868, State: Running, Role: LEADER
I20260709 12:27:17.469861 22518 consensus_queue.cc:260] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:17.471115 22518 raft_consensus.cc:3060] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.474529 22667 raft_consensus.cc:2468] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:17.475512 23195 leader_election.cc:304] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1704a791486d41aca21c226c48b00d89, 7b50b6c210724c66b6ee01c04ab9676d; no voters: 
I20260709 12:27:17.478665 23497 raft_consensus.cc:2804] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:17.479130 23497 raft_consensus.cc:697] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Becoming Leader. State: Replica: 7b50b6c210724c66b6ee01c04ab9676d, State: Running, Role: LEADER
I20260709 12:27:17.480031 23497 consensus_queue.cc:237] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:17.489987 22518 raft_consensus.cc:2468] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b50b6c210724c66b6ee01c04ab9676d in term 2.
I20260709 12:27:17.499430 22339 catalog_manager.cc:5697] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d reported cstate change: term changed from 1 to 2, leader changed from b3766de80037442fbcfbef7158ad1868 (127.14.78.66) to 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65). New cstate: current_term: 2 leader_uuid: "7b50b6c210724c66b6ee01c04ab9676d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:17.888303 22665 raft_consensus.cc:1275] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.889379 23404 consensus_queue.cc:1048] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.901871 22516 raft_consensus.cc:1275] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Refusing update from remote peer 7b50b6c210724c66b6ee01c04ab9676d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:17.904038 23388 consensus_queue.cc:1048] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:18.283341 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.317065 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:18.318095 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:18.318660 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.351807 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.387420 14649 tablet_server.cc:179] TabletServer@127.14.78.65:34885 shutting down...
W20260709 12:27:18.389799 22483 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 88 similar messages]
W20260709 12:27:18.400693 22483 consensus_peers.cc:597] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.432174 22631 consensus_peers.cc:597] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.438815 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:18.439858 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.441010 14649 raft_consensus.cc:2243] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.441954 14649 raft_consensus.cc:2272] T 6050042789ac4564968285caf738cbfd P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.444083 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.444686 14649 raft_consensus.cc:2243] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.445153 14649 raft_consensus.cc:2272] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.447628 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.448464 14649 raft_consensus.cc:2243] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.448987 14649 raft_consensus.cc:2272] T 2a056e813b794e0bb9f0055705fc192a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.451638 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.452237 14649 raft_consensus.cc:2243] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.452687 14649 raft_consensus.cc:2272] T 21c2cfe20d2945009689b68b54859bdc P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.455265 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.456197 14649 raft_consensus.cc:2243] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.456748 14649 raft_consensus.cc:2272] T 2354de9b29b94e98875230231b43cf19 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.459471 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.460352 14649 raft_consensus.cc:2243] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.461241 14649 raft_consensus.cc:2272] T 0dec979f13504b80853778e1e0e2f2c0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:18.461642 22557 consensus_peers.cc:597] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.463603 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.464165 14649 raft_consensus.cc:2243] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.464504 14649 raft_consensus.cc:2272] T 8051a982a56c4bd6a92fe0fcc84095e6 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.467145 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.467892 14649 raft_consensus.cc:2243] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.468380 14649 raft_consensus.cc:2272] T ff440e4e2d764ef1ae95785dc37916bd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.471849 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.472728 14649 raft_consensus.cc:2243] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.473336 14649 raft_consensus.cc:2272] T 8e68bab18985498ba50de54dca27ab78 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.475567 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.476101 14649 raft_consensus.cc:2243] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.476436 14649 raft_consensus.cc:2272] T d11e7fd15033436594cf4c660a36ef40 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.478613 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.479350 14649 raft_consensus.cc:2243] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.479862 14649 raft_consensus.cc:2272] T 97bf3648f5b74bf6a70e11f336dc788e P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.482131 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.482764 14649 raft_consensus.cc:2243] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.483534 14649 raft_consensus.cc:2272] T e6212b63ad2544469e53bc3d157e04a9 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.485509 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.486025 14649 raft_consensus.cc:2243] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.486399 14649 raft_consensus.cc:2272] T 2027b04cc47c4770a74b4e67e631780b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.488507 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.489078 14649 raft_consensus.cc:2243] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.489593 14649 raft_consensus.cc:2272] T afb9c110162141dbbeb161a2aaa00e82 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.491580 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.492074 14649 raft_consensus.cc:2243] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.492456 14649 raft_consensus.cc:2272] T 347648ceea81494ab02439c3c0cbb346 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.494357 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.495028 14649 raft_consensus.cc:2243] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.495553 14649 raft_consensus.cc:2272] T 53e50879db9d44aaaac554d982fb8377 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.498219 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.498812 14649 raft_consensus.cc:2243] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.499176 14649 raft_consensus.cc:2272] T d909a252b3344a49aa050687c81371f1 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.501746 14649 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:18.502199 22631 consensus_peers.cc:597] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.502379 14649 raft_consensus.cc:2243] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.503289 14649 raft_consensus.cc:2272] T 8c4c481bc7524854a8e81ad008f1c22b P 7b50b6c210724c66b6ee01c04ab9676d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.505396 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.506053 14649 raft_consensus.cc:2243] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.506776 14649 raft_consensus.cc:2272] T 1844b0368bfa419ca7922fd6c6d4a81f P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.508930 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.509482 14649 raft_consensus.cc:2243] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.510138 14649 raft_consensus.cc:2272] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.512145 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.512766 14649 raft_consensus.cc:2243] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.513273 14649 raft_consensus.cc:2272] T 8232aac5b6cf43f79a9dcb0181721fb3 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:18.515307 22557 consensus_peers.cc:597] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.516016 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.516692 14649 raft_consensus.cc:2243] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.517439 14649 raft_consensus.cc:2272] T f6a24bc91e384d40a18eabd347212ba4 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.519479 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.520177 14649 raft_consensus.cc:2243] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.520604 14649 raft_consensus.cc:2272] T 0c00de8d7389494ebc91a22801a56392 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.523440 14649 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:18.523931 22483 consensus_peers.cc:597] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.524195 14649 raft_consensus.cc:2243] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.525265 14649 raft_consensus.cc:2272] T 37840b43da264e199e487917060afcd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.527829 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.528478 14649 raft_consensus.cc:2243] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.528911 14649 raft_consensus.cc:2272] T e64be06c2f304bb0bc47273eb5b3443a P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.532035 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.532611 14649 raft_consensus.cc:2243] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.533104 14649 raft_consensus.cc:2272] T e1e0af41092c454cb010bef793f8ee91 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.535929 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.536676 14649 raft_consensus.cc:2243] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.537168 14649 raft_consensus.cc:2272] T caf37be188fc415084a391ababe64d34 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.539860 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.540616 14649 raft_consensus.cc:2243] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.541162 14649 raft_consensus.cc:2272] T 01570c53874f495494092ddc9bb43c05 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.543844 14649 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:18.543853 22557 consensus_peers.cc:597] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.544625 14649 raft_consensus.cc:2243] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.545466 14649 raft_consensus.cc:2272] T a0e89b4817634267af8055d08a1b1f72 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.547371 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.547943 14649 raft_consensus.cc:2243] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.548799 14649 raft_consensus.cc:2272] T d7389131679245b79dae4f4f256f4bd0 P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.552615 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.553177 14649 raft_consensus.cc:2243] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.553649 14649 raft_consensus.cc:2272] T 5b2297d3b48646d290a82d37a12edfe4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.556584 14649 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:18.556669 22557 consensus_peers.cc:597] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.557289 14649 raft_consensus.cc:2243] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.557818 14649 raft_consensus.cc:2272] T 08b620a48e004eb98b5a6e7b1872a55b P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.560155 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.560730 14649 raft_consensus.cc:2243] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.561161 14649 raft_consensus.cc:2272] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.563491 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.564100 14649 raft_consensus.cc:2243] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.564495 14649 raft_consensus.cc:2272] T 890e148410fe4d348d9bb67d9b26e53c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:18.564929 22483 consensus_peers.cc:597] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.566507 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.567111 14649 raft_consensus.cc:2243] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.567487 14649 raft_consensus.cc:2272] T 81ad0895a1da4871ab543142576039f5 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.569370 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.569855 14649 raft_consensus.cc:2243] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.570523 14649 raft_consensus.cc:2272] T 1533d020c6df4b0a969ce556adf9dc6e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.572543 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.573172 14649 raft_consensus.cc:2243] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.573545 14649 raft_consensus.cc:2272] T eed4a7e6a404436dafc8fa216c27bbb4 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.575834 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.576565 14649 raft_consensus.cc:2243] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.577047 14649 raft_consensus.cc:2272] T b957090ae4e240fdbd7eeca1dc5f62fd P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:18.578333 22483 consensus_peers.cc:597] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.579838 14649 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:18.579700 22631 consensus_peers.cc:597] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.580708 14649 raft_consensus.cc:2243] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.581229 14649 raft_consensus.cc:2272] T f7825c613d9040b1bd0b0a76c9ab864e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.583773 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.584462 14649 raft_consensus.cc:2243] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.584806 14649 raft_consensus.cc:2272] T c1e9a4f6e8ed40e5a1854b3462b79964 P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.586913 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.587402 14649 raft_consensus.cc:2243] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.588044 14649 raft_consensus.cc:2272] T a54217161e134ab3aeccf82f299bdf52 P 7b50b6c210724c66b6ee01c04ab9676d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.589927 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.590368 14649 raft_consensus.cc:2243] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.590730 14649 raft_consensus.cc:2272] T e89d8ff5add1411fb67886f3c197525e P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.592667 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.593163 14649 raft_consensus.cc:2243] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.593648 14649 raft_consensus.cc:2272] T 00fa50014add43a18981a5a1af88f89c P 7b50b6c210724c66b6ee01c04ab9676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.596125 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.596580 14649 raft_consensus.cc:2243] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.597368 14649 raft_consensus.cc:2272] T 9f54eadf52a74cd88517b59b0c79507c P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.599135 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:18.599581 14649 raft_consensus.cc:2243] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.600378 14649 raft_consensus.cc:2272] T 3faa19b604754a1382a3c631b4bb69ea P 7b50b6c210724c66b6ee01c04ab9676d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:18.633992 22483 consensus_peers.cc:597] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.637934 22483 consensus_peers.cc:597] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.648736 22631 consensus_peers.cc:597] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.652444 22557 consensus_peers.cc:597] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.678642 14649 tablet_server.cc:196] TabletServer@127.14.78.65:34885 shutdown complete.
W20260709 12:27:18.687496 22483 consensus_peers.cc:597] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.689759 22483 consensus_peers.cc:597] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.692065 22631 consensus_peers.cc:597] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.741501 22631 consensus_peers.cc:597] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.744776 22557 consensus_peers.cc:597] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.747725 22557 consensus_peers.cc:597] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.763929 22631 consensus_peers.cc:597] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.764508 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
W20260709 12:27:18.771729 22557 consensus_peers.cc:597] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.793072 22633 consensus_peers.cc:597] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.809715 22483 consensus_peers.cc:597] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.810729 22557 consensus_peers.cc:597] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.818504 22557 consensus_peers.cc:597] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.818959 22557 consensus_peers.cc:597] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.825238 22557 consensus_peers.cc:597] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.985883 22483 consensus_peers.cc:597] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.987972 22559 consensus_peers.cc:597] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.988881 22559 consensus_peers.cc:597] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.989457 22559 consensus_peers.cc:597] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.997957 22633 consensus_peers.cc:597] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:18.999955 22633 consensus_peers.cc:597] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.001807 22631 consensus_peers.cc:597] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.012168 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:19.014993 14649 tablet_replica.cc:333] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.017611 14649 raft_consensus.cc:2243] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.018421 14649 raft_consensus.cc:2272] T 97bf3648f5b74bf6a70e11f336dc788e P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.020553 14649 tablet_replica.cc:333] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.021399 14649 raft_consensus.cc:2243] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.021960 14649 raft_consensus.cc:2272] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.026221 22557 consensus_peers.cc:597] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b -> Peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Couldn't send request to peer 7b50b6c210724c66b6ee01c04ab9676d. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.028154 14649 tablet_replica.cc:333] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.029129 14649 raft_consensus.cc:2243] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.029659 14649 raft_consensus.cc:2272] T b957090ae4e240fdbd7eeca1dc5f62fd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.030686 22633 consensus_peers.cc:597] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.032614 14649 tablet_replica.cc:333] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
W20260709 12:27:19.032711 22559 consensus_peers.cc:597] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.033492 14649 raft_consensus.cc:2243] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.033954 14649 raft_consensus.cc:2272] T 6050042789ac4564968285caf738cbfd P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.038102 14649 tablet_replica.cc:333] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.038894 14649 raft_consensus.cc:2243] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.039391 14649 raft_consensus.cc:2272] T 53e50879db9d44aaaac554d982fb8377 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.039894 22633 consensus_peers.cc:597] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.041530 14649 tablet_replica.cc:333] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.042320 14649 raft_consensus.cc:2243] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.042855 14649 raft_consensus.cc:2272] T 48be715b16cb41ebbc7dd26ce297706b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.045357 14649 tablet_replica.cc:333] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.046162 14649 raft_consensus.cc:2243] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.047044 14649 raft_consensus.cc:2272] T f7825c613d9040b1bd0b0a76c9ab864e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.049391 14649 tablet_replica.cc:333] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.050118 14649 raft_consensus.cc:2243] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.050695 14649 raft_consensus.cc:2272] T 347648ceea81494ab02439c3c0cbb346 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.053454 14649 tablet_replica.cc:333] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.054230 14649 raft_consensus.cc:2243] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.054735 14649 raft_consensus.cc:2272] T cae0b622804545ada0418c3cd4bfa2b5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.057161 14649 tablet_replica.cc:333] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.057969 14649 raft_consensus.cc:2243] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.058576 14649 raft_consensus.cc:2272] T e6212b63ad2544469e53bc3d157e04a9 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.061252 14649 tablet_replica.cc:333] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.061772 14649 raft_consensus.cc:2243] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.062621 14649 raft_consensus.cc:2272] T 2027b04cc47c4770a74b4e67e631780b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.065181 14649 tablet_replica.cc:333] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.065953 14649 raft_consensus.cc:2243] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:19.066646 22633 consensus_peers.cc:597] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.072144 14649 raft_consensus.cc:2272] T e663a8692ca14cefbe1c5e449bcdd818 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.074997 14649 tablet_replica.cc:333] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.075778 14649 raft_consensus.cc:2243] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.076733 14649 raft_consensus.cc:2272] T eed4a7e6a404436dafc8fa216c27bbb4 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.079264 14649 tablet_replica.cc:333] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.079754 14649 raft_consensus.cc:2243] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.080395 14649 raft_consensus.cc:2272] T 2a056e813b794e0bb9f0055705fc192a P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.082126 14649 tablet_replica.cc:333] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.082593 14649 raft_consensus.cc:2243] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.083225 14649 raft_consensus.cc:2272] T 323fb614c73f476e882fd71e0015db18 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.084769 14649 tablet_replica.cc:333] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.085294 14649 raft_consensus.cc:2243] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.085668 14649 raft_consensus.cc:2272] T d7389131679245b79dae4f4f256f4bd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.087553 14649 tablet_replica.cc:333] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.088114 14649 raft_consensus.cc:2243] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.088963 14649 raft_consensus.cc:2272] T 01570c53874f495494092ddc9bb43c05 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.090873 14649 tablet_replica.cc:333] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.091444 14649 raft_consensus.cc:2243] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.091876 14649 raft_consensus.cc:2272] T a0e89b4817634267af8055d08a1b1f72 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.094139 14649 tablet_replica.cc:333] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.094661 14649 raft_consensus.cc:2243] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.095048 14649 raft_consensus.cc:2272] T 08b620a48e004eb98b5a6e7b1872a55b P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.096778 14649 tablet_replica.cc:333] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.097366 14649 raft_consensus.cc:2243] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.097795 14649 raft_consensus.cc:2272] T c8474847f8e04fd58b6b04a2bce93bee P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.099699 14649 tablet_replica.cc:333] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.100188 14649 raft_consensus.cc:2243] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.100579 14649 raft_consensus.cc:2272] T 37840b43da264e199e487917060afcd0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.102367 14649 tablet_replica.cc:333] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.102886 14649 raft_consensus.cc:2243] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.103449 14649 raft_consensus.cc:2272] T e64be06c2f304bb0bc47273eb5b3443a P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.105527 14649 tablet_replica.cc:333] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.106204 14649 raft_consensus.cc:2243] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.106951 14649 raft_consensus.cc:2272] T caf37be188fc415084a391ababe64d34 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.108763 14649 tablet_replica.cc:333] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.109409 14649 raft_consensus.cc:2243] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.109814 14649 raft_consensus.cc:2272] T dc626c4c37b24f3eb817050fb30f6514 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.111642 14649 tablet_replica.cc:333] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.112149 14649 raft_consensus.cc:2243] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.112560 14649 raft_consensus.cc:2272] T ff440e4e2d764ef1ae95785dc37916bd P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.114848 14649 tablet_replica.cc:333] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.115477 14649 raft_consensus.cc:2243] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.116180 14649 raft_consensus.cc:2272] T 6b0804e286664773b5ec173401e74bfc P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.118391 14649 tablet_replica.cc:333] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.119052 14649 raft_consensus.cc:2243] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.119552 14649 raft_consensus.cc:2272] T f6a24bc91e384d40a18eabd347212ba4 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.122020 14649 tablet_replica.cc:333] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
W20260709 12:27:19.122447 22633 consensus_peers.cc:597] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.122648 14649 raft_consensus.cc:2243] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.123301 14649 raft_consensus.cc:2272] T 3eeef333a78947669db43fca25c58e78 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.125491 14649 tablet_replica.cc:333] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.126003 14649 raft_consensus.cc:2243] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.126415 14649 raft_consensus.cc:2272] T 1533d020c6df4b0a969ce556adf9dc6e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.128048 14649 tablet_replica.cc:333] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.128594 14649 raft_consensus.cc:2243] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.128991 14649 raft_consensus.cc:2272] T 890e148410fe4d348d9bb67d9b26e53c P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.131103 14649 tablet_replica.cc:333] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.131799 14649 raft_consensus.cc:2243] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.132718 14649 raft_consensus.cc:2272] T 81ad0895a1da4871ab543142576039f5 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.134605 14649 tablet_replica.cc:333] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.135042 14649 raft_consensus.cc:2243] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.135403 14649 raft_consensus.cc:2272] T 21c2cfe20d2945009689b68b54859bdc P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.137703 14649 tablet_replica.cc:333] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.138240 14649 raft_consensus.cc:2243] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.138747 14649 raft_consensus.cc:2272] T 00fa50014add43a18981a5a1af88f89c P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.140937 14649 tablet_replica.cc:333] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.141637 14649 raft_consensus.cc:2243] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.142145 14649 raft_consensus.cc:2272] T e89d8ff5add1411fb67886f3c197525e P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.144084 22633 consensus_peers.cc:597] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.144731 14649 tablet_replica.cc:333] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.145406 14649 raft_consensus.cc:2243] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.145884 14649 raft_consensus.cc:2272] T e82e23baefcf48e78cfcbd3978804f66 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.148291 14649 tablet_replica.cc:333] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.148926 14649 raft_consensus.cc:2243] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.149391 14649 raft_consensus.cc:2272] T 8232aac5b6cf43f79a9dcb0181721fb3 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.151738 14649 tablet_replica.cc:333] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.152248 14649 raft_consensus.cc:2243] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.152732 14649 raft_consensus.cc:2272] T 8c4c481bc7524854a8e81ad008f1c22b P b3766de80037442fbcfbef7158ad1868 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.154655 22559 consensus_peers.cc:597] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.155314 14649 tablet_replica.cc:333] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.156092 14649 raft_consensus.cc:2243] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.156993 14649 raft_consensus.cc:2272] T 0b01a5d3d09f49098b1c8a295825a3e4 P b3766de80037442fbcfbef7158ad1868 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.157088 22633 consensus_peers.cc:597] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.159171 14649 tablet_replica.cc:333] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.159672 14649 raft_consensus.cc:2243] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.160418 14649 raft_consensus.cc:2272] T d909a252b3344a49aa050687c81371f1 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.162595 14649 tablet_replica.cc:333] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.163117 14649 raft_consensus.cc:2243] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.163508 14649 raft_consensus.cc:2272] T 34b4e6a3678b4214ab4cd68a86f36c7d P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.165627 14649 tablet_replica.cc:333] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.166141 14649 raft_consensus.cc:2243] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.166824 14649 raft_consensus.cc:2272] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.168558 14649 tablet_replica.cc:333] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.169076 14649 raft_consensus.cc:2243] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.169795 14649 raft_consensus.cc:2272] T 0c00de8d7389494ebc91a22801a56392 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.171720 14649 tablet_replica.cc:333] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
I20260709 12:27:19.172287 14649 raft_consensus.cc:2243] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.173089 14649 raft_consensus.cc:2272] T 9a9971a97d734f6195685a52c3a70d69 P b3766de80037442fbcfbef7158ad1868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.175393 14649 tablet_replica.cc:333] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868: stopping tablet replica
W20260709 12:27:19.175918 22633 consensus_peers.cc:597] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.175968 14649 raft_consensus.cc:2243] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.177119 14649 raft_consensus.cc:2272] T 0dec979f13504b80853778e1e0e2f2c0 P b3766de80037442fbcfbef7158ad1868 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.182616 22559 consensus_peers.cc:597] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.183594 22633 consensus_peers.cc:597] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.204857 22559 consensus_peers.cc:597] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.210676 22633 consensus_peers.cc:597] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.246976 22559 consensus_peers.cc:597] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b -> Peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Couldn't send request to peer b3766de80037442fbcfbef7158ad1868. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:35239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.260196 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
I20260709 12:27:19.338166 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
W20260709 12:27:19.387883 22632 consensus_peers.cc:597] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.390645 22632 consensus_peers.cc:597] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.392040 22632 consensus_peers.cc:597] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.400046 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:19.400918 14649 tablet_replica.cc:333] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.401924 14649 raft_consensus.cc:2243] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.402511 14649 raft_consensus.cc:2272] T 9f54eadf52a74cd88517b59b0c79507c P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.404366 14649 tablet_replica.cc:333] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.404889 14649 raft_consensus.cc:2243] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.405908 14649 raft_consensus.cc:2272] T 337431b8a27e4b17ac0a96ce4f9bfa1f P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.408622 14649 tablet_replica.cc:333] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.409410 14649 raft_consensus.cc:2243] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.410454 14649 raft_consensus.cc:2272] T b957090ae4e240fdbd7eeca1dc5f62fd P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.412570 22632 consensus_peers.cc:597] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.413133 14649 tablet_replica.cc:333] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.413771 14649 raft_consensus.cc:2243] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.414446 14649 raft_consensus.cc:2272] T e1e0af41092c454cb010bef793f8ee91 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.416174 14649 tablet_replica.cc:333] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.416714 14649 raft_consensus.cc:2243] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.417191 14649 raft_consensus.cc:2272] T 37840b43da264e199e487917060afcd0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.418980 14649 tablet_replica.cc:333] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.419535 14649 raft_consensus.cc:2243] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.420251 14649 raft_consensus.cc:2272] T 53e50879db9d44aaaac554d982fb8377 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.422079 14649 tablet_replica.cc:333] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.422928 14649 raft_consensus.cc:2243] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.423736 14649 raft_consensus.cc:2272] T 2354de9b29b94e98875230231b43cf19 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.425712 14649 tablet_replica.cc:333] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.426448 14649 raft_consensus.cc:2243] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.426980 14649 raft_consensus.cc:2272] T 6050042789ac4564968285caf738cbfd P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.429162 14649 tablet_replica.cc:333] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.429860 14649 raft_consensus.cc:2243] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.430315 14649 raft_consensus.cc:2272] T cae0b622804545ada0418c3cd4bfa2b5 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.432487 14649 tablet_replica.cc:333] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.433205 14649 raft_consensus.cc:2243] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.433684 14649 raft_consensus.cc:2272] T e663a8692ca14cefbe1c5e449bcdd818 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.435835 14649 tablet_replica.cc:333] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.436350 14649 raft_consensus.cc:2243] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.436779 14649 raft_consensus.cc:2272] T f7825c613d9040b1bd0b0a76c9ab864e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.438553 14649 tablet_replica.cc:333] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.439083 14649 raft_consensus.cc:2243] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.439502 14649 raft_consensus.cc:2272] T 48be715b16cb41ebbc7dd26ce297706b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.441259 14649 tablet_replica.cc:333] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.441761 14649 raft_consensus.cc:2243] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.442482 14649 raft_consensus.cc:2272] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.444177 14649 tablet_replica.cc:333] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.444700 14649 raft_consensus.cc:2243] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.445173 14649 raft_consensus.cc:2272] T eed4a7e6a404436dafc8fa216c27bbb4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.446910 14649 tablet_replica.cc:333] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.447408 14649 raft_consensus.cc:2243] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.448133 14649 raft_consensus.cc:2272] T 8051a982a56c4bd6a92fe0fcc84095e6 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.449864 14649 tablet_replica.cc:333] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.450503 14649 raft_consensus.cc:2243] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.451403 14649 raft_consensus.cc:2272] T c8474847f8e04fd58b6b04a2bce93bee P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.454007 14649 tablet_replica.cc:333] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.454671 14649 raft_consensus.cc:2243] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.455155 14649 raft_consensus.cc:2272] T dc626c4c37b24f3eb817050fb30f6514 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.457504 14649 tablet_replica.cc:333] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.458241 14649 raft_consensus.cc:2243] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.458695 14649 raft_consensus.cc:2272] T afb9c110162141dbbeb161a2aaa00e82 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.460543 14649 tablet_replica.cc:333] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.461095 14649 raft_consensus.cc:2243] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.461567 14649 raft_consensus.cc:2272] T f6a24bc91e384d40a18eabd347212ba4 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.463310 14649 tablet_replica.cc:333] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.463754 14649 raft_consensus.cc:2243] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.464372 14649 raft_consensus.cc:2272] T 21c2cfe20d2945009689b68b54859bdc P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.466205 14649 tablet_replica.cc:333] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.466681 14649 raft_consensus.cc:2243] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.467660 14649 raft_consensus.cc:2272] T e89d8ff5add1411fb67886f3c197525e P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.470301 14649 tablet_replica.cc:333] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.471040 14649 raft_consensus.cc:2243] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.471599 14649 raft_consensus.cc:2272] T d11e7fd15033436594cf4c660a36ef40 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.474377 14649 tablet_replica.cc:333] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.475070 14649 raft_consensus.cc:2243] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.475626 14649 raft_consensus.cc:2272] T 6b0804e286664773b5ec173401e74bfc P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.478250 14649 tablet_replica.cc:333] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.478924 14649 raft_consensus.cc:2243] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.479409 14649 raft_consensus.cc:2272] T 0b01a5d3d09f49098b1c8a295825a3e4 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.481731 14649 tablet_replica.cc:333] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.482211 14649 raft_consensus.cc:2243] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.482933 14649 raft_consensus.cc:2272] T 8232aac5b6cf43f79a9dcb0181721fb3 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.485173 14649 tablet_replica.cc:333] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.485971 14649 raft_consensus.cc:2243] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.486515 14649 raft_consensus.cc:2272] T bbf864ca7eae4b90b7a573bcd2d4fe03 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.488770 14649 tablet_replica.cc:333] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.489312 14649 raft_consensus.cc:2243] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.489712 14649 raft_consensus.cc:2272] T 8c4c481bc7524854a8e81ad008f1c22b P b662aaf197d344acbc951b9da5cebf2b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.491524 14649 tablet_replica.cc:333] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.491981 14649 raft_consensus.cc:2243] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.492308 14649 raft_consensus.cc:2272] T 1844b0368bfa419ca7922fd6c6d4a81f P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.494063 14649 tablet_replica.cc:333] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.494541 14649 raft_consensus.cc:2243] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.494859 14649 raft_consensus.cc:2272] T a54217161e134ab3aeccf82f299bdf52 P b662aaf197d344acbc951b9da5cebf2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.496539 14649 tablet_replica.cc:333] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.497165 14649 raft_consensus.cc:2243] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.498099 14649 raft_consensus.cc:2272] T c1e9a4f6e8ed40e5a1854b3462b79964 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.500417 22632 consensus_peers.cc:597] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.500593 14649 tablet_replica.cc:333] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.501286 14649 raft_consensus.cc:2243] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.501731 14649 raft_consensus.cc:2272] T 34b4e6a3678b4214ab4cd68a86f36c7d P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.503638 14649 tablet_replica.cc:333] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.504151 14649 raft_consensus.cc:2243] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.504535 14649 raft_consensus.cc:2272] T 4ab59b0f3c2140c198fb8aeb30cf9389 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.506326 14649 tablet_replica.cc:333] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.506851 14649 raft_consensus.cc:2243] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.507284 14649 raft_consensus.cc:2272] T 0c00de8d7389494ebc91a22801a56392 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.509865 14649 tablet_replica.cc:333] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.510537 14649 raft_consensus.cc:2243] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.510998 14649 raft_consensus.cc:2272] T 3faa19b604754a1382a3c631b4bb69ea P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.512964 14649 tablet_replica.cc:333] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.513505 14649 raft_consensus.cc:2243] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.513899 14649 raft_consensus.cc:2272] T 9a9971a97d734f6195685a52c3a70d69 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.515689 14649 tablet_replica.cc:333] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.516280 14649 raft_consensus.cc:2243] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.516682 14649 raft_consensus.cc:2272] T 0dec979f13504b80853778e1e0e2f2c0 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.518486 14649 tablet_replica.cc:333] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.519032 14649 raft_consensus.cc:2243] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.519964 14649 raft_consensus.cc:2272] T 8e68bab18985498ba50de54dca27ab78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.522166 14649 tablet_replica.cc:333] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.522684 14649 raft_consensus.cc:2243] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.523137 14649 raft_consensus.cc:2272] T 3eeef333a78947669db43fca25c58e78 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.524889 14649 tablet_replica.cc:333] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.525365 14649 raft_consensus.cc:2243] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.525691 14649 raft_consensus.cc:2272] T e82e23baefcf48e78cfcbd3978804f66 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.527377 14649 tablet_replica.cc:333] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.527835 14649 raft_consensus.cc:2243] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.528196 14649 raft_consensus.cc:2272] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.529999 14649 tablet_replica.cc:333] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.530474 14649 raft_consensus.cc:2243] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.530997 14649 raft_consensus.cc:2272] T 323fb614c73f476e882fd71e0015db18 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.532811 14649 tablet_replica.cc:333] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.533349 14649 raft_consensus.cc:2243] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.533723 14649 raft_consensus.cc:2272] T a0e89b4817634267af8055d08a1b1f72 P b662aaf197d344acbc951b9da5cebf2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.535720 14649 tablet_replica.cc:333] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.536499 14649 raft_consensus.cc:2243] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.537489 14649 raft_consensus.cc:2272] T 08b620a48e004eb98b5a6e7b1872a55b P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.539937 14649 tablet_replica.cc:333] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b: stopping tablet replica
I20260709 12:27:19.540527 14649 raft_consensus.cc:2243] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.541477 14649 raft_consensus.cc:2272] T 5b2297d3b48646d290a82d37a12edfe4 P b662aaf197d344acbc951b9da5cebf2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.601198 23525 raft_consensus.cc:493] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:19.601619 23525 raft_consensus.cc:515] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:19.603410 23525 leader_election.cc:290] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:19.608283 23525 raft_consensus.cc:493] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:19.608772 23525 raft_consensus.cc:515] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
W20260709 12:27:19.609827 22631 leader_election.cc:336] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111)
I20260709 12:27:19.611657 23525 leader_election.cc:290] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
W20260709 12:27:19.621384 22632 leader_election.cc:336] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111)
I20260709 12:27:19.621801 22632 leader_election.cc:304] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:27:19.622582 23523 raft_consensus.cc:2749] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:19.624524 22631 leader_election.cc:336] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111)
W20260709 12:27:19.630021 22632 leader_election.cc:336] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111)
I20260709 12:27:19.629983 23525 raft_consensus.cc:493] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:19.630550 22632 leader_election.cc:304] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:27:19.631247 23523 raft_consensus.cc:2749] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:19.630738 23525 raft_consensus.cc:515] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:19.634040 23525 leader_election.cc:290] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
W20260709 12:27:19.637784 22633 leader_election.cc:336] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Network error: Client connection negotiation failed: client connection to 127.14.78.66:35239: connect: Connection refused (error 111)
W20260709 12:27:19.638813 22631 leader_election.cc:336] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111)
I20260709 12:27:19.639269 22631 leader_election.cc:304] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:27:19.639935 23525 raft_consensus.cc:2749] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:19.641716 23525 raft_consensus.cc:493] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:19.641887 23523 raft_consensus.cc:493] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7b50b6c210724c66b6ee01c04ab9676d)
I20260709 12:27:19.642212 23525 raft_consensus.cc:515] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b662aaf197d344acbc951b9da5cebf2b" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 33639 } } peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } }
I20260709 12:27:19.642428 23523 raft_consensus.cc:515] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1704a791486d41aca21c226c48b00d89" member_type: VOTER last_known_addr { host: "127.14.78.68" port: 43965 } } peers { permanent_uuid: "7b50b6c210724c66b6ee01c04ab9676d" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 34885 } } peers { permanent_uuid: "b3766de80037442fbcfbef7158ad1868" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35239 } }
I20260709 12:27:19.644316 23525 leader_election.cc:290] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639), 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885)
I20260709 12:27:19.644316 23523 leader_election.cc:290] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885), b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239)
I20260709 12:27:19.645906 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
W20260709 12:27:19.649214 22631 leader_election.cc:336] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111)
W20260709 12:27:19.649727 22631 leader_election.cc:336] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7b50b6c210724c66b6ee01c04ab9676d (127.14.78.65:34885): Network error: Client connection negotiation failed: client connection to 127.14.78.65:34885: connect: Connection refused (error 111)
W20260709 12:27:19.650478 22633 leader_election.cc:336] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b3766de80037442fbcfbef7158ad1868 (127.14.78.66:35239): Network error: Client connection negotiation failed: client connection to 127.14.78.66:35239: connect: Connection refused (error 111)
I20260709 12:27:19.650961 22633 leader_election.cc:304] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b3766de80037442fbcfbef7158ad1868
I20260709 12:27:19.651773 23523 raft_consensus.cc:2749] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:19.652433 22632 leader_election.cc:336] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111)
I20260709 12:27:19.652783 22632 leader_election.cc:304] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1704a791486d41aca21c226c48b00d89; no voters: 7b50b6c210724c66b6ee01c04ab9676d, b662aaf197d344acbc951b9da5cebf2b
I20260709 12:27:19.653406 23523 raft_consensus.cc:2749] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:19.666986 22632 consensus_peers.cc:597] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.667542 22632 consensus_peers.cc:597] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.676164 22632 consensus_peers.cc:597] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:19.683465 22632 consensus_peers.cc:597] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.724131 14649 tablet_server.cc:179] TabletServer@127.14.78.68:0 shutting down...
W20260709 12:27:19.737684 22632 consensus_peers.cc:597] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 -> Peer b662aaf197d344acbc951b9da5cebf2b (127.14.78.67:33639): Couldn't send request to peer b662aaf197d344acbc951b9da5cebf2b. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.67:33639: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.764016 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:19.764920 14649 tablet_replica.cc:333] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.765702 14649 raft_consensus.cc:2243] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.766215 14649 raft_consensus.cc:2272] T 9f54eadf52a74cd88517b59b0c79507c P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.768483 14649 tablet_replica.cc:333] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.769325 14649 raft_consensus.cc:2243] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.769882 14649 raft_consensus.cc:2272] T 9a9971a97d734f6195685a52c3a70d69 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.772538 14649 tablet_replica.cc:333] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.773288 14649 raft_consensus.cc:2243] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.773720 14649 raft_consensus.cc:2272] T 337431b8a27e4b17ac0a96ce4f9bfa1f P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.775420 14649 tablet_replica.cc:333] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.775939 14649 raft_consensus.cc:2243] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.776640 14649 raft_consensus.cc:2272] T 00fa50014add43a18981a5a1af88f89c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.778512 14649 tablet_replica.cc:333] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.779047 14649 raft_consensus.cc:2243] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.779436 14649 raft_consensus.cc:2272] T 2354de9b29b94e98875230231b43cf19 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.781258 14649 tablet_replica.cc:333] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.781791 14649 raft_consensus.cc:2243] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.782245 14649 raft_consensus.cc:2272] T e6212b63ad2544469e53bc3d157e04a9 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.784049 14649 tablet_replica.cc:333] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.784564 14649 raft_consensus.cc:2243] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.784940 14649 raft_consensus.cc:2272] T 2027b04cc47c4770a74b4e67e631780b P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.786626 14649 tablet_replica.cc:333] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.787165 14649 raft_consensus.cc:2243] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.787861 14649 raft_consensus.cc:2272] T 48be715b16cb41ebbc7dd26ce297706b P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.790557 14649 tablet_replica.cc:333] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.791410 14649 raft_consensus.cc:2243] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.792397 14649 raft_consensus.cc:2272] T cae0b622804545ada0418c3cd4bfa2b5 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.794595 14649 tablet_replica.cc:333] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.795126 14649 raft_consensus.cc:2243] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.795843 14649 raft_consensus.cc:2272] T e663a8692ca14cefbe1c5e449bcdd818 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.797832 14649 tablet_replica.cc:333] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.798354 14649 raft_consensus.cc:2243] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.799062 14649 raft_consensus.cc:2272] T 347648ceea81494ab02439c3c0cbb346 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.800787 14649 tablet_replica.cc:333] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.801540 14649 raft_consensus.cc:2243] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.802062 14649 raft_consensus.cc:2272] T 4ab59b0f3c2140c198fb8aeb30cf9389 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.804339 14649 tablet_replica.cc:333] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.805016 14649 raft_consensus.cc:2243] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.805457 14649 raft_consensus.cc:2272] T 0a72f62885ce4d3b96f5b6e5e2f1b1a2 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.807219 14649 tablet_replica.cc:333] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.807760 14649 raft_consensus.cc:2243] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.808153 14649 raft_consensus.cc:2272] T 8051a982a56c4bd6a92fe0fcc84095e6 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.809880 14649 tablet_replica.cc:333] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.810499 14649 raft_consensus.cc:2243] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.810902 14649 raft_consensus.cc:2272] T c8474847f8e04fd58b6b04a2bce93bee P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.812768 14649 tablet_replica.cc:333] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.814306 14649 raft_consensus.cc:2243] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.815037 14649 raft_consensus.cc:2272] T afb9c110162141dbbeb161a2aaa00e82 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.816699 14649 tablet_replica.cc:333] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.817286 14649 raft_consensus.cc:2243] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.817675 14649 raft_consensus.cc:2272] T e1e0af41092c454cb010bef793f8ee91 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.819350 14649 tablet_replica.cc:333] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.819859 14649 raft_consensus.cc:2243] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.820557 14649 raft_consensus.cc:2272] T e64be06c2f304bb0bc47273eb5b3443a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.822595 14649 tablet_replica.cc:333] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.823186 14649 raft_consensus.cc:2243] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.823577 14649 raft_consensus.cc:2272] T caf37be188fc415084a391ababe64d34 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.825373 14649 tablet_replica.cc:333] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.825908 14649 raft_consensus.cc:2243] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.826592 14649 raft_consensus.cc:2272] T dc626c4c37b24f3eb817050fb30f6514 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.828437 14649 tablet_replica.cc:333] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.828958 14649 raft_consensus.cc:2243] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.829351 14649 raft_consensus.cc:2272] T 0b01a5d3d09f49098b1c8a295825a3e4 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.830996 14649 tablet_replica.cc:333] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.831595 14649 raft_consensus.cc:2243] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.831996 14649 raft_consensus.cc:2272] T d909a252b3344a49aa050687c81371f1 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.833735 14649 tablet_replica.cc:333] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.834292 14649 raft_consensus.cc:2243] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.834694 14649 raft_consensus.cc:2272] T bbf864ca7eae4b90b7a573bcd2d4fe03 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.836436 14649 tablet_replica.cc:333] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.836977 14649 raft_consensus.cc:2243] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.837394 14649 raft_consensus.cc:2272] T 1844b0368bfa419ca7922fd6c6d4a81f P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.839128 14649 tablet_replica.cc:333] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.839643 14649 raft_consensus.cc:2243] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.840358 14649 raft_consensus.cc:2272] T 3eeef333a78947669db43fca25c58e78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.842128 14649 tablet_replica.cc:333] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.842655 14649 raft_consensus.cc:2243] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.843122 14649 raft_consensus.cc:2272] T 1533d020c6df4b0a969ce556adf9dc6e P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.844874 14649 tablet_replica.cc:333] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.845412 14649 raft_consensus.cc:2243] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.846112 14649 raft_consensus.cc:2272] T 890e148410fe4d348d9bb67d9b26e53c P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.847855 14649 tablet_replica.cc:333] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.848382 14649 raft_consensus.cc:2243] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.848759 14649 raft_consensus.cc:2272] T 81ad0895a1da4871ab543142576039f5 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.850567 14649 tablet_replica.cc:333] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.851135 14649 raft_consensus.cc:2243] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.851848 14649 raft_consensus.cc:2272] T ff440e4e2d764ef1ae95785dc37916bd P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.853518 14649 tablet_replica.cc:333] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.854104 14649 raft_consensus.cc:2243] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.854517 14649 raft_consensus.cc:2272] T 3faa19b604754a1382a3c631b4bb69ea P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.856218 14649 tablet_replica.cc:333] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.856745 14649 raft_consensus.cc:2243] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.857174 14649 raft_consensus.cc:2272] T a54217161e134ab3aeccf82f299bdf52 P 1704a791486d41aca21c226c48b00d89 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.858994 14649 tablet_replica.cc:333] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.859544 14649 raft_consensus.cc:2243] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.859934 14649 raft_consensus.cc:2272] T c1e9a4f6e8ed40e5a1854b3462b79964 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.861622 14649 tablet_replica.cc:333] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.862174 14649 raft_consensus.cc:2243] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.862910 14649 raft_consensus.cc:2272] T 34b4e6a3678b4214ab4cd68a86f36c7d P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.864604 14649 tablet_replica.cc:333] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.865126 14649 raft_consensus.cc:2243] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.865509 14649 raft_consensus.cc:2272] T 8e68bab18985498ba50de54dca27ab78 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.866104 22373 debug-util.cc:398] Leaking SignalData structure 0x7b080032e9c0 after lost signal to thread 14652
W20260709 12:27:19.867318 22373 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1d60 after lost signal to thread 22376
I20260709 12:27:19.867709 14649 tablet_replica.cc:333] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.868482 14649 raft_consensus.cc:2243] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.869364 14649 raft_consensus.cc:2272] T e82e23baefcf48e78cfcbd3978804f66 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.869670 22373 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2ee0 after lost signal to thread 22691
I20260709 12:27:19.871806 14649 tablet_replica.cc:333] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.872560 14649 raft_consensus.cc:2243] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.873095 14649 raft_consensus.cc:2272] T 2a056e813b794e0bb9f0055705fc192a P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.875662 14649 tablet_replica.cc:333] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.876461 14649 raft_consensus.cc:2243] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.877482 14649 raft_consensus.cc:2272] T 7fcb63af1b654f0b8f361fb4bcf9a9a6 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.880169 14649 tablet_replica.cc:333] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.880900 14649 raft_consensus.cc:2243] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.881418 14649 raft_consensus.cc:2272] T 323fb614c73f476e882fd71e0015db18 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.884042 14649 tablet_replica.cc:333] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.884805 14649 raft_consensus.cc:2243] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.885371 14649 raft_consensus.cc:2272] T d7389131679245b79dae4f4f256f4bd0 P 1704a791486d41aca21c226c48b00d89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.888101 14649 tablet_replica.cc:333] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.888811 14649 raft_consensus.cc:2243] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.889357 14649 raft_consensus.cc:2272] T 01570c53874f495494092ddc9bb43c05 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.891903 14649 tablet_replica.cc:333] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.892648 14649 raft_consensus.cc:2243] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.893157 14649 raft_consensus.cc:2272] T 5b2297d3b48646d290a82d37a12edfe4 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.894940 14649 tablet_replica.cc:333] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.895395 14649 raft_consensus.cc:2243] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.895767 14649 raft_consensus.cc:2272] T 6b0804e286664773b5ec173401e74bfc P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.897531 14649 tablet_replica.cc:333] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.897971 14649 raft_consensus.cc:2243] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.898386 14649 raft_consensus.cc:2272] T 97bf3648f5b74bf6a70e11f336dc788e P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.900197 14649 tablet_replica.cc:333] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89: stopping tablet replica
I20260709 12:27:19.900619 14649 raft_consensus.cc:2243] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.901384 14649 raft_consensus.cc:2272] T d11e7fd15033436594cf4c660a36ef40 P 1704a791486d41aca21c226c48b00d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.968845 14649 tablet_server.cc:196] TabletServer@127.14.78.68:0 shutdown complete.
I20260709 12:27:20.037267 14649 master.cc:562] Master@127.14.78.126:38407 shutting down...
I20260709 12:27:20.071084 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.071837 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.072244 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P 151e6f25ba1f490d93bfd0a4c1484f56: stopping tablet replica
W20260709 12:27:21.091924 14649 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22373)
W20260709 12:27:22.092526 14649 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22373)
I20260709 12:27:22.753612 14649 master.cc:584] Master@127.14.78.126:38407 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32254 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:27:22.841028 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:37991
I20260709 12:27:22.842234 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:22.848027 23529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:22.848143 23530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:22.848846 23532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:22.850036 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:22.851164 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:22.851363 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:22.851483 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600042851472 us; error 0 us; skew 500 ppm
I20260709 12:27:22.851940 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:22.854189 14649 webserver.cc:533] Webserver started at http://127.14.78.126:44911/ using document root <none> and password file <none>
I20260709 12:27:22.854624 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:22.854769 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:22.855000 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:22.856052 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "a277c5c662f44113b59c08ad549a8473"
format_stamp: "Formatted at 2026-07-09 12:27:22 on dist-test-slave-vrh7"
I20260709 12:27:22.860235 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:27:22.863612 23537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:22.864352 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:22.864595 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "a277c5c662f44113b59c08ad549a8473"
format_stamp: "Formatted at 2026-07-09 12:27:22 on dist-test-slave-vrh7"
I20260709 12:27:22.864913 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:22.877136 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:22.878248 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:22.915808 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:37991
I20260709 12:27:22.915906 23588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:37991 every 8 connection(s)
I20260709 12:27:22.919709 23589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.930028 23589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473: Bootstrap starting.
I20260709 12:27:22.934557 23589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.938453 23589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473: No bootstrap required, opened a new log
I20260709 12:27:22.940419 23589 raft_consensus.cc:359] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a277c5c662f44113b59c08ad549a8473" member_type: VOTER }
I20260709 12:27:22.940765 23589 raft_consensus.cc:385] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.940943 23589 raft_consensus.cc:740] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a277c5c662f44113b59c08ad549a8473, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.941591 23589 consensus_queue.cc:260] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a277c5c662f44113b59c08ad549a8473" member_type: VOTER }
I20260709 12:27:22.942020 23589 raft_consensus.cc:399] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:22.942209 23589 raft_consensus.cc:493] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:22.942420 23589 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.946565 23589 raft_consensus.cc:515] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a277c5c662f44113b59c08ad549a8473" member_type: VOTER }
I20260709 12:27:22.946995 23589 leader_election.cc:304] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a277c5c662f44113b59c08ad549a8473; no voters: 
I20260709 12:27:22.948016 23589 leader_election.cc:290] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:22.948426 23592 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:22.949816 23592 raft_consensus.cc:697] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 1 LEADER]: Becoming Leader. State: Replica: a277c5c662f44113b59c08ad549a8473, State: Running, Role: LEADER
I20260709 12:27:22.950465 23592 consensus_queue.cc:237] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a277c5c662f44113b59c08ad549a8473" member_type: VOTER }
I20260709 12:27:22.950865 23589 sys_catalog.cc:565] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:22.955149 23594 sys_catalog.cc:455] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a277c5c662f44113b59c08ad549a8473. Latest consensus state: current_term: 1 leader_uuid: "a277c5c662f44113b59c08ad549a8473" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a277c5c662f44113b59c08ad549a8473" member_type: VOTER } }
I20260709 12:27:22.955444 23593 sys_catalog.cc:455] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a277c5c662f44113b59c08ad549a8473" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a277c5c662f44113b59c08ad549a8473" member_type: VOTER } }
I20260709 12:27:22.955890 23594 sys_catalog.cc:458] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:22.956025 23593 sys_catalog.cc:458] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:22.958626 23599 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:22.966255 23599 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:22.967276 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:22.974748 23599 catalog_manager.cc:1383] Generated new cluster ID: 7eefc0b88d474572922c9405049aa8c8
I20260709 12:27:22.975004 23599 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:22.996954 23599 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:22.998747 23599 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:23.014562 23599 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473: Generated new TSK 0
I20260709 12:27:23.015105 23599 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:23.033782 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:23.039395 23610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.040498 23611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.042073 23613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.042614 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:23.043584 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:23.043782 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:23.043963 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600043043927 us; error 0 us; skew 500 ppm
I20260709 12:27:23.044494 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:23.046628 14649 webserver.cc:533] Webserver started at http://127.14.78.65:37711/ using document root <none> and password file <none>
I20260709 12:27:23.047101 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:23.047288 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:23.047569 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:23.048627 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "e19494e779974ae8833d0023733d65a0"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:23.053134 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:23.056358 23618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.057161 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:23.057453 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "e19494e779974ae8833d0023733d65a0"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:23.057742 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:23.079205 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:23.080363 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:23.081871 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:23.084290 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:23.084506 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.084738 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:23.084929 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.123871 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:42321
I20260709 12:27:23.123965 23680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:42321 every 8 connection(s)
I20260709 12:27:23.129058 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:23.136538 23685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.138922 23686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.139715 23688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.140021 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:23.141117 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:23.141304 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:23.141431 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600043141420 us; error 0 us; skew 500 ppm
I20260709 12:27:23.142020 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:23.145099 23681 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37991
I20260709 12:27:23.145566 23681 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:23.145737 14649 webserver.cc:533] Webserver started at http://127.14.78.66:45223/ using document root <none> and password file <none>
I20260709 12:27:23.146428 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:23.146427 23681 heartbeater.cc:507] Master 127.14.78.126:37991 requested a full tablet report, sending...
I20260709 12:27:23.146763 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:23.147114 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:23.148542 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:23.148869 23554 ts_manager.cc:194] Registered new tserver with Master: e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321)
I20260709 12:27:23.150687 23554 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40344
I20260709 12:27:23.153450 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:23.156726 23693 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.157562 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:23.157857 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:23.158095 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:23.180444 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:23.181591 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:23.182994 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:23.185168 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:23.185374 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.185639 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:23.185777 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.223941 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:39995
I20260709 12:27:23.224048 23755 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:39995 every 8 connection(s)
I20260709 12:27:23.228761 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:23.234967 23759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.235989 23760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:23.237625 23762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:23.241902 23756 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37991
I20260709 12:27:23.242486 23756 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:23.243573 23756 heartbeater.cc:507] Master 127.14.78.126:37991 requested a full tablet report, sending...
I20260709 12:27:23.244171 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:23.245445 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:23.245631 23554 ts_manager.cc:194] Registered new tserver with Master: 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
W20260709 12:27:23.245685 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:23.246106 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600043246088 us; error 0 us; skew 500 ppm
I20260709 12:27:23.246699 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:23.247150 23554 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40352
I20260709 12:27:23.249265 14649 webserver.cc:533] Webserver started at http://127.14.78.67:41181/ using document root <none> and password file <none>
I20260709 12:27:23.249904 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:23.250069 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:23.250267 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:23.251339 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:23.255523 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:27:23.258749 23767 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.259702 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:23.260092 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:23.260358 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:23.277729 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:23.278813 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:23.280148 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:23.282222 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:23.282414 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.282670 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:23.282824 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:23.321347 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:34973
I20260709 12:27:23.321533 23829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:34973 every 8 connection(s)
I20260709 12:27:23.334729 23830 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37991
I20260709 12:27:23.335172 23830 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:23.335923 23830 heartbeater.cc:507] Master 127.14.78.126:37991 requested a full tablet report, sending...
I20260709 12:27:23.337823 23554 ts_manager.cc:194] Registered new tserver with Master: ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:23.337920 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013498225s
I20260709 12:27:23.339174 23554 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40354
I20260709 12:27:23.364276 23554 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40366:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:23.367187 23554 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:23.436142 23721 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5052d7202a46f8bad53717d030a962 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:23.437453 23721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5052d7202a46f8bad53717d030a962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.444732 23720 tablet_service.cc:1511] Processing CreateTablet for tablet 695585999b21428c90641c3734b58197 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:23.446636 23720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695585999b21428c90641c3734b58197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.463294 23795 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5052d7202a46f8bad53717d030a962 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:23.464663 23795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5052d7202a46f8bad53717d030a962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.466550 23646 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5052d7202a46f8bad53717d030a962 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:23.467952 23646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5052d7202a46f8bad53717d030a962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.470513 23645 tablet_service.cc:1511] Processing CreateTablet for tablet 695585999b21428c90641c3734b58197 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:23.472326 23645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695585999b21428c90641c3734b58197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.474283 23644 tablet_service.cc:1511] Processing CreateTablet for tablet f80660313b3048be84c3ef80948bddff (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:23.475714 23643 tablet_service.cc:1511] Processing CreateTablet for tablet a09e70f5b6114f5d8d339079dbaab67e (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:23.476173 23644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80660313b3048be84c3ef80948bddff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.477093 23643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09e70f5b6114f5d8d339079dbaab67e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.474653 23719 tablet_service.cc:1511] Processing CreateTablet for tablet f80660313b3048be84c3ef80948bddff (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:23.477164 23718 tablet_service.cc:1511] Processing CreateTablet for tablet a09e70f5b6114f5d8d339079dbaab67e (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:23.478248 23719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80660313b3048be84c3ef80948bddff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.480218 23642 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4e88cfb85c43f4ae110d4f3ac3e527 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:23.481534 23642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4e88cfb85c43f4ae110d4f3ac3e527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.484378 23641 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3b2615f67e4365a95f29aba6f81b0f (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:23.485683 23641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3b2615f67e4365a95f29aba6f81b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.491418 23717 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4e88cfb85c43f4ae110d4f3ac3e527 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:23.492717 23717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4e88cfb85c43f4ae110d4f3ac3e527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.497366 23718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09e70f5b6114f5d8d339079dbaab67e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.508042 23640 tablet_service.cc:1511] Processing CreateTablet for tablet 104f49edc5604da0b035b29da79d8142 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:23.509428 23640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104f49edc5604da0b035b29da79d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.510776 23794 tablet_service.cc:1511] Processing CreateTablet for tablet 695585999b21428c90641c3734b58197 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:23.512123 23794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695585999b21428c90641c3734b58197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.514220 23639 tablet_service.cc:1511] Processing CreateTablet for tablet 684480b8b17744d6a03dbfd13702f241 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:23.515493 23639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684480b8b17744d6a03dbfd13702f241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.518191 23638 tablet_service.cc:1511] Processing CreateTablet for tablet b07a13115c6448a7b17e1b333cafd11d (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:23.519028 23793 tablet_service.cc:1511] Processing CreateTablet for tablet f80660313b3048be84c3ef80948bddff (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:23.519518 23638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07a13115c6448a7b17e1b333cafd11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.520325 23793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80660313b3048be84c3ef80948bddff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.522491 23637 tablet_service.cc:1511] Processing CreateTablet for tablet fbf5f68e53f14fc785bdb6ab9158494f (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:23.523720 23637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf5f68e53f14fc785bdb6ab9158494f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.526937 23792 tablet_service.cc:1511] Processing CreateTablet for tablet a09e70f5b6114f5d8d339079dbaab67e (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:23.528218 23792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09e70f5b6114f5d8d339079dbaab67e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.527861 23716 tablet_service.cc:1511] Processing CreateTablet for tablet 104f49edc5604da0b035b29da79d8142 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:23.528393 23719 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3b2615f67e4365a95f29aba6f81b0f (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:23.530615 23715 tablet_service.cc:1511] Processing CreateTablet for tablet 684480b8b17744d6a03dbfd13702f241 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:23.533095 23714 tablet_service.cc:1511] Processing CreateTablet for tablet b07a13115c6448a7b17e1b333cafd11d (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:23.534843 23791 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4e88cfb85c43f4ae110d4f3ac3e527 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:23.535614 23713 tablet_service.cc:1511] Processing CreateTablet for tablet fbf5f68e53f14fc785bdb6ab9158494f (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:23.536140 23791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4e88cfb85c43f4ae110d4f3ac3e527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.537846 23716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104f49edc5604da0b035b29da79d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.538291 23790 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3b2615f67e4365a95f29aba6f81b0f (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:23.539616 23790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3b2615f67e4365a95f29aba6f81b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.542194 23719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3b2615f67e4365a95f29aba6f81b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.545640 23714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07a13115c6448a7b17e1b333cafd11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.546769 23713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf5f68e53f14fc785bdb6ab9158494f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.583895 23789 tablet_service.cc:1511] Processing CreateTablet for tablet 104f49edc5604da0b035b29da79d8142 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:23.585309 23789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104f49edc5604da0b035b29da79d8142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.590101 23788 tablet_service.cc:1511] Processing CreateTablet for tablet 684480b8b17744d6a03dbfd13702f241 (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:23.591435 23788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684480b8b17744d6a03dbfd13702f241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.594153 23787 tablet_service.cc:1511] Processing CreateTablet for tablet b07a13115c6448a7b17e1b333cafd11d (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:23.595435 23787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07a13115c6448a7b17e1b333cafd11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.598052 23786 tablet_service.cc:1511] Processing CreateTablet for tablet fbf5f68e53f14fc785bdb6ab9158494f (DEFAULT_TABLE table=test-workload [id=c52460e30dad45e3a368ea4a44adbc33]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:23.599298 23786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf5f68e53f14fc785bdb6ab9158494f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.620154 23715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684480b8b17744d6a03dbfd13702f241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.685894 23845 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:23.705051 23846 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:23.717376 23847 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.721406 23845 tablet_bootstrap.cc:654] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.723905 23847 tablet_bootstrap.cc:654] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.724895 23846 tablet_bootstrap.cc:654] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.729724 23845 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:23.730167 23845 ts_tablet_manager.cc:1403] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.006s
I20260709 12:27:23.731235 23847 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:23.731981 23847 ts_tablet_manager.cc:1403] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:27:23.732863 23845 raft_consensus.cc:359] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.733508 23845 raft_consensus.cc:385] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.733748 23845 raft_consensus.cc:740] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.734072 23846 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:23.734579 23846 ts_tablet_manager.cc:1403] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:27:23.734431 23845 consensus_queue.cc:260] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.734812 23847 raft_consensus.cc:359] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.735596 23847 raft_consensus.cc:385] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.735968 23847 raft_consensus.cc:740] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.736452 23756 heartbeater.cc:499] Master 127.14.78.126:37991 was elected leader, sending a full tablet report...
I20260709 12:27:23.736963 23845 ts_tablet_manager.cc:1434] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:23.736877 23847 consensus_queue.cc:260] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.737567 23846 raft_consensus.cc:359] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.738032 23845 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:23.738358 23846 raft_consensus.cc:385] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.738781 23846 raft_consensus.cc:740] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.739845 23846 consensus_queue.cc:260] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.752854 23830 heartbeater.cc:499] Master 127.14.78.126:37991 was elected leader, sending a full tablet report...
I20260709 12:27:23.753497 23847 ts_tablet_manager.cc:1434] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:27:23.754771 23847 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.756443 23846 ts_tablet_manager.cc:1434] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.003s
I20260709 12:27:23.757323 23681 heartbeater.cc:499] Master 127.14.78.126:37991 was elected leader, sending a full tablet report...
I20260709 12:27:23.758916 23846 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:23.763307 23845 tablet_bootstrap.cc:654] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.764577 23847 tablet_bootstrap.cc:654] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.765467 23846 tablet_bootstrap.cc:654] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.775456 23845 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:23.776013 23845 ts_tablet_manager.cc:1403] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 12:27:23.776345 23847 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:23.776921 23847 ts_tablet_manager.cc:1403] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 12:27:23.779098 23845 raft_consensus.cc:359] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.779784 23847 raft_consensus.cc:359] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.780989 23845 raft_consensus.cc:385] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.781143 23847 raft_consensus.cc:385] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.781576 23847 raft_consensus.cc:740] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.782362 23846 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:23.783034 23846 ts_tablet_manager.cc:1403] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:27:23.782460 23847 consensus_queue.cc:260] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.783476 23845 raft_consensus.cc:740] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.785054 23847 ts_tablet_manager.cc:1434] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:23.785202 23845 consensus_queue.cc:260] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.786129 23847 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.785933 23846 raft_consensus.cc:359] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.786809 23846 raft_consensus.cc:385] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.787194 23846 raft_consensus.cc:740] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.787598 23845 ts_tablet_manager.cc:1434] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:23.788656 23845 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:23.788179 23846 consensus_queue.cc:260] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.790597 23846 ts_tablet_manager.cc:1434] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:23.791600 23846 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:23.793192 23847 tablet_bootstrap.cc:654] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.797945 23846 tablet_bootstrap.cc:654] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.800964 23845 tablet_bootstrap.cc:654] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.804837 23847 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:23.805363 23847 ts_tablet_manager.cc:1403] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:27:23.808313 23847 raft_consensus.cc:359] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.808939 23847 raft_consensus.cc:385] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.809403 23847 raft_consensus.cc:740] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.810534 23845 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:23.810577 23846 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:23.810287 23847 consensus_queue.cc:260] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.811261 23846 ts_tablet_manager.cc:1403] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 12:27:23.812937 23847 ts_tablet_manager.cc:1434] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:23.814018 23847 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.814224 23846 raft_consensus.cc:359] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.815026 23846 raft_consensus.cc:385] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.815122 23845 ts_tablet_manager.cc:1403] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.003s
I20260709 12:27:23.815410 23846 raft_consensus.cc:740] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.816365 23846 consensus_queue.cc:260] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.818571 23846 ts_tablet_manager.cc:1434] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:27:23.818303 23845 raft_consensus.cc:359] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.819123 23845 raft_consensus.cc:385] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.819497 23845 raft_consensus.cc:740] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.820290 23845 consensus_queue.cc:260] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.820942 23847 tablet_bootstrap.cc:654] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.821144 23846 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:23.822909 23845 ts_tablet_manager.cc:1434] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:27:23.825456 23831 tablet.cc:2406] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:23.826231 23845 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:23.828351 23846 tablet_bootstrap.cc:654] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.838330 23845 tablet_bootstrap.cc:654] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.848584 23846 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:23.849128 23846 ts_tablet_manager.cc:1403] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.011s
I20260709 12:27:23.850356 23847 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:23.850857 23847 ts_tablet_manager.cc:1403] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.020s
I20260709 12:27:23.851749 23846 raft_consensus.cc:359] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.852411 23846 raft_consensus.cc:385] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.852538 23845 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:23.852821 23846 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.853132 23845 ts_tablet_manager.cc:1403] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 12:27:23.853654 23846 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.853924 23847 raft_consensus.cc:359] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.854771 23847 raft_consensus.cc:385] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.855108 23847 raft_consensus.cc:740] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.855738 23846 ts_tablet_manager.cc:1434] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:27:23.856843 23846 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:23.856611 23845 raft_consensus.cc:359] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.856420 23847 consensus_queue.cc:260] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.857614 23851 raft_consensus.cc:493] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.858093 23851 raft_consensus.cc:515] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.860651 23851 leader_election.cc:290] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:23.857348 23845 raft_consensus.cc:385] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.861521 23845 raft_consensus.cc:740] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.862138 23847 ts_tablet_manager.cc:1434] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:27:23.862252 23845 consensus_queue.cc:260] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.863312 23847 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.863833 23846 tablet_bootstrap.cc:654] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.867184 23845 ts_tablet_manager.cc:1434] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:23.868302 23845 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:23.871483 23847 tablet_bootstrap.cc:654] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.874908 23845 tablet_bootstrap.cc:654] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.883519 23846 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:23.885722 23846 ts_tablet_manager.cc:1403] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 12:27:23.893869 23845 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:23.894510 23845 ts_tablet_manager.cc:1403] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:27:23.894016 23847 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:23.895354 23847 ts_tablet_manager.cc:1403] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 12:27:23.896920 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80660313b3048be84c3ef80948bddff" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:23.897629 23656 raft_consensus.cc:2468] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:23.897593 23845 raft_consensus.cc:359] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.898435 23845 raft_consensus.cc:385] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.898309 23847 raft_consensus.cc:359] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.898836 23845 raft_consensus.cc:740] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.889806 23846 raft_consensus.cc:359] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.899377 23696 leader_election.cc:304] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:23.899536 23846 raft_consensus.cc:385] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.899133 23847 raft_consensus.cc:385] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.900094 23846 raft_consensus.cc:740] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.900228 23847 raft_consensus.cc:740] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.900390 23851 raft_consensus.cc:2804] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.901412 23851 raft_consensus.cc:493] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.901257 23845 consensus_queue.cc:260] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.901815 23851 raft_consensus.cc:3060] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.901829 23846 consensus_queue.cc:260] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.904286 23853 raft_consensus.cc:493] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.904783 23853 raft_consensus.cc:515] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.913166 23805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80660313b3048be84c3ef80948bddff" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:23.919035 23851 raft_consensus.cc:515] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.927351 23851 leader_election.cc:290] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:23.921514 23847 consensus_queue.cc:260] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.927731 23853 leader_election.cc:290] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:23.928277 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80660313b3048be84c3ef80948bddff" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:23.936782 23805 raft_consensus.cc:2468] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:23.937011 23656 raft_consensus.cc:3060] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.932102 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80660313b3048be84c3ef80948bddff" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:23.943830 23847 ts_tablet_manager.cc:1434] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:27:23.944906 23847 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.951673 23847 tablet_bootstrap.cc:654] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.936013 23870 raft_consensus.cc:493] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.953433 23870 raft_consensus.cc:515] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.954167 23845 ts_tablet_manager.cc:1434] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.059s	user 0.016s	sys 0.023s
I20260709 12:27:23.956115 23845 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:23.957185 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5052d7202a46f8bad53717d030a962" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:23.957544 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5052d7202a46f8bad53717d030a962" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:23.957894 23655 raft_consensus.cc:2468] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:23.958168 23804 raft_consensus.cc:2468] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:23.959244 23696 leader_election.cc:304] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:23.959481 23870 leader_election.cc:290] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
W20260709 12:27:23.961834 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:23.963057 23845 tablet_bootstrap.cc:654] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.963876 23870 raft_consensus.cc:2804] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.964298 23870 raft_consensus.cc:493] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.964646 23870 raft_consensus.cc:3060] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.971576 23656 raft_consensus.cc:2468] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:23.974340 23696 leader_election.cc:304] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:23.975536 23868 raft_consensus.cc:2804] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.975474 23870 raft_consensus.cc:515] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.976146 23868 raft_consensus.cc:697] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:23.976325 23845 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:23.976790 23845 ts_tablet_manager.cc:1403] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:27:23.976325 23847 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:23.977780 23847 ts_tablet_manager.cc:1403] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.004s
I20260709 12:27:23.977005 23868 consensus_queue.cc:237] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.979717 23845 raft_consensus.cc:359] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.980433 23845 raft_consensus.cc:385] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.980803 23845 raft_consensus.cc:740] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.980682 23847 raft_consensus.cc:359] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.981528 23847 raft_consensus.cc:385] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.981868 23847 raft_consensus.cc:740] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.981703 23845 consensus_queue.cc:260] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.982913 23847 consensus_queue.cc:260] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.985517 23847 ts_tablet_manager.cc:1434] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:27:23.985553 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5052d7202a46f8bad53717d030a962" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:23.986322 23655 raft_consensus.cc:3060] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.986689 23847 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:23.993727 23852 raft_consensus.cc:493] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.994318 23852 raft_consensus.cc:515] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:23.994659 23655 raft_consensus.cc:2468] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:23.995905 23696 leader_election.cc:304] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:23.993837 23845 ts_tablet_manager.cc:1434] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:23.996670 23851 raft_consensus.cc:2804] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.998445 23870 leader_election.cc:290] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:23.997565 23845 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:24.000787 23852 leader_election.cc:290] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:23.993759 23847 tablet_bootstrap.cc:654] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.011402 23551 catalog_manager.cc:5697] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 1 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.013463 23851 raft_consensus.cc:697] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:24.022495 23851 consensus_queue.cc:237] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.024091 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.024797 23731 raft_consensus.cc:2468] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.030592 23845 tablet_bootstrap.cc:654] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.036465 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.036867 23846 ts_tablet_manager.cc:1434] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.151s	user 0.020s	sys 0.055s
I20260709 12:27:24.037364 23804 raft_consensus.cc:2468] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.038415 23846 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:24.042369 23619 leader_election.cc:304] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.043860 23869 raft_consensus.cc:2804] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.048281 23869 raft_consensus.cc:493] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.048622 23869 raft_consensus.cc:3060] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.053282 23846 tablet_bootstrap.cc:654] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.055897 23847 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:24.054925 23869 raft_consensus.cc:515] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.061970 23847 ts_tablet_manager.cc:1403] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.017s
I20260709 12:27:24.055413 23876 raft_consensus.cc:493] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.064908 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:24.065553 23731 raft_consensus.cc:3060] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.065376 23876 raft_consensus.cc:515] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.068900 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
W20260709 12:27:24.070587 23696 leader_election.cc:343] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.071820 23876 leader_election.cc:290] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.074501 23731 raft_consensus.cc:2468] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.078460 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.079234 23804 raft_consensus.cc:3060] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.075491 23847 raft_consensus.cc:359] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.080227 23847 raft_consensus.cc:385] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.080542 23847 raft_consensus.cc:740] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.080840 23621 leader_election.cc:304] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.081836 23853 raft_consensus.cc:2804] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.083284 23853 raft_consensus.cc:697] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Becoming Leader. State: Replica: e19494e779974ae8833d0023733d65a0, State: Running, Role: LEADER
I20260709 12:27:24.084116 23853 consensus_queue.cc:237] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.089164 23869 leader_election.cc:290] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Requested vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.081360 23847 consensus_queue.cc:260] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.076536 23845 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:24.091179 23845 ts_tablet_manager.cc:1403] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.014s
I20260709 12:27:24.091780 23804 raft_consensus.cc:2468] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.096571 23846 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:24.096424 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5052d7202a46f8bad53717d030a962" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.097139 23805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.097826 23805 raft_consensus.cc:2468] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:24.097169 23846 ts_tablet_manager.cc:1403] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.004s
I20260709 12:27:24.099251 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:24.099537 23694 leader_election.cc:304] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.098455 23845 raft_consensus.cc:359] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.100641 23851 raft_consensus.cc:2804] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.100857 23845 raft_consensus.cc:385] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.101025 23851 raft_consensus.cc:493] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.101481 23851 raft_consensus.cc:3060] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.101388 23845 raft_consensus.cc:740] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.097474 23804 raft_consensus.cc:3060] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.101267 23846 raft_consensus.cc:359] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.102962 23846 raft_consensus.cc:385] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.103315 23846 raft_consensus.cc:740] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.103700 23847 ts_tablet_manager.cc:1434] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:27:24.104166 23846 consensus_queue.cc:260] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
W20260709 12:27:24.104805 23770 leader_election.cc:343] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.104648 23845 consensus_queue.cc:260] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.106911 23845 ts_tablet_manager.cc:1434] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 12:27:24.106870 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.107061 23846 ts_tablet_manager.cc:1434] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:24.108104 23845 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:24.108214 23846 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
W20260709 12:27:24.108481 23770 leader_election.cc:343] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.109617 23851 raft_consensus.cc:515] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.113785 23847 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:24.116410 23804 raft_consensus.cc:2468] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:24.121060 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
W20260709 12:27:24.122655 23696 leader_election.cc:343] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.124089 23851 leader_election.cc:290] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.124261 23845 tablet_bootstrap.cc:654] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.114648 23770 leader_election.cc:304] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.126590 23852 raft_consensus.cc:2749] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.129509 23846 tablet_bootstrap.cc:654] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.130343 23552 catalog_manager.cc:5697] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19494e779974ae8833d0023733d65a0 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "e19494e779974ae8833d0023733d65a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.134033 23847 tablet_bootstrap.cc:654] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.135159 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.135810 23804 raft_consensus.cc:3060] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.139113 23846 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:24.139680 23846 ts_tablet_manager.cc:1403] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.002s
I20260709 12:27:24.142714 23845 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:24.143179 23845 ts_tablet_manager.cc:1403] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.005s
I20260709 12:27:24.142535 23553 catalog_manager.cc:5697] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 1 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.143204 23846 raft_consensus.cc:359] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.144033 23846 raft_consensus.cc:385] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.144344 23846 raft_consensus.cc:740] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.145171 23846 consensus_queue.cc:260] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.145982 23845 raft_consensus.cc:359] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.146646 23845 raft_consensus.cc:385] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.146934 23845 raft_consensus.cc:740] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.141218 23847 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:24.147620 23846 ts_tablet_manager.cc:1434] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:27:24.148135 23847 ts_tablet_manager.cc:1403] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.010s
I20260709 12:27:24.148821 23846 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:24.150734 23847 raft_consensus.cc:359] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.147601 23845 consensus_queue.cc:260] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.153563 23845 ts_tablet_manager.cc:1434] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:27:24.153968 23876 raft_consensus.cc:493] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.154856 23876 raft_consensus.cc:515] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.155313 23845 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:24.155658 23846 tablet_bootstrap.cc:654] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.157236 23876 leader_election.cc:290] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.154057 23804 raft_consensus.cc:2468] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:24.157734 23847 raft_consensus.cc:385] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.158149 23847 raft_consensus.cc:740] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.159094 23694 leader_election.cc:304] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.163304 23876 raft_consensus.cc:2804] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.159271 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:24.163421 23847 consensus_queue.cc:260] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.163924 23876 raft_consensus.cc:697] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:24.165005 23876 consensus_queue.cc:237] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.165570 23847 ts_tablet_manager.cc:1434] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:27:24.166517 23847 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:24.161675 23846 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:24.169795 23846 ts_tablet_manager.cc:1403] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.007s
I20260709 12:27:24.171471 23847 tablet_bootstrap.cc:654] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.172821 23846 raft_consensus.cc:359] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.173503 23846 raft_consensus.cc:385] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.173755 23846 raft_consensus.cc:740] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.162578 23845 tablet_bootstrap.cc:654] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.163990 23655 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:24.174415 23846 consensus_queue.cc:260] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.160504 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.175405 23804 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:24.176415 23846 ts_tablet_manager.cc:1434] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:27:24.177513 23846 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:24.180768 23845 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:24.181272 23845 ts_tablet_manager.cc:1403] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:27:24.182111 23846 tablet_bootstrap.cc:654] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.183064 23847 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:24.183562 23847 ts_tablet_manager.cc:1403] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 12:27:24.184001 23845 raft_consensus.cc:359] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.184715 23845 raft_consensus.cc:385] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.184975 23845 raft_consensus.cc:740] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.175318 23696 leader_election.cc:304] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.185830 23876 raft_consensus.cc:2804] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.185714 23845 consensus_queue.cc:260] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.186225 23876 raft_consensus.cc:493] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.186596 23876 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.186542 23847 raft_consensus.cc:359] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.187369 23847 raft_consensus.cc:385] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.187672 23847 raft_consensus.cc:740] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.188002 23845 ts_tablet_manager.cc:1434] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:24.188438 23847 consensus_queue.cc:260] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.188938 23845 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: Bootstrap starting.
I20260709 12:27:24.190500 23847 ts_tablet_manager.cc:1434] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:24.189729 23551 catalog_manager.cc:5697] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 1 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.191399 23847 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: Bootstrap starting.
I20260709 12:27:24.194221 23876 raft_consensus.cc:515] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.195173 23845 tablet_bootstrap.cc:654] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.196595 23852 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.197466 23847 tablet_bootstrap.cc:654] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.197113 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:24.198249 23655 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.198773 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.199375 23804 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.197103 23852 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.206507 23852 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:24.206946 23852 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.207412 23852 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.207664 23853 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.208165 23853 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.210211 23853 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.212096 23805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.212713 23805 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.213948 23619 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.216086 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.216662 23731 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.218189 23853 raft_consensus.cc:2804] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.218607 23853 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.218930 23853 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.219069 23876 leader_election.cc:290] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.212867 23804 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:24.223066 23852 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:24.223278 23876 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.223956 23876 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.227697 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
W20260709 12:27:24.229610 23696 leader_election.cc:343] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.230038 23853 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.232506 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:24.233168 23731 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.236238 23846 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:24.236881 23846 ts_tablet_manager.cc:1403] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.007s
I20260709 12:27:24.239763 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.240206 23731 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.240398 23804 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.241411 23621 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.241506 23876 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.242302 23869 raft_consensus.cc:2804] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.242842 23869 raft_consensus.cc:697] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Becoming Leader. State: Replica: e19494e779974ae8833d0023733d65a0, State: Running, Role: LEADER
I20260709 12:27:24.243646 23869 consensus_queue.cc:237] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.244937 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:24.247746 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.233069 23655 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:24.248912 23730 raft_consensus.cc:2393] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba5b440b5f4b4cf683d4ea2a3647e117 in current term 1: Already voted for candidate e19494e779974ae8833d0023733d65a0 in this term.
I20260709 12:27:24.249752 23696 leader_election.cc:304] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.251943 23845 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: No bootstrap required, opened a new log
I20260709 12:27:24.252465 23845 ts_tablet_manager.cc:1403] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.001s
I20260709 12:27:24.252786 23869 raft_consensus.cc:493] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.254091 23885 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.254554 23885 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.242878 23853 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Requested vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.255287 23845 raft_consensus.cc:359] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.255957 23845 raft_consensus.cc:385] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.256220 23845 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.256670 23885 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.253358 23869 raft_consensus.cc:515] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.258129 23805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.258615 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
W20260709 12:27:24.259552 23619 leader_election.cc:343] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.261250 23805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.262145 23805 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.262593 23770 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.262800 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.261512 23729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.263434 23803 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:24.263155 23804 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.263839 23729 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.264125 23619 leader_election.cc:304] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.264511 23897 raft_consensus.cc:2749] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.264706 23694 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.259557 23730 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 0.
I20260709 12:27:24.265643 23851 raft_consensus.cc:2804] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.266045 23851 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.263808 23876 raft_consensus.cc:2804] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.266453 23851 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.266712 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:24.267551 23770 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 
I20260709 12:27:24.267607 23876 raft_consensus.cc:697] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:24.269542 23852 raft_consensus.cc:2804] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.265400 23846 raft_consensus.cc:359] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.268187 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.259865 23869 leader_election.cc:290] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.269791 23876 consensus_queue.cc:237] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.270248 23846 raft_consensus.cc:385] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.271304 23846 raft_consensus.cc:740] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.270208 23551 catalog_manager.cc:5697] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19494e779974ae8833d0023733d65a0 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "e19494e779974ae8833d0023733d65a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.271999 23846 consensus_queue.cc:260] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.269963 23852 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.268910 23847 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: No bootstrap required, opened a new log
I20260709 12:27:24.273175 23852 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.273476 23847 ts_tablet_manager.cc:1403] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent bootstrapping tablet: real 0.082s	user 0.033s	sys 0.039s
I20260709 12:27:24.274413 23846 ts_tablet_manager.cc:1434] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:27:24.275365 23846 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
W20260709 12:27:24.269673 23770 leader_election.cc:343] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.276180 23847 raft_consensus.cc:359] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.266065 23885 raft_consensus.cc:2804] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.276928 23847 raft_consensus.cc:385] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.277192 23885 raft_consensus.cc:493] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.277630 23885 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.277254 23847 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.278432 23847 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.283607 23847 ts_tablet_manager.cc:1434] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:24.283859 23846 tablet_bootstrap.cc:654] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.284987 23851 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.295693 23852 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.262279 23845 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.297359 23731 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 0.
I20260709 12:27:24.299433 23621 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:24.300459 23869 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.300889 23869 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.301512 23869 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.301738 23852 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:24.303187 23851 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.304231 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:24.306041 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:24.306854 23731 raft_consensus.cc:2393] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba5b440b5f4b4cf683d4ea2a3647e117 in current term 1: Already voted for candidate 24cdcf0bf51746638717f13fa6c4d1ff in this term.
I20260709 12:27:24.303990 23885 raft_consensus.cc:515] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.300853 23845 ts_tablet_manager.cc:1434] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 12:27:24.305233 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
W20260709 12:27:24.307194 23696 leader_election.cc:343] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:24.309531 23770 leader_election.cc:343] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.310242 23770 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.310604 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:24.311008 23852 raft_consensus.cc:2749] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.311390 23731 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.310542 23885 leader_election.cc:290] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Requested vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.312002 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.312179 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.312592 23803 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.312971 23804 raft_consensus.cc:2393] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 24cdcf0bf51746638717f13fa6c4d1ff in current term 1: Already voted for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in this term.
I20260709 12:27:24.315055 23552 catalog_manager.cc:5697] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 1 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.317588 23731 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.318234 23694 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff; no voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0
I20260709 12:27:24.319079 23876 raft_consensus.cc:2749] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.319869 23846 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: No bootstrap required, opened a new log
I20260709 12:27:24.320061 23869 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.321866 23869 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Requested vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.320456 23846 ts_tablet_manager.cc:1403] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.019s
I20260709 12:27:24.322911 23803 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.319779 23621 leader_election.cc:304] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.323107 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.324769 23804 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.324919 23846 raft_consensus.cc:359] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.325660 23846 raft_consensus.cc:385] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.325927 23846 raft_consensus.cc:740] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.326742 23846 consensus_queue.cc:260] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.326465 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:24.327719 23885 raft_consensus.cc:2804] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.327831 23731 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.328312 23885 raft_consensus.cc:697] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Becoming Leader. State: Replica: e19494e779974ae8833d0023733d65a0, State: Running, Role: LEADER
I20260709 12:27:24.328899 23846 ts_tablet_manager.cc:1434] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:27:24.329165 23885 consensus_queue.cc:237] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.335453 23804 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.336248 23731 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19494e779974ae8833d0023733d65a0 in term 1.
I20260709 12:27:24.336608 23619 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.337471 23869 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.337950 23869 raft_consensus.cc:697] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Becoming Leader. State: Replica: e19494e779974ae8833d0023733d65a0, State: Running, Role: LEADER
I20260709 12:27:24.338851 23869 consensus_queue.cc:237] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.344353 23551 catalog_manager.cc:5697] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19494e779974ae8833d0023733d65a0 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "e19494e779974ae8833d0023733d65a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.356588 23551 catalog_manager.cc:5697] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19494e779974ae8833d0023733d65a0 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "e19494e779974ae8833d0023733d65a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.416224 23876 consensus_queue.cc:1048] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.425678 23804 raft_consensus.cc:3060] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.433914 23876 consensus_queue.cc:1048] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.434898 23869 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.435400 23869 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.438189 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.439020 23731 raft_consensus.cc:2393] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19494e779974ae8833d0023733d65a0 in current term 1: Already voted for candidate 24cdcf0bf51746638717f13fa6c4d1ff in this term.
I20260709 12:27:24.438800 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.439803 23869 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.439962 23803 raft_consensus.cc:2393] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19494e779974ae8833d0023733d65a0 in current term 1: Already voted for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in this term.
I20260709 12:27:24.441381 23619 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19494e779974ae8833d0023733d65a0; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:24.442040 23869 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.447319 23869 raft_consensus.cc:2749] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.463531 23876 raft_consensus.cc:493] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.464005 23876 raft_consensus.cc:515] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.465956 23876 leader_election.cc:290] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.466544 23655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:24.466950 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.466877 23876 consensus_queue.cc:1048] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.467288 23655 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:24.467694 23803 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 0.
I20260709 12:27:24.468340 23696 leader_election.cc:304] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.469179 23876 raft_consensus.cc:2804] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.469530 23876 raft_consensus.cc:493] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.469828 23876 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.478199 23868 consensus_queue.cc:1048] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.480628 23876 raft_consensus.cc:515] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.484434 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:24.485167 23876 leader_election.cc:290] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.485509 23656 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.484665 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:24.486223 23803 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.492894 23656 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:24.493933 23696 leader_election.cc:304] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:24.494673 23876 raft_consensus.cc:2804] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.495136 23876 raft_consensus.cc:697] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:24.495942 23876 consensus_queue.cc:237] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.502381 23803 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:24.504197 23552 catalog_manager.cc:5697] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 1 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.566198 23869 consensus_queue.cc:1048] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.576022 23885 consensus_queue.cc:1048] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.595774 23885 raft_consensus.cc:493] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.596148 23885 raft_consensus.cc:515] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:24.597800 23885 leader_election.cc:290] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:24.598541 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:24.598739 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "e19494e779974ae8833d0023733d65a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:24.599534 23803 raft_consensus.cc:2393] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e19494e779974ae8833d0023733d65a0 in current term 1: Already voted for candidate 24cdcf0bf51746638717f13fa6c4d1ff in this term.
I20260709 12:27:24.600409 23619 leader_election.cc:304] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19494e779974ae8833d0023733d65a0; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:24.601020 23885 raft_consensus.cc:3060] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.605778 23885 raft_consensus.cc:2749] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.622750 23876 consensus_queue.cc:1048] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.626753 23876 consensus_queue.cc:1048] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.682719 23870 consensus_queue.cc:1048] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.682719 23885 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.696528 23870 consensus_queue.cc:1048] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.699558 23869 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.814002 23869 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.813973 23885 consensus_queue.cc:1048] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.838553 23885 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.842409 23869 consensus_queue.cc:1048] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:24.969730 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:25.115926 23870 consensus_queue.cc:1048] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.119647 23870 consensus_queue.cc:1048] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.958864 23868 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.959631 23868 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:25.961922 23868 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:25.962915 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0" is_pre_election: true
I20260709 12:27:25.963035 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:25.963759 23656 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:25.963824 23804 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:25.965170 23696 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:25.965885 23868 raft_consensus.cc:2804] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:25.966213 23868 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.966454 23868 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.974424 23868 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:25.976069 23868 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:25.976992 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:25.977077 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:25.977619 23656 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.977808 23804 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:25.978673 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:25.984146 23656 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 2.
I20260709 12:27:25.984151 23804 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 2.
I20260709 12:27:25.985306 23696 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:25.985949 23868 raft_consensus.cc:2804] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:25.986449 23868 raft_consensus.cc:697] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:25.987449 23868 consensus_queue.cc:237] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:25.994865 23553 catalog_manager.cc:5697] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 0 to 2, leader changed from <none> to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 2 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.258662 14649 ts_manager.cc:295] Set tserver state for e19494e779974ae8833d0023733d65a0 to MAINTENANCE_MODE
I20260709 12:27:26.259796 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
I20260709 12:27:26.289649 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:26.290405 14649 tablet_replica.cc:333] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.291225 14649 raft_consensus.cc:2243] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.291703 14649 raft_consensus.cc:2272] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.294113 14649 tablet_replica.cc:333] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.294812 14649 raft_consensus.cc:2243] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.295306 14649 raft_consensus.cc:2272] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.297487 14649 tablet_replica.cc:333] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.298040 14649 raft_consensus.cc:2243] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.298854 14649 raft_consensus.cc:2272] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.300887 14649 tablet_replica.cc:333] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.301595 14649 raft_consensus.cc:2243] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.302096 14649 raft_consensus.cc:2272] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.304740 14649 tablet_replica.cc:333] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.305338 14649 raft_consensus.cc:2243] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.306190 14649 raft_consensus.cc:2272] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.309234 14649 tablet_replica.cc:333] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.309919 14649 raft_consensus.cc:2243] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.310812 14649 raft_consensus.cc:2272] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.312917 14649 tablet_replica.cc:333] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.313412 14649 raft_consensus.cc:2243] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.313782 14649 raft_consensus.cc:2272] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.315830 14649 tablet_replica.cc:333] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.316329 14649 raft_consensus.cc:2243] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.317149 14649 raft_consensus.cc:2272] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.319355 14649 tablet_replica.cc:333] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.319938 14649 raft_consensus.cc:2243] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.320360 14649 raft_consensus.cc:2272] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.322618 14649 tablet_replica.cc:333] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: stopping tablet replica
I20260709 12:27:26.323068 14649 raft_consensus.cc:2243] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.323467 14649 raft_consensus.cc:2272] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:26.347748 23696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111) [suppressed 123 similar messages]
W20260709 12:27:26.351030 23696 consensus_peers.cc:597] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.355805 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
W20260709 12:27:26.435359 23696 consensus_peers.cc:597] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.447129 23804 raft_consensus.cc:1275] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:26.448366 23868 consensus_queue.cc:1048] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:26.465530 23696 consensus_peers.cc:597] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.507695 23696 consensus_peers.cc:597] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.588769 23696 consensus_peers.cc:597] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.601694 23696 consensus_peers.cc:597] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.979626 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:27.303478 23940 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.304044 23940 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.305796 23940 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:27.308683 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
W20260709 12:27:27.312045 23770 leader_election.cc:336] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.312395 23770 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.312979 23940 raft_consensus.cc:2749] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:27.357503 23940 raft_consensus.cc:493] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.358001 23940 raft_consensus.cc:515] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.359926 23940 leader_election.cc:290] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:27.361737 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
W20260709 12:27:27.363796 23770 leader_election.cc:336] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.364169 23770 leader_election.cc:304] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.364769 23940 raft_consensus.cc:2749] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:27.385434 23870 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.385996 23870 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.387826 23870 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.388911 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:27.389601 23804 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:27.390820 23694 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 
W20260709 12:27:27.391270 23696 leader_election.cc:336] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.391520 23870 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:27.391986 23870 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.392316 23870 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.398344 23870 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.399945 23870 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.401121 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:27.401818 23804 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:27.403724 23696 leader_election.cc:336] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.407490 23804 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 2.
I20260709 12:27:27.408486 23694 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.409228 23870 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.409633 23870 raft_consensus.cc:697] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:27.410359 23870 consensus_queue.cc:237] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.417102 23554 catalog_manager.cc:5697] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 1 to 2, leader changed from e19494e779974ae8833d0023733d65a0 (127.14.78.65) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 2 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.474869 23940 raft_consensus.cc:493] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.475468 23940 raft_consensus.cc:515] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.477344 23940 leader_election.cc:290] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:27.478714 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
W20260709 12:27:27.480443 23770 leader_election.cc:336] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.480809 23770 leader_election.cc:304] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.481441 23940 raft_consensus.cc:2749] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:27.528378 23870 raft_consensus.cc:493] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.528980 23870 raft_consensus.cc:515] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.531296 23870 leader_election.cc:290] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.532357 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:27.532986 23804 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:27.534021 23694 leader_election.cc:304] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 
I20260709 12:27:27.534713 23870 raft_consensus.cc:2804] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:27.534852 23696 leader_election.cc:336] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.535187 23870 raft_consensus.cc:493] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.535620 23870 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.541285 23870 raft_consensus.cc:515] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.543133 23870 leader_election.cc:290] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.544229 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:27.544797 23804 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:27.546277 23696 leader_election.cc:336] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.549479 23804 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 2.
I20260709 12:27:27.550431 23694 leader_election.cc:304] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.551074 23870 raft_consensus.cc:2804] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.551541 23870 raft_consensus.cc:697] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:27.552304 23870 consensus_queue.cc:237] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.559230 23554 catalog_manager.cc:5697] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 1 to 2, leader changed from e19494e779974ae8833d0023733d65a0 (127.14.78.65) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 2 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.689710 23870 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.690182 23870 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.691799 23870 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.692893 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
W20260709 12:27:27.695258 23696 leader_election.cc:336] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.695626 23696 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff; no voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.696215 23870 raft_consensus.cc:2749] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:27.741350 23870 raft_consensus.cc:493] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.741878 23870 raft_consensus.cc:515] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.743606 23870 leader_election.cc:290] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.744760 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" is_pre_election: true
I20260709 12:27:27.745483 23804 raft_consensus.cc:2468] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 1.
I20260709 12:27:27.746541 23694 leader_election.cc:304] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 
I20260709 12:27:27.747380 23870 raft_consensus.cc:2804] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:27.747604 23696 leader_election.cc:336] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.747800 23870 raft_consensus.cc:493] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.748220 23870 raft_consensus.cc:3060] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.753597 23870 raft_consensus.cc:515] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.755103 23870 leader_election.cc:290] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:27.756125 23804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695585999b21428c90641c3734b58197" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:27.756688 23804 raft_consensus.cc:3060] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:27.758512 23696 leader_election.cc:336] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.761567 23804 raft_consensus.cc:2468] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 2.
I20260709 12:27:27.762521 23694 leader_election.cc:304] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.763141 23870 raft_consensus.cc:2804] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.763535 23870 raft_consensus.cc:697] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:27.764267 23870 consensus_queue.cc:237] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.774071 23554 catalog_manager.cc:5697] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 1 to 2, leader changed from e19494e779974ae8833d0023733d65a0 (127.14.78.65) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 2 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.810266 23940 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.810885 23940 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.812649 23940 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:27.814250 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" is_pre_election: true
I20260709 12:27:27.814921 23730 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 1.
I20260709 12:27:27.815933 23770 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 
I20260709 12:27:27.816702 23940 raft_consensus.cc:2804] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:27.816725 23770 leader_election.cc:336] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.817170 23940 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e19494e779974ae8833d0023733d65a0)
I20260709 12:27:27.817620 23940 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.823374 23940 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.824764 23940 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:27.826112 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:27.826732 23730 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:27.827903 23770 leader_election.cc:336] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111)
I20260709 12:27:27.831903 23730 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:27.832866 23770 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: e19494e779974ae8833d0023733d65a0
I20260709 12:27:27.833527 23940 raft_consensus.cc:2804] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.834540 23940 raft_consensus.cc:697] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:27.835353 23940 consensus_queue.cc:237] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:27.842043 23554 catalog_manager.cc:5697] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 1 to 2, leader changed from e19494e779974ae8833d0023733d65a0 (127.14.78.65) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:27.849846 23696 consensus_peers.cc:597] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.958468 23804 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.959776 23870 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:27.980439 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:27.994685 23804 raft_consensus.cc:1275] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.995806 23938 consensus_queue.cc:1048] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:28.006831 23696 consensus_peers.cc:597] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.193732 23804 raft_consensus.cc:1275] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.195055 23949 consensus_queue.cc:1048] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:28.207746 23696 consensus_peers.cc:597] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.277886 23770 consensus_peers.cc:597] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.407914 23730 raft_consensus.cc:1275] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.409343 23940 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:28.764130 23696 consensus_peers.cc:597] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.771711 23696 consensus_peers.cc:597] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.923568 23696 consensus_peers.cc:597] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.949333 23696 consensus_peers.cc:597] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.981338 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:29.002494 23696 consensus_peers.cc:597] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.501370 23696 consensus_peers.cc:597] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.982348 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:30.351709 23696 consensus_peers.cc:597] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:30.707967 23696 consensus_peers.cc:597] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:30.871347 23696 consensus_peers.cc:597] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:30.926975 23770 consensus_peers.cc:597] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:30.983266 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:31.015935 23696 consensus_peers.cc:597] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.368983 23696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 12:27:31.371167 23696 consensus_peers.cc:597] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:31.387615 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:31.395285 23696 consensus_peers.cc:597] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.395380 23970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:31.396294 23969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:31.397804 23972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:31.399580 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:31.400868 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:31.401152 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:31.401358 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600051401338 us; error 0 us; skew 500 ppm
I20260709 12:27:31.401918 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:31.404335 14649 webserver.cc:533] Webserver started at http://127.14.78.65:37711/ using document root <none> and password file <none>
I20260709 12:27:31.404846 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:31.405030 14649 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:31.408849 14649 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:31.412567 23977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:31.413592 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:31.413936 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "e19494e779974ae8833d0023733d65a0"
format_stamp: "Formatted at 2026-07-09 12:27:23 on dist-test-slave-vrh7"
I20260709 12:27:31.414453 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:31.435868 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:31.437027 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:31.438421 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:31.442512 23984 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:27:31.492552 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:27:31.492830 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.051s	user 0.003s	sys 0.000s
I20260709 12:27:31.493127 14649 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:27:31.497638 23984 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
W20260709 12:27:31.500031 23696 consensus_peers.cc:597] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:31.514310 23984 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.515259 23984 tablet_bootstrap.cc:492] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.515918 23984 ts_tablet_manager.cc:1403] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:27:31.518786 23984 raft_consensus.cc:359] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.519347 23984 raft_consensus.cc:740] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.519934 23984 consensus_queue.cc:260] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.522498 23984 ts_tablet_manager.cc:1434] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:27:31.523156 23984 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.534854 23984 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.535566 23984 tablet_bootstrap.cc:492] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.536085 23984 ts_tablet_manager.cc:1403] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:27:31.537285 14649 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:27:31.537566 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.038s	sys 0.006s
I20260709 12:27:31.538137 23984 raft_consensus.cc:359] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.538983 23984 raft_consensus.cc:740] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.539572 23984 consensus_queue.cc:260] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.541208 23984 ts_tablet_manager.cc:1434] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:31.541821 23984 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
W20260709 12:27:31.554817 23696 consensus_peers.cc:597] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:31.558427 23984 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.559208 23984 tablet_bootstrap.cc:492] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.559965 23984 ts_tablet_manager.cc:1403] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:27:31.562268 23984 raft_consensus.cc:359] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.562898 23984 raft_consensus.cc:740] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.563548 23984 consensus_queue.cc:260] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.565001 23984 ts_tablet_manager.cc:1434] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20260709 12:27:31.565631 23984 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.577858 23984 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.578737 23984 tablet_bootstrap.cc:492] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.579411 23984 ts_tablet_manager.cc:1403] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 12:27:31.581980 23984 raft_consensus.cc:359] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.582657 23984 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.583400 23984 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.585487 23984 ts_tablet_manager.cc:1434] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:31.586189 23984 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.597852 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:42321
I20260709 12:27:31.598016 24048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:42321 every 8 connection(s)
I20260709 12:27:31.598775 23984 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.599444 23984 tablet_bootstrap.cc:492] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.599948 23984 ts_tablet_manager.cc:1403] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:27:31.602377 23984 raft_consensus.cc:359] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.603132 23984 raft_consensus.cc:740] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.603837 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:31.603899 23984 consensus_queue.cc:260] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.605829 23984 ts_tablet_manager.cc:1434] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:31.606629 23984 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.624454 24049 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37991
I20260709 12:27:31.625098 24049 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:31.626369 24049 heartbeater.cc:507] Master 127.14.78.126:37991 requested a full tablet report, sending...
I20260709 12:27:31.627584 23984 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.628587 23984 tablet_bootstrap.cc:492] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.629294 23984 ts_tablet_manager.cc:1403] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 12:27:31.631736 23984 raft_consensus.cc:359] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.632278 23984 raft_consensus.cc:740] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.632225 23553 ts_manager.cc:194] Re-registered known tserver with Master: e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321)
I20260709 12:27:31.633281 23984 consensus_queue.cc:260] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.635416 23984 ts_tablet_manager.cc:1434] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:27:31.636272 23984 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.638187 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "104f49edc5604da0b035b29da79d8142"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:31.638931 23730 raft_consensus.cc:606] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:31.641844 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:31.642424 23730 raft_consensus.cc:606] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:31.644836 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:31.645092 23553 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41468
I20260709 12:27:31.645375 23730 raft_consensus.cc:606] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:31.647827 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:31.648276 23730 raft_consensus.cc:606] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:31.648994 24049 heartbeater.cc:499] Master 127.14.78.126:37991 was elected leader, sending a full tablet report...
I20260709 12:27:31.650482 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f80660313b3048be84c3ef80948bddff"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:31.651051 23730 raft_consensus.cc:606] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:31.652261 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:31.652943 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:31.653723 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:31.654973 23984 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.655886 23984 tablet_bootstrap.cc:492] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.656504 23984 ts_tablet_manager.cc:1403] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 12:27:31.659070 23984 raft_consensus.cc:359] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.659765 23984 raft_consensus.cc:740] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.660482 23984 consensus_queue.cc:260] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.662799 23984 ts_tablet_manager.cc:1434] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:31.663571 23984 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.674728 24058 raft_consensus.cc:993] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:31.675268 23960 raft_consensus.cc:1081] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:31.676785 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:31.677395 23803 raft_consensus.cc:493] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.677734 23803 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.677907 23984 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.678855 23984 tablet_bootstrap.cc:492] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.679486 23984 ts_tablet_manager.cc:1403] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:27:31.682123 23984 raft_consensus.cc:359] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.682905 23984 raft_consensus.cc:740] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.683593 23984 consensus_queue.cc:260] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.685673 23984 ts_tablet_manager.cc:1434] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:31.686497 23984 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.687196 23803 raft_consensus.cc:515] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.689092 23803 leader_election.cc:290] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:31.690541 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:31.691141 23730 raft_consensus.cc:3055] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:31.691474 23730 raft_consensus.cc:740] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:31.692534 23730 consensus_queue.cc:260] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.693995 23730 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.702653 23730 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:31.703441 23984 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.703945 23770 leader_election.cc:304] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, ba5b440b5f4b4cf683d4ea2a3647e117; no voters: 
I20260709 12:27:31.704350 23984 tablet_bootstrap.cc:492] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.704919 23966 raft_consensus.cc:2804] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:31.705120 23984 ts_tablet_manager.cc:1403] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.010s
I20260709 12:27:31.706437 23966 raft_consensus.cc:697] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:31.707422 23966 consensus_queue.cc:237] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.708186 23984 raft_consensus.cc:359] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.708945 23984 raft_consensus.cc:740] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.709718 23984 consensus_queue.cc:260] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.712291 23984 ts_tablet_manager.cc:1434] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:31.713164 23984 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Bootstrap starting.
I20260709 12:27:31.716284 23553 catalog_manager.cc:5697] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 1 to 2, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.718430 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:31.719152 24023 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.728140 24023 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:31.729980 23984 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:31.730964 23984 tablet_bootstrap.cc:492] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Bootstrap complete.
I20260709 12:27:31.731598 23984 ts_tablet_manager.cc:1403] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:27:31.733676 23984 raft_consensus.cc:359] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.734138 23984 raft_consensus.cc:740] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19494e779974ae8833d0023733d65a0, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.734637 23984 consensus_queue.cc:260] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.736066 23984 ts_tablet_manager.cc:1434] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:27:31.794588 24058 raft_consensus.cc:993] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:31.795805 23960 raft_consensus.cc:1081] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:31.797462 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:31.797946 23803 raft_consensus.cc:493] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.798239 23803 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.803439 23803 raft_consensus.cc:515] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.804546 24023 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.805039 23803 leader_election.cc:290] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 3 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:31.806038 24022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:31.806322 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07a13115c6448a7b17e1b333cafd11d" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:31.806707 24022 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.806968 23730 raft_consensus.cc:3055] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:31.807353 23730 raft_consensus.cc:740] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:31.808166 23730 consensus_queue.cc:260] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.809495 23730 raft_consensus.cc:3060] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.812891 24022 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 3.
I20260709 12:27:31.814311 23770 leader_election.cc:304] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:31.815078 23966 raft_consensus.cc:2804] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:31.815550 23966 raft_consensus.cc:697] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:31.816512 23966 consensus_queue.cc:237] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.817955 23730 raft_consensus.cc:2468] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 3.
I20260709 12:27:31.824930 23553 catalog_manager.cc:5697] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 2 to 3, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.837008 24068 raft_consensus.cc:993] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:31.837462 23960 raft_consensus.cc:1081] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:31.838833 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:31.839290 23803 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.839587 23803 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.844739 23803 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.846432 23803 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 3 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:31.847121 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:31.847436 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:31.847786 24023 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.848021 23730 raft_consensus.cc:3055] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:31.848357 23730 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:31.849259 23730 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.850524 23730 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.854943 24023 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 3.
I20260709 12:27:31.856019 23770 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:31.857517 23966 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:31.858053 23966 raft_consensus.cc:697] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:31.858842 23966 consensus_queue.cc:237] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:31.860742 23730 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 3.
I20260709 12:27:31.867133 23554 catalog_manager.cc:5697] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 2 to 3, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.883417 24022 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.887961 24023 raft_consensus.cc:3060] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:31.984303 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:32.077243 24058 raft_consensus.cc:993] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:32.077816 23960 raft_consensus.cc:1081] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:32.079550 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f80660313b3048be84c3ef80948bddff"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:32.080013 23803 raft_consensus.cc:493] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.080269 23803 raft_consensus.cc:3060] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.085340 23803 raft_consensus.cc:515] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.086817 23803 leader_election.cc:290] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:32.087633 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80660313b3048be84c3ef80948bddff" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:32.087806 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80660313b3048be84c3ef80948bddff" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:32.088312 24023 raft_consensus.cc:3060] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.088389 23730 raft_consensus.cc:3055] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:32.088800 23730 raft_consensus.cc:740] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:32.089433 23730 consensus_queue.cc:260] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.090449 23730 raft_consensus.cc:3060] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.093305 24023 raft_consensus.cc:2468] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:32.094238 23770 leader_election.cc:304] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:32.094867 23966 raft_consensus.cc:2804] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:32.095348 23966 raft_consensus.cc:697] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:32.095789 23730 raft_consensus.cc:2468] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:32.096241 23966 consensus_queue.cc:237] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.103217 23554 catalog_manager.cc:5697] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 1 to 2, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:32.151274 23730 raft_consensus.cc:1275] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.152587 23966 consensus_queue.cc:1048] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.162004 24023 raft_consensus.cc:1275] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.163430 23966 consensus_queue.cc:1048] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.230922 24068 raft_consensus.cc:993] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:32.231488 23960 raft_consensus.cc:1081] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:32.233229 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "104f49edc5604da0b035b29da79d8142"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:32.233741 23803 raft_consensus.cc:493] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.234092 23803 raft_consensus.cc:3060] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.240607 23803 raft_consensus.cc:515] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.242424 23803 leader_election.cc:290] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:32.243178 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:32.243330 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104f49edc5604da0b035b29da79d8142" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:32.243839 24023 raft_consensus.cc:3060] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.244050 23730 raft_consensus.cc:3055] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:32.244426 23730 raft_consensus.cc:740] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:32.245267 23730 consensus_queue.cc:260] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.246327 23730 raft_consensus.cc:3060] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:32.248912 24023 raft_consensus.cc:2468] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:32.249907 23770 leader_election.cc:304] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:32.250556 23966 raft_consensus.cc:2804] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:32.251081 23966 raft_consensus.cc:697] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:32.252071 23966 consensus_queue.cc:237] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.252686 23730 raft_consensus.cc:2468] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:32.257407 23730 raft_consensus.cc:1275] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:32.258764 24061 consensus_queue.cc:1048] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.260404 23553 catalog_manager.cc:5697] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 1 to 2, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:32.269240 24023 raft_consensus.cc:1275] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:32.270913 23966 consensus_queue.cc:1048] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.349085 24023 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:32.350319 23966 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.359869 23730 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:32.361908 24079 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:32.610265 23730 raft_consensus.cc:1275] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.611431 24079 consensus_queue.cc:1048] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.620700 24023 raft_consensus.cc:1275] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.622155 24079 consensus_queue.cc:1048] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.636700 23730 raft_consensus.cc:1275] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.637925 24079 consensus_queue.cc:1048] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.648397 24023 raft_consensus.cc:1275] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:32.649706 24061 consensus_queue.cc:1048] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.662683 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:32.679251 23803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
mode: GRACEFUL
new_leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:48216
I20260709 12:27:32.679766 23803 raft_consensus.cc:606] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Received request to transfer leadership to TS 24cdcf0bf51746638717f13fa6c4d1ff
I20260709 12:27:32.681998 23803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
mode: GRACEFUL
new_leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:48216
I20260709 12:27:32.682438 23803 raft_consensus.cc:606] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Received request to transfer leadership to TS 24cdcf0bf51746638717f13fa6c4d1ff
I20260709 12:27:32.683441 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:32.683841 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:32.684324 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:32.757315 24079 raft_consensus.cc:993] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: : Instructing follower 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:32.757735 24061 raft_consensus.cc:1081] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Signalling peer 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:32.759143 23730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:36630
I20260709 12:27:32.759603 23730 raft_consensus.cc:493] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.759848 23730 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:32.765472 23730 raft_consensus.cc:515] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.767204 23730 leader_election.cc:290] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 3 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:32.767971 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:32.768237 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b2615f67e4365a95f29aba6f81b0f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:32.768713 24023 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:32.768817 23803 raft_consensus.cc:3055] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:32.769297 23803 raft_consensus.cc:740] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:32.770107 23803 consensus_queue.cc:260] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.770991 23803 raft_consensus.cc:3060] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:32.774412 24023 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 3.
I20260709 12:27:32.775354 23696 leader_election.cc:304] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:32.775869 23803 raft_consensus.cc:2468] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 3.
I20260709 12:27:32.775991 23960 raft_consensus.cc:2804] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:32.776536 23960 raft_consensus.cc:697] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:32.777293 23960 consensus_queue.cc:237] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.783183 23554 catalog_manager.cc:5697] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 2 to 3, leader changed from ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 3 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.949076 24061 raft_consensus.cc:993] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: : Instructing follower 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:32.949548 23966 raft_consensus.cc:1081] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Signalling peer 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:32.950917 23730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:36630
I20260709 12:27:32.951416 23730 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.951723 23730 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:32.956637 23730 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.958225 23730 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 4 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:32.958971 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:32.959146 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:32.959692 24023 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:32.959702 23803 raft_consensus.cc:3055] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:32.960343 23803 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:32.961086 23803 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.961905 23803 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:32.964986 24023 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 4.
I20260709 12:27:32.966064 23696 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:32.966254 23803 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 4.
I20260709 12:27:32.966883 23960 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:32.967365 23960 raft_consensus.cc:697] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:32.968116 23960 consensus_queue.cc:237] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:32.974038 23554 catalog_manager.cc:5697] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 3 to 4, leader changed from ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 4 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:32.985205 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:33.211692 24023 raft_consensus.cc:1275] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:33.212965 24058 consensus_queue.cc:1048] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:33.222301 23803 raft_consensus.cc:1275] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:33.224215 24099 consensus_queue.cc:1048] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:33.393730 23803 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:33.394801 24099 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:33.402340 24023 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:33.404210 24104 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:33.690564 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:33.698362 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:33.698863 23730 raft_consensus.cc:606] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:33.701112 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:33.701534 23730 raft_consensus.cc:606] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:33.702574 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:33.703045 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:33.703584 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:33.966904 24104 raft_consensus.cc:993] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:33.967475 24058 raft_consensus.cc:1081] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:33.968930 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:33.969408 23803 raft_consensus.cc:493] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:33.969679 23803 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.974491 23803 raft_consensus.cc:515] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:33.975832 23803 leader_election.cc:290] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:33.976677 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:33.976882 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:33.977396 24023 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.977540 23730 raft_consensus.cc:3055] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:33.977947 23730 raft_consensus.cc:740] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:33.978538 23730 consensus_queue.cc:260] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:33.979451 23730 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.983376 24023 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:33.984509 23770 leader_election.cc:304] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:33.985076 23730 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 2.
I20260709 12:27:33.985330 23966 raft_consensus.cc:2804] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:33.986174 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:33.986887 23966 raft_consensus.cc:697] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:33.987735 23966 consensus_queue.cc:237] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:33.996790 23554 catalog_manager.cc:5697] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 1 to 2, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.141456 24104 raft_consensus.cc:993] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:34.141932 24058 raft_consensus.cc:1081] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:34.143209 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:34.143625 23803 raft_consensus.cc:493] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:34.143847 23803 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:34.148142 23803 raft_consensus.cc:515] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:34.149585 23803 leader_election.cc:290] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 3 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:34.150306 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:34.150513 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4e88cfb85c43f4ae110d4f3ac3e527" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:34.150954 24023 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:34.151031 23730 raft_consensus.cc:3055] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:34.151453 23730 raft_consensus.cc:740] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:34.152190 23730 consensus_queue.cc:260] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:34.153383 23730 raft_consensus.cc:3060] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:34.157727 24023 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 3.
I20260709 12:27:34.158703 23770 leader_election.cc:304] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:34.159324 23966 raft_consensus.cc:2804] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:34.159739 23730 raft_consensus.cc:2468] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 3.
I20260709 12:27:34.159816 23966 raft_consensus.cc:697] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:34.160948 23966 consensus_queue.cc:237] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:34.167418 23554 catalog_manager.cc:5697] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 2 to 3, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.471715 23730 raft_consensus.cc:1275] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:34.472904 23966 consensus_queue.cc:1048] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:34.481962 24023 raft_consensus.cc:1275] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:34.483305 24106 consensus_queue.cc:1048] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:34.633173 23730 raft_consensus.cc:1275] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:34.634342 24106 consensus_queue.cc:1048] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:34.642781 24023 raft_consensus.cc:1275] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:34.644745 24106 consensus_queue.cc:1048] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:34.709594 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:34.716768 23803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
mode: GRACEFUL
new_leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:48216
I20260709 12:27:34.717348 23803 raft_consensus.cc:606] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Received request to transfer leadership to TS 24cdcf0bf51746638717f13fa6c4d1ff
I20260709 12:27:34.719895 23803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
mode: GRACEFUL
new_leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:48216
I20260709 12:27:34.720382 23803 raft_consensus.cc:606] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Received request to transfer leadership to TS 24cdcf0bf51746638717f13fa6c4d1ff
I20260709 12:27:34.721432 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:34.721908 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:34.722448 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:34.978673 24120 raft_consensus.cc:993] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: : Instructing follower 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:34.979503 24106 raft_consensus.cc:1081] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Signalling peer 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:34.981024 23730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:36630
I20260709 12:27:34.981635 23730 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:34.981979 23730 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:34.987597 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:34.989686 23730 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:34.991391 23730 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 3 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:34.992497 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:34.992612 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:34.993258 23803 raft_consensus.cc:3055] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:34.993269 24023 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:34.993566 23803 raft_consensus.cc:740] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:34.994707 23803 consensus_queue.cc:260] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:34.996104 23803 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:34.999989 24023 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 3.
I20260709 12:27:35.001521 23696 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:35.002424 24058 raft_consensus.cc:2804] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:35.003474 24058 raft_consensus.cc:697] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:35.004464 23803 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 3.
I20260709 12:27:35.004739 24058 consensus_queue.cc:237] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.013860 23554 catalog_manager.cc:5697] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 2 to 3, leader changed from ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 3 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.100782 24120 raft_consensus.cc:993] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: : Instructing follower 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:35.101258 24106 raft_consensus.cc:1081] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Signalling peer 24cdcf0bf51746638717f13fa6c4d1ff to start an election
I20260709 12:27:35.102596 23730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
 from {username='slave'} at 127.0.0.1:36630
I20260709 12:27:35.102982 23730 raft_consensus.cc:493] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.103199 23730 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.108585 23730 raft_consensus.cc:515] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.110062 23730 leader_election.cc:290] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 3 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67:34973)
I20260709 12:27:35.110956 24022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:35.111061 23803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf5f68e53f14fc785bdb6ab9158494f" candidate_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
I20260709 12:27:35.111649 24022 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.111649 23803 raft_consensus.cc:3055] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:35.112363 23803 raft_consensus.cc:740] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:35.113173 23803 consensus_queue.cc:260] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.114135 23803 raft_consensus.cc:3060] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.118726 24022 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 3.
I20260709 12:27:35.119340 23803 raft_consensus.cc:2468] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24cdcf0bf51746638717f13fa6c4d1ff in term 3.
I20260709 12:27:35.119706 23696 leader_election.cc:304] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cdcf0bf51746638717f13fa6c4d1ff, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:35.120682 24058 raft_consensus.cc:2804] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:35.121145 24058 raft_consensus.cc:697] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Becoming Leader. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:35.122157 24058 consensus_queue.cc:237] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.128929 23554 catalog_manager.cc:5697] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff reported cstate change: term changed from 2 to 3, leader changed from ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67) to 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66). New cstate: current_term: 3 leader_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.405148 23803 raft_consensus.cc:1275] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:35.406239 24058 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:35.417357 24023 raft_consensus.cc:1275] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:35.419752 24058 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:35.653649 23803 raft_consensus.cc:1275] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:35.654814 24058 consensus_queue.cc:1048] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:35.663575 24023 raft_consensus.cc:1275] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Refusing update from remote peer 24cdcf0bf51746638717f13fa6c4d1ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:35.665270 24123 consensus_queue.cc:1048] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:35.728503 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:35.737313 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:35.737859 23730 raft_consensus.cc:606] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:35.740440 23730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e"
dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
mode: GRACEFUL
new_leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:41734
I20260709 12:27:35.740865 23730 raft_consensus.cc:606] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Received request to transfer leadership to TS ba5b440b5f4b4cf683d4ea2a3647e117
I20260709 12:27:35.741895 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:35.742357 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:35.743079 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:35.811074 24123 raft_consensus.cc:993] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:35.811702 24129 raft_consensus.cc:1081] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:35.813225 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:35.813678 23803 raft_consensus.cc:493] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.813962 23803 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.819096 23803 raft_consensus.cc:515] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.820674 23803 leader_election.cc:290] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 4 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:35.821393 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:35.821698 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a09e70f5b6114f5d8d339079dbaab67e" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:35.822070 24023 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.822293 23730 raft_consensus.cc:3055] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:35.822650 23730 raft_consensus.cc:740] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:35.823307 23730 consensus_queue.cc:260] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.824177 23730 raft_consensus.cc:3060] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.826557 24023 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 4.
I20260709 12:27:35.827574 23770 leader_election.cc:304] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:35.828305 24120 raft_consensus.cc:2804] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:35.828708 24120 raft_consensus.cc:697] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:35.829332 23730 raft_consensus.cc:2468] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 4.
I20260709 12:27:35.829440 24120 consensus_queue.cc:237] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.835431 23553 catalog_manager.cc:5697] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 3 to 4, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 4 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:35.942837 24123 raft_consensus.cc:993] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: : Instructing follower ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:35.943333 24129 raft_consensus.cc:1081] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 LEADER]: Signalling peer ba5b440b5f4b4cf683d4ea2a3647e117 to start an election
I20260709 12:27:35.944661 23803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241"
dest_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:27:35.945135 23803 raft_consensus.cc:493] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.945410 23803 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.951022 23803 raft_consensus.cc:515] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.952402 23803 leader_election.cc:290] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 5 election: Requested vote from peers e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321), 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995)
I20260709 12:27:35.953284 24023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e19494e779974ae8833d0023733d65a0"
I20260709 12:27:35.953444 23730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684480b8b17744d6a03dbfd13702f241" candidate_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "24cdcf0bf51746638717f13fa6c4d1ff"
I20260709 12:27:35.953985 24023 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.954023 23730 raft_consensus.cc:3055] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:35.954432 23730 raft_consensus.cc:740] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24cdcf0bf51746638717f13fa6c4d1ff, State: Running, Role: LEADER
I20260709 12:27:35.955173 23730 consensus_queue.cc:260] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.956107 23730 raft_consensus.cc:3060] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.958577 24023 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 5.
I20260709 12:27:35.959635 23770 leader_election.cc:304] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba5b440b5f4b4cf683d4ea2a3647e117, e19494e779974ae8833d0023733d65a0; no voters: 
I20260709 12:27:35.960381 24120 raft_consensus.cc:2804] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:35.960935 24120 raft_consensus.cc:697] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 5 LEADER]: Becoming Leader. State: Replica: ba5b440b5f4b4cf683d4ea2a3647e117, State: Running, Role: LEADER
I20260709 12:27:35.961021 23730 raft_consensus.cc:2468] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba5b440b5f4b4cf683d4ea2a3647e117 in term 5.
I20260709 12:27:35.962051 24120 consensus_queue.cc:237] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } }
I20260709 12:27:35.969463 23553 catalog_manager.cc:5697] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 reported cstate change: term changed from 4 to 5, leader changed from 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66) to ba5b440b5f4b4cf683d4ea2a3647e117 (127.14.78.67). New cstate: current_term: 5 leader_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba5b440b5f4b4cf683d4ea2a3647e117" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 34973 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:35.988513 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:36.282821 24023 raft_consensus.cc:1275] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:36.284024 24120 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:36.292472 23731 raft_consensus.cc:1275] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:36.294413 24120 consensus_queue.cc:1048] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:36.421380 23731 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 5 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:36.422675 24146 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cdcf0bf51746638717f13fa6c4d1ff" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:36.432552 24023 raft_consensus.cc:1275] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 5 FOLLOWER]: Refusing update from remote peer ba5b440b5f4b4cf683d4ea2a3647e117: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:36.434458 24120 consensus_queue.cc:1048] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19494e779974ae8833d0023733d65a0" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:36.749081 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:36.782998 14649 tablet_server.cc:179] TabletServer@127.14.78.65:42321 shutting down...
W20260709 12:27:36.794258 23770 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:27:36.799983 23770 consensus_peers.cc:597] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.814702 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:36.815552 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.816504 14649 raft_consensus.cc:2243] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.816951 14649 raft_consensus.cc:2272] T fbf5f68e53f14fc785bdb6ab9158494f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.819139 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.819725 14649 raft_consensus.cc:2243] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.820156 14649 raft_consensus.cc:2272] T 695585999b21428c90641c3734b58197 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.822400 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.822916 14649 raft_consensus.cc:2243] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.823339 14649 raft_consensus.cc:2272] T 104f49edc5604da0b035b29da79d8142 P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.826047 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.826615 14649 raft_consensus.cc:2243] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.827291 14649 raft_consensus.cc:2272] T f80660313b3048be84c3ef80948bddff P e19494e779974ae8833d0023733d65a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.829504 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.830020 14649 raft_consensus.cc:2243] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.830453 14649 raft_consensus.cc:2272] T b07a13115c6448a7b17e1b333cafd11d P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.832571 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.833128 14649 raft_consensus.cc:2243] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.833551 14649 raft_consensus.cc:2272] T 684480b8b17744d6a03dbfd13702f241 P e19494e779974ae8833d0023733d65a0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.836071 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.836553 14649 raft_consensus.cc:2243] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.836967 14649 raft_consensus.cc:2272] T 5c3b2615f67e4365a95f29aba6f81b0f P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.839161 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.839648 14649 raft_consensus.cc:2243] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.840022 14649 raft_consensus.cc:2272] T a09e70f5b6114f5d8d339079dbaab67e P e19494e779974ae8833d0023733d65a0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.843335 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.843796 14649 raft_consensus.cc:2243] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.844120 14649 raft_consensus.cc:2272] T 5f5052d7202a46f8bad53717d030a962 P e19494e779974ae8833d0023733d65a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.846199 14649 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:36.846648 14649 raft_consensus.cc:2243] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.847072 14649 raft_consensus.cc:2272] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P e19494e779974ae8833d0023733d65a0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:36.855266 23770 consensus_peers.cc:597] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.879423 14649 tablet_server.cc:196] TabletServer@127.14.78.65:42321 shutdown complete.
W20260709 12:27:36.904693 23770 consensus_peers.cc:597] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.910148 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
W20260709 12:27:36.919680 23770 consensus_peers.cc:597] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.938629 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:36.939338 14649 tablet_replica.cc:333] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.940215 14649 raft_consensus.cc:2243] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.940688 14649 raft_consensus.cc:2272] T 684480b8b17744d6a03dbfd13702f241 P 24cdcf0bf51746638717f13fa6c4d1ff [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.943796 14649 tablet_replica.cc:333] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.944432 14649 raft_consensus.cc:2243] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.944972 14649 raft_consensus.cc:2272] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.947516 14649 tablet_replica.cc:333] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
W20260709 12:27:36.947855 23770 consensus_peers.cc:597] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.948169 14649 raft_consensus.cc:2243] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:36.949116 14649 raft_consensus.cc:2272] T fbf5f68e53f14fc785bdb6ab9158494f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.951182 14649 tablet_replica.cc:333] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.951731 14649 raft_consensus.cc:2243] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:36.952661 14649 raft_consensus.cc:2272] T 5c3b2615f67e4365a95f29aba6f81b0f P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.954919 14649 tablet_replica.cc:333] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.955444 14649 raft_consensus.cc:2243] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.955852 14649 raft_consensus.cc:2272] T a09e70f5b6114f5d8d339079dbaab67e P 24cdcf0bf51746638717f13fa6c4d1ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.958232 14649 tablet_replica.cc:333] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.958760 14649 raft_consensus.cc:2243] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.959228 14649 raft_consensus.cc:2272] T b07a13115c6448a7b17e1b333cafd11d P 24cdcf0bf51746638717f13fa6c4d1ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.961576 14649 tablet_replica.cc:333] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.962091 14649 raft_consensus.cc:2243] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.962602 14649 raft_consensus.cc:2272] T 104f49edc5604da0b035b29da79d8142 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.964602 14649 tablet_replica.cc:333] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.965158 14649 raft_consensus.cc:2243] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:36.965960 14649 raft_consensus.cc:2272] T 695585999b21428c90641c3734b58197 P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.968164 14649 tablet_replica.cc:333] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.968750 14649 raft_consensus.cc:2243] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:36.969323 14649 raft_consensus.cc:2272] T f80660313b3048be84c3ef80948bddff P 24cdcf0bf51746638717f13fa6c4d1ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:36.971541 14649 tablet_replica.cc:333] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff: stopping tablet replica
I20260709 12:27:36.972055 14649 raft_consensus.cc:2243] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:36.972997 14649 raft_consensus.cc:2272] T 5f5052d7202a46f8bad53717d030a962 P 24cdcf0bf51746638717f13fa6c4d1ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:36.989529 23602 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:36.995210 23770 consensus_peers.cc:597] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer e19494e779974ae8833d0023733d65a0 (127.14.78.65:42321): Couldn't send request to peer e19494e779974ae8833d0023733d65a0. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.997063 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
W20260709 12:27:37.017832 23770 consensus_peers.cc:597] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995): Couldn't send request to peer 24cdcf0bf51746638717f13fa6c4d1ff. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:39995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.026381 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
I20260709 12:27:37.054195 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:37.055265 14649 tablet_replica.cc:333] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
W20260709 12:27:37.056380 23770 consensus_peers.cc:597] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 -> Peer 24cdcf0bf51746638717f13fa6c4d1ff (127.14.78.66:39995): Couldn't send request to peer 24cdcf0bf51746638717f13fa6c4d1ff. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:39995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.056406 14649 raft_consensus.cc:2243] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.057763 14649 raft_consensus.cc:2272] T 684480b8b17744d6a03dbfd13702f241 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.061344 14649 tablet_replica.cc:333] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.062120 14649 raft_consensus.cc:2243] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.062995 14649 raft_consensus.cc:2272] T b07a13115c6448a7b17e1b333cafd11d P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.065029 14649 tablet_replica.cc:333] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.065573 14649 raft_consensus.cc:2243] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.066286 14649 raft_consensus.cc:2272] T 8a4e88cfb85c43f4ae110d4f3ac3e527 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.068257 14649 tablet_replica.cc:333] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.068712 14649 raft_consensus.cc:2243] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.069577 14649 raft_consensus.cc:2272] T 104f49edc5604da0b035b29da79d8142 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.071663 14649 tablet_replica.cc:333] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.072162 14649 raft_consensus.cc:2243] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.072562 14649 raft_consensus.cc:2272] T 695585999b21428c90641c3734b58197 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.074638 14649 tablet_replica.cc:333] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.075094 14649 raft_consensus.cc:2243] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.075807 14649 raft_consensus.cc:2272] T f80660313b3048be84c3ef80948bddff P ba5b440b5f4b4cf683d4ea2a3647e117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.077785 14649 tablet_replica.cc:333] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.078249 14649 raft_consensus.cc:2243] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.078617 14649 raft_consensus.cc:2272] T 5f5052d7202a46f8bad53717d030a962 P ba5b440b5f4b4cf683d4ea2a3647e117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.080567 14649 tablet_replica.cc:333] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.081100 14649 raft_consensus.cc:2243] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.081450 14649 raft_consensus.cc:2272] T fbf5f68e53f14fc785bdb6ab9158494f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.083280 14649 tablet_replica.cc:333] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.083689 14649 raft_consensus.cc:2243] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.084100 14649 raft_consensus.cc:2272] T 5c3b2615f67e4365a95f29aba6f81b0f P ba5b440b5f4b4cf683d4ea2a3647e117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.086002 14649 tablet_replica.cc:333] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117: stopping tablet replica
I20260709 12:27:37.086395 14649 raft_consensus.cc:2243] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.087074 14649 raft_consensus.cc:2272] T a09e70f5b6114f5d8d339079dbaab67e P ba5b440b5f4b4cf683d4ea2a3647e117 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.119637 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
I20260709 12:27:37.144841 14649 master.cc:562] Master@127.14.78.126:37991 shutting down...
I20260709 12:27:37.166296 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.166944 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.167337 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P a277c5c662f44113b59c08ad549a8473: stopping tablet replica
I20260709 12:27:37.188009 14649 master.cc:584] Master@127.14.78.126:37991 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14390 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:27:37.231228 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:46199
I20260709 12:27:37.232327 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:37.237953 24155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.238040 24154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.238981 24157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.239374 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:37.240281 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:37.240453 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:37.240564 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600057240553 us; error 0 us; skew 500 ppm
I20260709 12:27:37.241008 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:37.243273 14649 webserver.cc:533] Webserver started at http://127.14.78.126:43823/ using document root <none> and password file <none>
I20260709 12:27:37.243723 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:37.243880 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:37.244087 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:37.245272 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "4d309e7087fb4b5d83970e30768c6b06"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.249366 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:37.252492 24162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.253242 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:37.253471 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "4d309e7087fb4b5d83970e30768c6b06"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.253695 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:37.264904 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:37.265983 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:37.302872 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:46199
I20260709 12:27:37.302983 24213 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:46199 every 8 connection(s)
I20260709 12:27:37.307032 24214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.317942 24214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06: Bootstrap starting.
I20260709 12:27:37.322656 24214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.326654 24214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06: No bootstrap required, opened a new log
I20260709 12:27:37.328691 24214 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d309e7087fb4b5d83970e30768c6b06" member_type: VOTER }
I20260709 12:27:37.329082 24214 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.329308 24214 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d309e7087fb4b5d83970e30768c6b06, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.329851 24214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d309e7087fb4b5d83970e30768c6b06" member_type: VOTER }
I20260709 12:27:37.330297 24214 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:37.330521 24214 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:37.330788 24214 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:37.335150 24214 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d309e7087fb4b5d83970e30768c6b06" member_type: VOTER }
I20260709 12:27:37.335628 24214 leader_election.cc:304] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d309e7087fb4b5d83970e30768c6b06; no voters: 
I20260709 12:27:37.336637 24214 leader_election.cc:290] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:37.336942 24217 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:37.338382 24217 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 1 LEADER]: Becoming Leader. State: Replica: 4d309e7087fb4b5d83970e30768c6b06, State: Running, Role: LEADER
I20260709 12:27:37.339038 24217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d309e7087fb4b5d83970e30768c6b06" member_type: VOTER }
I20260709 12:27:37.339584 24214 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:37.343299 24218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d309e7087fb4b5d83970e30768c6b06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d309e7087fb4b5d83970e30768c6b06" member_type: VOTER } }
I20260709 12:27:37.344054 24219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d309e7087fb4b5d83970e30768c6b06. Latest consensus state: current_term: 1 leader_uuid: "4d309e7087fb4b5d83970e30768c6b06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d309e7087fb4b5d83970e30768c6b06" member_type: VOTER } }
I20260709 12:27:37.344597 24218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:37.344684 24219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:37.347193 24225 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:37.354972 24225 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:37.356104 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:37.363471 24225 catalog_manager.cc:1383] Generated new cluster ID: 292ee784a3b54013bc5f5ddaa8481bb8
I20260709 12:27:37.363736 24225 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:37.396097 24225 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:37.397531 24225 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:37.416808 24225 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06: Generated new TSK 0
I20260709 12:27:37.417414 24225 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:37.422840 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:37.430740 24235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.431600 24236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.437163 14649 server_base.cc:1061] running on GCE node
W20260709 12:27:37.438165 24238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.439134 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:37.439374 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:37.439543 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600057439524 us; error 0 us; skew 500 ppm
I20260709 12:27:37.440071 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:37.442353 14649 webserver.cc:533] Webserver started at http://127.14.78.65:35463/ using document root <none> and password file <none>
I20260709 12:27:37.442826 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:37.443022 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:37.443292 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:37.444375 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "3facdf10800b4805be53e3abc4ae5abc"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.448791 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:27:37.452273 24243 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.453356 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:37.453626 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "3facdf10800b4805be53e3abc4ae5abc"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.453984 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:37.478101 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:37.479189 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:37.480587 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:37.482789 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:37.483003 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.483264 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:37.483443 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.522171 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:45503
I20260709 12:27:37.522269 24305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:45503 every 8 connection(s)
I20260709 12:27:37.527156 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:37.533941 24310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.535573 24311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.538161 24313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.539209 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:37.539680 24306 heartbeater.cc:344] Connected to a master server at 127.14.78.126:46199
I20260709 12:27:37.540095 24306 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:37.540354 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:37.540681 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:37.540822 24306 heartbeater.cc:507] Master 127.14.78.126:46199 requested a full tablet report, sending...
I20260709 12:27:37.540871 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600057540853 us; error 0 us; skew 500 ppm
I20260709 12:27:37.541723 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:37.543102 24179 ts_manager.cc:194] Registered new tserver with Master: 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503)
I20260709 12:27:37.544389 14649 webserver.cc:533] Webserver started at http://127.14.78.66:45023/ using document root <none> and password file <none>
I20260709 12:27:37.544929 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:37.545159 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:37.545240 24179 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37848
I20260709 12:27:37.545439 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:37.546916 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "30d28b65e113465aae478c97481ba3cc"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.551163 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:37.554363 24318 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.555150 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:37.555507 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "30d28b65e113465aae478c97481ba3cc"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.555873 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:37.585408 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:37.586619 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:37.588071 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:37.590265 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:37.590502 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.590744 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:37.590914 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.629891 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:44703
I20260709 12:27:37.629989 24380 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:44703 every 8 connection(s)
I20260709 12:27:37.634689 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:37.642082 24384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.643702 24385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.647599 14649 server_base.cc:1061] running on GCE node
W20260709 12:27:37.648169 24387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.648512 24381 heartbeater.cc:344] Connected to a master server at 127.14.78.126:46199
I20260709 12:27:37.649004 24381 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:37.649329 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:37.649619 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:37.649801 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600057649784 us; error 0 us; skew 500 ppm
I20260709 12:27:37.649947 24381 heartbeater.cc:507] Master 127.14.78.126:46199 requested a full tablet report, sending...
I20260709 12:27:37.650476 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:37.652077 24179 ts_manager.cc:194] Registered new tserver with Master: 30d28b65e113465aae478c97481ba3cc (127.14.78.66:44703)
I20260709 12:27:37.653288 14649 webserver.cc:533] Webserver started at http://127.14.78.67:38175/ using document root <none> and password file <none>
I20260709 12:27:37.653764 24179 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37864
I20260709 12:27:37.653864 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:37.654241 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:37.654507 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:37.655894 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "517ddd5d05604568be015e7a51961b94"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.660219 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:37.663425 24392 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.664098 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:27:37.664407 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "517ddd5d05604568be015e7a51961b94"
format_stamp: "Formatted at 2026-07-09 12:27:37 on dist-test-slave-vrh7"
I20260709 12:27:37.664693 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:37.693097 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:37.694226 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:37.695667 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:37.697826 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:37.698047 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.698293 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:37.698467 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.736603 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:39433
I20260709 12:27:37.736706 24454 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:39433 every 8 connection(s)
I20260709 12:27:37.750427 24455 heartbeater.cc:344] Connected to a master server at 127.14.78.126:46199
I20260709 12:27:37.750898 24455 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:37.751624 24455 heartbeater.cc:507] Master 127.14.78.126:46199 requested a full tablet report, sending...
I20260709 12:27:37.753721 24179 ts_manager.cc:194] Registered new tserver with Master: 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:37.754601 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014793985s
I20260709 12:27:37.755347 24179 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37880
I20260709 12:27:37.779431 24179 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37892:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:37.781726 24179 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:37.826627 24271 tablet_service.cc:1511] Processing CreateTablet for tablet 07ba33de01ae418ea8c00f44a0360bed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0a9bde0581be4741a1ea0a879c4c0a78]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:37.827837 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ba33de01ae418ea8c00f44a0360bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.829770 24420 tablet_service.cc:1511] Processing CreateTablet for tablet 07ba33de01ae418ea8c00f44a0360bed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0a9bde0581be4741a1ea0a879c4c0a78]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:37.830086 24419 tablet_service.cc:1511] Processing CreateTablet for tablet 65886b8ea24e4f918d9304b72a4b0fcd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0a9bde0581be4741a1ea0a879c4c0a78]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:37.831144 24420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ba33de01ae418ea8c00f44a0360bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.831804 24419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65886b8ea24e4f918d9304b72a4b0fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.834641 24270 tablet_service.cc:1511] Processing CreateTablet for tablet 65886b8ea24e4f918d9304b72a4b0fcd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0a9bde0581be4741a1ea0a879c4c0a78]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:37.835593 24270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65886b8ea24e4f918d9304b72a4b0fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.838901 24346 tablet_service.cc:1511] Processing CreateTablet for tablet 07ba33de01ae418ea8c00f44a0360bed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0a9bde0581be4741a1ea0a879c4c0a78]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:37.839747 24345 tablet_service.cc:1511] Processing CreateTablet for tablet 65886b8ea24e4f918d9304b72a4b0fcd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0a9bde0581be4741a1ea0a879c4c0a78]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:37.840265 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ba33de01ae418ea8c00f44a0360bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.841070 24345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65886b8ea24e4f918d9304b72a4b0fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:37.869217 24471 tablet_bootstrap.cc:492] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: Bootstrap starting.
I20260709 12:27:37.875928 24470 tablet_bootstrap.cc:492] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94: Bootstrap starting.
I20260709 12:27:37.876987 24472 tablet_bootstrap.cc:492] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc: Bootstrap starting.
I20260709 12:27:37.877027 24471 tablet_bootstrap.cc:654] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.881722 24471 tablet_bootstrap.cc:492] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: No bootstrap required, opened a new log
I20260709 12:27:37.882130 24471 ts_tablet_manager.cc:1403] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:27:37.883136 24470 tablet_bootstrap.cc:654] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.884413 24472 tablet_bootstrap.cc:654] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.884524 24471 raft_consensus.cc:359] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:37.885463 24471 raft_consensus.cc:385] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.885769 24471 raft_consensus.cc:740] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.886546 24471 consensus_queue.cc:260] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:37.888712 24470 tablet_bootstrap.cc:492] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94: No bootstrap required, opened a new log
I20260709 12:27:37.888983 24381 heartbeater.cc:499] Master 127.14.78.126:46199 was elected leader, sending a full tablet report...
I20260709 12:27:37.889218 24470 ts_tablet_manager.cc:1403] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:27:37.889496 24471 ts_tablet_manager.cc:1434] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:37.890506 24471 tablet_bootstrap.cc:492] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc: Bootstrap starting.
I20260709 12:27:37.893008 24470 raft_consensus.cc:359] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:37.894127 24470 raft_consensus.cc:385] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.894608 24470 raft_consensus.cc:740] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517ddd5d05604568be015e7a51961b94, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.895744 24470 consensus_queue.cc:260] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:37.897136 24471 tablet_bootstrap.cc:654] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.903178 24472 tablet_bootstrap.cc:492] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc: No bootstrap required, opened a new log
I20260709 12:27:37.903652 24472 ts_tablet_manager.cc:1403] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 12:27:37.905308 24455 heartbeater.cc:499] Master 127.14.78.126:46199 was elected leader, sending a full tablet report...
I20260709 12:27:37.905678 24471 tablet_bootstrap.cc:492] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc: No bootstrap required, opened a new log
I20260709 12:27:37.905936 24470 ts_tablet_manager.cc:1434] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:27:37.906251 24471 ts_tablet_manager.cc:1403] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:27:37.907049 24470 tablet_bootstrap.cc:492] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94: Bootstrap starting.
I20260709 12:27:37.906651 24472 raft_consensus.cc:359] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:37.907688 24472 raft_consensus.cc:385] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.908037 24472 raft_consensus.cc:740] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.908984 24472 consensus_queue.cc:260] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:37.909641 24471 raft_consensus.cc:359] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:37.910528 24471 raft_consensus.cc:385] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.910873 24471 raft_consensus.cc:740] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.911831 24471 consensus_queue.cc:260] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:37.913950 24471 ts_tablet_manager.cc:1434] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:37.918351 24472 ts_tablet_manager.cc:1434] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc: Time spent starting tablet: real 0.014s	user 0.015s	sys 0.000s
I20260709 12:27:37.919543 24472 tablet_bootstrap.cc:492] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: Bootstrap starting.
I20260709 12:27:37.920138 24306 heartbeater.cc:499] Master 127.14.78.126:46199 was elected leader, sending a full tablet report...
I20260709 12:27:37.915517 24470 tablet_bootstrap.cc:654] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.926316 24472 tablet_bootstrap.cc:654] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:37.931807 24472 tablet_bootstrap.cc:492] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: No bootstrap required, opened a new log
I20260709 12:27:37.932204 24470 tablet_bootstrap.cc:492] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94: No bootstrap required, opened a new log
I20260709 12:27:37.932217 24472 ts_tablet_manager.cc:1403] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.010s
I20260709 12:27:37.932722 24470 ts_tablet_manager.cc:1403] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.015s
I20260709 12:27:37.934844 24472 raft_consensus.cc:359] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:37.935024 24470 raft_consensus.cc:359] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:37.935374 24472 raft_consensus.cc:385] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.935681 24470 raft_consensus.cc:385] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:37.935788 24472 raft_consensus.cc:740] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.936043 24470 raft_consensus.cc:740] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517ddd5d05604568be015e7a51961b94, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.936583 24472 consensus_queue.cc:260] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:37.936774 24470 consensus_queue.cc:260] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:37.938426 24472 ts_tablet_manager.cc:1434] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:27:37.938879 24470 ts_tablet_manager.cc:1434] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:38.076992 24475 raft_consensus.cc:493] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.077579 24475 raft_consensus.cc:515] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:38.079582 24475 leader_election.cc:290] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.089145 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3facdf10800b4805be53e3abc4ae5abc" is_pre_election: true
I20260709 12:27:38.089970 24281 raft_consensus.cc:2468] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 0.
I20260709 12:27:38.090365 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94" is_pre_election: true
I20260709 12:27:38.091075 24430 raft_consensus.cc:2468] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 0.
I20260709 12:27:38.091087 24322 leader_election.cc:304] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 3facdf10800b4805be53e3abc4ae5abc; no voters: 
I20260709 12:27:38.091988 24475 raft_consensus.cc:2804] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:38.092340 24475 raft_consensus.cc:493] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.092636 24475 raft_consensus.cc:3060] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.097551 24475 raft_consensus.cc:515] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:38.099035 24475 leader_election.cc:290] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 election: Requested vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.099790 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
I20260709 12:27:38.099949 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94"
I20260709 12:27:38.100304 24281 raft_consensus.cc:3060] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.100508 24430 raft_consensus.cc:3060] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.105742 24281 raft_consensus.cc:2468] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 1.
I20260709 12:27:38.105760 24430 raft_consensus.cc:2468] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 1.
I20260709 12:27:38.106803 24322 leader_election.cc:304] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 3facdf10800b4805be53e3abc4ae5abc; no voters: 
I20260709 12:27:38.107492 24475 raft_consensus.cc:2804] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:38.108381 24475 raft_consensus.cc:697] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Becoming Leader. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Running, Role: LEADER
I20260709 12:27:38.109066 24475 consensus_queue.cc:237] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:38.115231 24179 catalog_manager.cc:5697] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d28b65e113465aae478c97481ba3cc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "30d28b65e113465aae478c97481ba3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:38.323276 24475 raft_consensus.cc:493] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.323835 24475 raft_consensus.cc:515] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.325664 24475 leader_election.cc:290] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.326471 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65886b8ea24e4f918d9304b72a4b0fcd" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3facdf10800b4805be53e3abc4ae5abc" is_pre_election: true
I20260709 12:27:38.326723 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65886b8ea24e4f918d9304b72a4b0fcd" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94" is_pre_election: true
I20260709 12:27:38.327070 24281 raft_consensus.cc:2468] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 0.
I20260709 12:27:38.327350 24430 raft_consensus.cc:2468] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 0.
I20260709 12:27:38.328076 24322 leader_election.cc:304] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 3facdf10800b4805be53e3abc4ae5abc; no voters: 
I20260709 12:27:38.328920 24475 raft_consensus.cc:2804] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:38.329326 24475 raft_consensus.cc:493] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.329603 24475 raft_consensus.cc:3060] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.334507 24475 raft_consensus.cc:515] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.336084 24475 leader_election.cc:290] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 election: Requested vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.336823 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65886b8ea24e4f918d9304b72a4b0fcd" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
I20260709 12:27:38.337196 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65886b8ea24e4f918d9304b72a4b0fcd" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94"
I20260709 12:27:38.337404 24281 raft_consensus.cc:3060] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.337807 24430 raft_consensus.cc:3060] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.342193 24281 raft_consensus.cc:2468] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 1.
I20260709 12:27:38.342482 24430 raft_consensus.cc:2468] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 1.
I20260709 12:27:38.343183 24322 leader_election.cc:304] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 3facdf10800b4805be53e3abc4ae5abc; no voters: 
I20260709 12:27:38.343925 24475 raft_consensus.cc:2804] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:38.344409 24475 raft_consensus.cc:697] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Becoming Leader. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Running, Role: LEADER
I20260709 12:27:38.345180 24475 consensus_queue.cc:237] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
W20260709 12:27:38.350865 24227 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:38.351758 24179 catalog_manager.cc:5697] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d28b65e113465aae478c97481ba3cc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "30d28b65e113465aae478c97481ba3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:38.421599 24179 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37896:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:38.423596 24179 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:38.446740 24270 tablet_service.cc:1511] Processing CreateTablet for tablet 81309f70e35949d395779337289720c5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8557b128f81747eca110109bde8f09bb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:38.448002 24270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81309f70e35949d395779337289720c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:38.447829 24345 tablet_service.cc:1511] Processing CreateTablet for tablet 81309f70e35949d395779337289720c5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8557b128f81747eca110109bde8f09bb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:38.449008 24345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81309f70e35949d395779337289720c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:38.453420 24346 tablet_service.cc:1511] Processing CreateTablet for tablet a465eb48557a43cbac40f9a227a02a7b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8557b128f81747eca110109bde8f09bb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:38.453460 24419 tablet_service.cc:1511] Processing CreateTablet for tablet a465eb48557a43cbac40f9a227a02a7b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8557b128f81747eca110109bde8f09bb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:38.454741 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465eb48557a43cbac40f9a227a02a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:38.454488 24420 tablet_service.cc:1511] Processing CreateTablet for tablet 81309f70e35949d395779337289720c5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8557b128f81747eca110109bde8f09bb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:38.454926 24419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465eb48557a43cbac40f9a227a02a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:38.455755 24420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81309f70e35949d395779337289720c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:38.458626 24271 tablet_service.cc:1511] Processing CreateTablet for tablet a465eb48557a43cbac40f9a227a02a7b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8557b128f81747eca110109bde8f09bb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:38.459822 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465eb48557a43cbac40f9a227a02a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:38.477339 24492 tablet_bootstrap.cc:492] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: Bootstrap starting.
I20260709 12:27:38.478192 24493 tablet_bootstrap.cc:492] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94: Bootstrap starting.
I20260709 12:27:38.484542 24492 tablet_bootstrap.cc:654] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:38.485136 24493 tablet_bootstrap.cc:654] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:38.497812 24494 tablet_bootstrap.cc:492] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: Bootstrap starting.
I20260709 12:27:38.499730 24492 tablet_bootstrap.cc:492] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: No bootstrap required, opened a new log
I20260709 12:27:38.500166 24493 tablet_bootstrap.cc:492] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94: No bootstrap required, opened a new log
I20260709 12:27:38.500198 24492 ts_tablet_manager.cc:1403] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 12:27:38.500860 24493 ts_tablet_manager.cc:1403] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 12:27:38.502981 24492 raft_consensus.cc:359] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.503559 24492 raft_consensus.cc:385] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:38.503801 24492 raft_consensus.cc:740] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.504154 24493 raft_consensus.cc:359] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.504464 24492 consensus_queue.cc:260] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.504958 24493 raft_consensus.cc:385] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:38.505527 24493 raft_consensus.cc:740] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517ddd5d05604568be015e7a51961b94, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.506737 24492 ts_tablet_manager.cc:1434] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:27:38.506413 24493 consensus_queue.cc:260] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.504891 24494 tablet_bootstrap.cc:654] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:38.509405 24483 consensus_queue.cc:1048] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:38.509892 24493 ts_tablet_manager.cc:1434] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:27:38.519032 24493 tablet_bootstrap.cc:492] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: Bootstrap starting.
I20260709 12:27:38.521235 24494 tablet_bootstrap.cc:492] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: No bootstrap required, opened a new log
I20260709 12:27:38.521756 24494 ts_tablet_manager.cc:1403] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 12:27:38.522433 24492 tablet_bootstrap.cc:492] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc: Bootstrap starting.
I20260709 12:27:38.524794 24494 raft_consensus.cc:359] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.525511 24494 raft_consensus.cc:385] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:38.525812 24494 raft_consensus.cc:740] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.526754 24494 consensus_queue.cc:260] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.530361 24492 tablet_bootstrap.cc:654] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:38.533913 24493 tablet_bootstrap.cc:654] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:38.538813 24494 ts_tablet_manager.cc:1434] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 12:27:38.540169 24494 tablet_bootstrap.cc:492] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc: Bootstrap starting.
I20260709 12:27:38.545953 24493 tablet_bootstrap.cc:492] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: No bootstrap required, opened a new log
I20260709 12:27:38.546499 24493 ts_tablet_manager.cc:1403] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.010s
I20260709 12:27:38.549762 24493 raft_consensus.cc:359] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.553442 24493 raft_consensus.cc:385] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:38.554849 24493 raft_consensus.cc:740] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517ddd5d05604568be015e7a51961b94, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.555899 24493 consensus_queue.cc:260] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.557747 24494 tablet_bootstrap.cc:654] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:38.558262 24493 ts_tablet_manager.cc:1434] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:38.558311 24475 consensus_queue.cc:1048] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:38.563407 24492 tablet_bootstrap.cc:492] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc: No bootstrap required, opened a new log
I20260709 12:27:38.563923 24492 ts_tablet_manager.cc:1403] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.017s
I20260709 12:27:38.566959 24492 raft_consensus.cc:359] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.567644 24492 raft_consensus.cc:385] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:38.567957 24492 raft_consensus.cc:740] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.570050 24494 tablet_bootstrap.cc:492] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc: No bootstrap required, opened a new log
I20260709 12:27:38.570583 24494 ts_tablet_manager.cc:1403] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.011s
I20260709 12:27:38.573635 24494 raft_consensus.cc:359] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.574349 24494 raft_consensus.cc:385] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:38.568756 24492 consensus_queue.cc:260] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.574680 24494 raft_consensus.cc:740] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.575814 24494 consensus_queue.cc:260] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.576602 24475 raft_consensus.cc:493] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.576840 24492 ts_tablet_manager.cc:1434] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:38.577143 24475 raft_consensus.cc:515] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.578982 24494 ts_tablet_manager.cc:1434] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:27:38.580690 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3facdf10800b4805be53e3abc4ae5abc" is_pre_election: true
I20260709 12:27:38.581420 24280 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 0.
I20260709 12:27:38.583069 24322 leader_election.cc:304] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 3facdf10800b4805be53e3abc4ae5abc; no voters: 
I20260709 12:27:38.583922 24483 raft_consensus.cc:2804] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:38.584278 24483 raft_consensus.cc:493] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.584599 24483 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.581446 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94" is_pre_election: true
I20260709 12:27:38.585850 24430 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 0.
I20260709 12:27:38.579370 24475 leader_election.cc:290] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.595515 24483 raft_consensus.cc:515] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.597857 24483 leader_election.cc:290] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 election: Requested vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.598098 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
I20260709 12:27:38.598433 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "30d28b65e113465aae478c97481ba3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94"
I20260709 12:27:38.598783 24281 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.599025 24430 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.604379 24430 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 1.
I20260709 12:27:38.604504 24281 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d28b65e113465aae478c97481ba3cc in term 1.
I20260709 12:27:38.605346 24319 leader_election.cc:304] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 517ddd5d05604568be015e7a51961b94; no voters: 
I20260709 12:27:38.606021 24483 raft_consensus.cc:2804] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:38.606451 24483 raft_consensus.cc:697] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Becoming Leader. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Running, Role: LEADER
I20260709 12:27:38.607189 24483 consensus_queue.cc:237] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.613858 24179 catalog_manager.cc:5697] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d28b65e113465aae478c97481ba3cc (127.14.78.66). New cstate: current_term: 1 leader_uuid: "30d28b65e113465aae478c97481ba3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:38.845503 24500 raft_consensus.cc:493] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.846024 24500 raft_consensus.cc:515] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.847942 24500 leader_election.cc:290] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30d28b65e113465aae478c97481ba3cc (127.14.78.66:44703), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.859488 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465eb48557a43cbac40f9a227a02a7b" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d28b65e113465aae478c97481ba3cc" is_pre_election: true
I20260709 12:27:38.860203 24356 raft_consensus.cc:2468] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 0.
I20260709 12:27:38.861378 24244 leader_election.cc:304] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d28b65e113465aae478c97481ba3cc, 3facdf10800b4805be53e3abc4ae5abc; no voters: 
I20260709 12:27:38.862064 24500 raft_consensus.cc:2804] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:38.861999 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465eb48557a43cbac40f9a227a02a7b" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94" is_pre_election: true
I20260709 12:27:38.862507 24500 raft_consensus.cc:493] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.862684 24430 raft_consensus.cc:2468] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 0.
I20260709 12:27:38.862828 24500 raft_consensus.cc:3060] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.868376 24500 raft_consensus.cc:515] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.870028 24500 leader_election.cc:290] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 1 election: Requested vote from peers 30d28b65e113465aae478c97481ba3cc (127.14.78.66:44703), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:38.870667 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465eb48557a43cbac40f9a227a02a7b" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d28b65e113465aae478c97481ba3cc"
I20260709 12:27:38.870893 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465eb48557a43cbac40f9a227a02a7b" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517ddd5d05604568be015e7a51961b94"
I20260709 12:27:38.871176 24356 raft_consensus.cc:3060] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.871472 24430 raft_consensus.cc:3060] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:38.876355 24356 raft_consensus.cc:2468] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 1.
I20260709 12:27:38.876389 24430 raft_consensus.cc:2468] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 1.
I20260709 12:27:38.877676 24244 leader_election.cc:304] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3facdf10800b4805be53e3abc4ae5abc, 517ddd5d05604568be015e7a51961b94; no voters: 
I20260709 12:27:38.878288 24500 raft_consensus.cc:2804] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:38.878760 24500 raft_consensus.cc:697] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 1 LEADER]: Becoming Leader. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Running, Role: LEADER
I20260709 12:27:38.879532 24500 consensus_queue.cc:237] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:38.885999 24179 catalog_manager.cc:5697] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65). New cstate: current_term: 1 leader_uuid: "3facdf10800b4805be53e3abc4ae5abc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:38.919588 24483 consensus_queue.cc:1048] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:38.920730 24509 consensus_queue.cc:1048] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:38.957355 24356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed"
dest_uuid: "30d28b65e113465aae478c97481ba3cc"
mode: GRACEFUL
new_leader_uuid: "3facdf10800b4805be53e3abc4ae5abc"
 from {username='slave'} at 127.0.0.1:56780
I20260709 12:27:38.957983 24356 raft_consensus.cc:606] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Received request to transfer leadership to TS 3facdf10800b4805be53e3abc4ae5abc
I20260709 12:27:38.965387 24356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81309f70e35949d395779337289720c5"
dest_uuid: "30d28b65e113465aae478c97481ba3cc"
mode: GRACEFUL
new_leader_uuid: "3facdf10800b4805be53e3abc4ae5abc"
 from {username='slave'} at 127.0.0.1:56780
I20260709 12:27:38.965855 24356 raft_consensus.cc:606] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Received request to transfer leadership to TS 3facdf10800b4805be53e3abc4ae5abc
I20260709 12:27:39.015384 24509 consensus_queue.cc:1048] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:39.024021 24475 raft_consensus.cc:993] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: : Instructing follower 3facdf10800b4805be53e3abc4ae5abc to start an election
I20260709 12:27:39.024471 24475 raft_consensus.cc:1081] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Signalling peer 3facdf10800b4805be53e3abc4ae5abc to start an election
I20260709 12:27:39.026181 24280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81309f70e35949d395779337289720c5"
dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
 from {username='slave'} at 127.0.0.1:38866
I20260709 12:27:39.026721 24280 raft_consensus.cc:493] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:39.027143 24280 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.030153 24475 consensus_queue.cc:1048] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:39.037588 24280 raft_consensus.cc:515] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:39.038900 24281 raft_consensus.cc:1240] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Rejecting Update request from peer 30d28b65e113465aae478c97481ba3cc for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:39.040198 24280 leader_election.cc:290] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 2 election: Requested vote from peers 30d28b65e113465aae478c97481ba3cc (127.14.78.66:44703), 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433)
I20260709 12:27:39.041393 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "517ddd5d05604568be015e7a51961b94"
I20260709 12:27:39.041898 24430 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.042258 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d28b65e113465aae478c97481ba3cc"
I20260709 12:27:39.042906 24356 raft_consensus.cc:3055] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:39.043248 24356 raft_consensus.cc:740] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Running, Role: LEADER
I20260709 12:27:39.044147 24356 consensus_queue.cc:260] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:39.044961 24475 consensus_queue.cc:1059] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:39.048561 24356 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.048902 24430 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 2.
I20260709 12:27:39.050241 24244 leader_election.cc:304] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3facdf10800b4805be53e3abc4ae5abc, 517ddd5d05604568be015e7a51961b94; no voters: 
I20260709 12:27:39.050909 24500 raft_consensus.cc:2804] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.051370 24500 raft_consensus.cc:697] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Becoming Leader. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Running, Role: LEADER
I20260709 12:27:39.052150 24500 consensus_queue.cc:237] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:39.057152 24356 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 2.
I20260709 12:27:39.063427 24178 catalog_manager.cc:5697] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc reported cstate change: term changed from 1 to 2, leader changed from 30d28b65e113465aae478c97481ba3cc (127.14.78.66) to 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "3facdf10800b4805be53e3abc4ae5abc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:39.158154 24509 raft_consensus.cc:993] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: : Instructing follower 3facdf10800b4805be53e3abc4ae5abc to start an election
I20260709 12:27:39.158569 24483 raft_consensus.cc:1081] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Signalling peer 3facdf10800b4805be53e3abc4ae5abc to start an election
I20260709 12:27:39.159955 24281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed"
dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
 from {username='slave'} at 127.0.0.1:38866
I20260709 12:27:39.160380 24281 raft_consensus.cc:493] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:39.160626 24281 raft_consensus.cc:3060] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.166184 24281 raft_consensus.cc:515] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:39.167927 24281 leader_election.cc:290] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 2 election: Requested vote from peers 517ddd5d05604568be015e7a51961b94 (127.14.78.67:39433), 30d28b65e113465aae478c97481ba3cc (127.14.78.66:44703)
I20260709 12:27:39.168562 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "517ddd5d05604568be015e7a51961b94"
I20260709 12:27:39.169214 24430 raft_consensus.cc:3060] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.169096 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ba33de01ae418ea8c00f44a0360bed" candidate_uuid: "3facdf10800b4805be53e3abc4ae5abc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d28b65e113465aae478c97481ba3cc"
I20260709 12:27:39.169813 24356 raft_consensus.cc:3055] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:39.170140 24356 raft_consensus.cc:740] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30d28b65e113465aae478c97481ba3cc, State: Running, Role: LEADER
I20260709 12:27:39.170956 24356 consensus_queue.cc:260] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:39.172178 24356 raft_consensus.cc:3060] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.176259 24430 raft_consensus.cc:2468] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 2.
I20260709 12:27:39.177546 24244 leader_election.cc:304] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3facdf10800b4805be53e3abc4ae5abc, 517ddd5d05604568be015e7a51961b94; no voters: 
I20260709 12:27:39.178345 24500 raft_consensus.cc:2804] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.178846 24500 raft_consensus.cc:697] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Becoming Leader. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Running, Role: LEADER
I20260709 12:27:39.178954 24356 raft_consensus.cc:2468] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3facdf10800b4805be53e3abc4ae5abc in term 2.
I20260709 12:27:39.179694 24500 consensus_queue.cc:237] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } }
I20260709 12:27:39.186250 24178 catalog_manager.cc:5697] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc reported cstate change: term changed from 1 to 2, leader changed from 30d28b65e113465aae478c97481ba3cc (127.14.78.66) to 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65). New cstate: current_term: 2 leader_uuid: "3facdf10800b4805be53e3abc4ae5abc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:39.261508 24500 consensus_queue.cc:1048] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:39.271134 14649 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:27:39.272656 24499 consensus_queue.cc:1048] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Connected to new peer: Peer: permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:39.273999 14649 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:27:39.274575 14649 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:27:39.295650 24281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81309f70e35949d395779337289720c5"
dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
mode: GRACEFUL
new_leader_uuid: "517ddd5d05604568be015e7a51961b94"
 from {username='slave'} at 127.0.0.1:38870
I20260709 12:27:39.296156 24281 raft_consensus.cc:606] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Received request to transfer leadership to TS 517ddd5d05604568be015e7a51961b94
I20260709 12:27:39.297289 14649 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:27:39.546133 24430 raft_consensus.cc:1275] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Refusing update from remote peer 3facdf10800b4805be53e3abc4ae5abc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.547446 24522 consensus_queue.cc:1048] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Connected to new peer: Peer: permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:39.552201 24499 raft_consensus.cc:993] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: : Instructing follower 517ddd5d05604568be015e7a51961b94 to start an election
I20260709 12:27:39.552639 24500 raft_consensus.cc:1081] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Signalling peer 517ddd5d05604568be015e7a51961b94 to start an election
I20260709 12:27:39.554345 24429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81309f70e35949d395779337289720c5"
dest_uuid: "517ddd5d05604568be015e7a51961b94"
 from {username='slave'} at 127.0.0.1:33672
I20260709 12:27:39.554976 24429 raft_consensus.cc:493] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:39.555337 24429 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.558787 24356 raft_consensus.cc:1275] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 2 FOLLOWER]: Refusing update from remote peer 3facdf10800b4805be53e3abc4ae5abc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.560271 24500 consensus_queue.cc:1048] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:39.563030 24429 raft_consensus.cc:515] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:39.576975 24429 leader_election.cc:290] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [CANDIDATE]: Term 3 election: Requested vote from peers 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65:45503), 30d28b65e113465aae478c97481ba3cc (127.14.78.66:44703)
I20260709 12:27:39.579362 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "517ddd5d05604568be015e7a51961b94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3facdf10800b4805be53e3abc4ae5abc"
I20260709 12:27:39.580076 24281 raft_consensus.cc:3055] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:39.580384 24281 raft_consensus.cc:740] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3facdf10800b4805be53e3abc4ae5abc, State: Running, Role: LEADER
I20260709 12:27:39.581218 24281 consensus_queue.cc:260] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:39.582473 24281 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.588593 24281 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517ddd5d05604568be015e7a51961b94 in term 3.
I20260709 12:27:39.589639 24396 leader_election.cc:304] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3facdf10800b4805be53e3abc4ae5abc, 517ddd5d05604568be015e7a51961b94; no voters: 
I20260709 12:27:39.590071 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81309f70e35949d395779337289720c5" candidate_uuid: "517ddd5d05604568be015e7a51961b94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30d28b65e113465aae478c97481ba3cc"
I20260709 12:27:39.590341 24497 raft_consensus.cc:2804] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:39.590608 24356 raft_consensus.cc:3060] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.591612 24497 raft_consensus.cc:697] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 3 LEADER]: Becoming Leader. State: Replica: 517ddd5d05604568be015e7a51961b94, State: Running, Role: LEADER
I20260709 12:27:39.592366 24497 consensus_queue.cc:237] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } }
I20260709 12:27:39.596203 24356 raft_consensus.cc:2468] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517ddd5d05604568be015e7a51961b94 in term 3.
I20260709 12:27:39.597766 24179 catalog_manager.cc:5697] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 reported cstate change: term changed from 2 to 3, leader changed from 3facdf10800b4805be53e3abc4ae5abc (127.14.78.65) to 517ddd5d05604568be015e7a51961b94 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "517ddd5d05604568be015e7a51961b94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3facdf10800b4805be53e3abc4ae5abc" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 45503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d28b65e113465aae478c97481ba3cc" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517ddd5d05604568be015e7a51961b94" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 39433 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:39.641525 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
I20260709 12:27:39.660570 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:39.661227 14649 tablet_replica.cc:333] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc: stopping tablet replica
I20260709 12:27:39.661800 14649 raft_consensus.cc:2243] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.662606 14649 raft_consensus.cc:2272] T a465eb48557a43cbac40f9a227a02a7b P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.664625 14649 tablet_replica.cc:333] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc: stopping tablet replica
I20260709 12:27:39.665208 14649 raft_consensus.cc:2243] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.665618 14649 raft_consensus.cc:2272] T 81309f70e35949d395779337289720c5 P 3facdf10800b4805be53e3abc4ae5abc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.667728 14649 tablet_replica.cc:333] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: stopping tablet replica
I20260709 12:27:39.668222 14649 raft_consensus.cc:2243] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.668785 14649 pending_rounds.cc:70] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: Trying to abort 1 pending ops.
I20260709 12:27:39.668967 14649 pending_rounds.cc:77] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625842408947712 op_type: NO_OP noop_request { }
I20260709 12:27:39.669313 14649 raft_consensus.cc:2889] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:39.669589 14649 raft_consensus.cc:2272] T 07ba33de01ae418ea8c00f44a0360bed P 3facdf10800b4805be53e3abc4ae5abc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.671679 14649 tablet_replica.cc:333] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc: stopping tablet replica
I20260709 12:27:39.672155 14649 raft_consensus.cc:2243] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.672542 14649 raft_consensus.cc:2272] T 65886b8ea24e4f918d9304b72a4b0fcd P 3facdf10800b4805be53e3abc4ae5abc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.694401 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
I20260709 12:27:39.705977 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
I20260709 12:27:39.722632 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:39.723209 14649 tablet_replica.cc:333] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc: stopping tablet replica
I20260709 12:27:39.723706 14649 raft_consensus.cc:2243] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.724086 14649 raft_consensus.cc:2272] T a465eb48557a43cbac40f9a227a02a7b P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.726315 14649 tablet_replica.cc:333] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc: stopping tablet replica
I20260709 12:27:39.726780 14649 raft_consensus.cc:2243] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.727134 14649 raft_consensus.cc:2272] T 81309f70e35949d395779337289720c5 P 30d28b65e113465aae478c97481ba3cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.728977 14649 tablet_replica.cc:333] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc: stopping tablet replica
I20260709 12:27:39.729477 14649 raft_consensus.cc:2243] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.730144 14649 raft_consensus.cc:2272] T 65886b8ea24e4f918d9304b72a4b0fcd P 30d28b65e113465aae478c97481ba3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.731963 14649 tablet_replica.cc:333] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc: stopping tablet replica
I20260709 12:27:39.732366 14649 raft_consensus.cc:2243] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.732671 14649 raft_consensus.cc:2272] T 07ba33de01ae418ea8c00f44a0360bed P 30d28b65e113465aae478c97481ba3cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.753865 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
I20260709 12:27:39.765403 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
I20260709 12:27:39.783608 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:39.784134 14649 tablet_replica.cc:333] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: stopping tablet replica
I20260709 12:27:39.784617 14649 raft_consensus.cc:2243] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.785275 14649 pending_rounds.cc:70] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: Trying to abort 1 pending ops.
I20260709 12:27:39.785439 14649 pending_rounds.cc:77] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625844097687552 op_type: NO_OP noop_request { }
I20260709 12:27:39.785656 14649 raft_consensus.cc:2889] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:39.785882 14649 raft_consensus.cc:2272] T 81309f70e35949d395779337289720c5 P 517ddd5d05604568be015e7a51961b94 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.787916 14649 tablet_replica.cc:333] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94: stopping tablet replica
I20260709 12:27:39.788370 14649 raft_consensus.cc:2243] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.788710 14649 raft_consensus.cc:2272] T a465eb48557a43cbac40f9a227a02a7b P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.791102 14649 tablet_replica.cc:333] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94: stopping tablet replica
I20260709 12:27:39.791544 14649 raft_consensus.cc:2243] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.791884 14649 raft_consensus.cc:2272] T 65886b8ea24e4f918d9304b72a4b0fcd P 517ddd5d05604568be015e7a51961b94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.794056 14649 tablet_replica.cc:333] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94: stopping tablet replica
I20260709 12:27:39.794461 14649 raft_consensus.cc:2243] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:39.794800 14649 raft_consensus.cc:2272] T 07ba33de01ae418ea8c00f44a0360bed P 517ddd5d05604568be015e7a51961b94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.815836 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
I20260709 12:27:39.827442 14649 master.cc:562] Master@127.14.78.126:46199 shutting down...
I20260709 12:27:39.841598 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:39.842136 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:39.842463 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4d309e7087fb4b5d83970e30768c6b06: stopping tablet replica
I20260709 12:27:39.860423 14649 master.cc:584] Master@127.14.78.126:46199 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2655 ms)
[----------] 6 tests from LeaderRebalancerTest (313187 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:27:39.886732 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:37197
I20260709 12:27:39.887861 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:39.892493 24530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:39.893962 24531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:39.894150 24533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:39.894829 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:39.895643 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:39.895812 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:39.895991 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600059895978 us; error 0 us; skew 500 ppm
I20260709 12:27:39.896570 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:39.898703 14649 webserver.cc:533] Webserver started at http://127.14.78.126:40473/ using document root <none> and password file <none>
I20260709 12:27:39.899170 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:39.899360 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:39.899638 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:39.900645 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "f3f0241de12a4ca0a057657530656881"
format_stamp: "Formatted at 2026-07-09 12:27:39 on dist-test-slave-vrh7"
I20260709 12:27:39.904960 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:27:39.908108 24538 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:39.908838 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:39.909138 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "f3f0241de12a4ca0a057657530656881"
format_stamp: "Formatted at 2026-07-09 12:27:39 on dist-test-slave-vrh7"
I20260709 12:27:39.909436 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:39.929410 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:39.930408 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:39.964614 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:37197
I20260709 12:27:39.964725 24589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:37197 every 8 connection(s)
I20260709 12:27:39.968204 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:39.978253 24590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881: Bootstrap starting.
I20260709 12:27:39.982463 24590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:39.986153 24590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881: No bootstrap required, opened a new log
I20260709 12:27:39.988090 24590 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f0241de12a4ca0a057657530656881" member_type: VOTER }
I20260709 12:27:39.988469 24590 raft_consensus.cc:385] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:39.988699 24590 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3f0241de12a4ca0a057657530656881, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.989269 24590 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f0241de12a4ca0a057657530656881" member_type: VOTER }
I20260709 12:27:39.989712 24590 raft_consensus.cc:399] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:39.989943 24590 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:39.990197 24590 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:39.994369 24590 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f0241de12a4ca0a057657530656881" member_type: VOTER }
I20260709 12:27:39.994853 24590 leader_election.cc:304] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3f0241de12a4ca0a057657530656881; no voters: 
I20260709 12:27:39.995913 24590 leader_election.cc:290] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:39.996220 24593 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:39.997536 24593 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 1 LEADER]: Becoming Leader. State: Replica: f3f0241de12a4ca0a057657530656881, State: Running, Role: LEADER
I20260709 12:27:39.998162 24593 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f0241de12a4ca0a057657530656881" member_type: VOTER }
I20260709 12:27:39.998775 24590 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:40.001077 24594 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3f0241de12a4ca0a057657530656881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f0241de12a4ca0a057657530656881" member_type: VOTER } }
I20260709 12:27:40.001160 24595 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3f0241de12a4ca0a057657530656881. Latest consensus state: current_term: 1 leader_uuid: "f3f0241de12a4ca0a057657530656881" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f0241de12a4ca0a057657530656881" member_type: VOTER } }
I20260709 12:27:40.001899 24594 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:40.001909 24595 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:40.005416 24600 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:40.009950 24600 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:40.013115 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:40.018071 24600 catalog_manager.cc:1383] Generated new cluster ID: c2fa49d743604590a7d626faa1278d39
I20260709 12:27:40.018342 24600 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:40.049502 24600 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:40.050746 24600 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:40.065539 24600 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881: Generated new TSK 0
I20260709 12:27:40.066094 24600 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:40.079260 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:40.084573 24611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:40.085822 24612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:40.087581 24614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:40.087623 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:40.088773 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:40.088991 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:40.089221 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600060089202 us; error 0 us; skew 500 ppm
I20260709 12:27:40.089758 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:40.091913 14649 webserver.cc:533] Webserver started at http://127.14.78.65:42499/ using document root <none> and password file <none>
I20260709 12:27:40.092391 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:40.092585 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:40.092864 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:40.093937 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "8d3390139ca74e6692e72ce6decd8a35"
format_stamp: "Formatted at 2026-07-09 12:27:40 on dist-test-slave-vrh7"
I20260709 12:27:40.098102 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:40.101472 24619 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.102181 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:40.102461 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "8d3390139ca74e6692e72ce6decd8a35"
format_stamp: "Formatted at 2026-07-09 12:27:40 on dist-test-slave-vrh7"
I20260709 12:27:40.102731 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:40.117871 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:40.118886 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:40.120196 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:40.122339 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:40.122505 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.122803 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:40.122958 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.159299 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:43621
I20260709 12:27:40.159405 24681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:43621 every 8 connection(s)
I20260709 12:27:40.164247 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:40.170655 24686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:40.171453 24687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:40.176134 24689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:40.176287 14649 server_base.cc:1061] running on GCE node
I20260709 12:27:40.177212 24682 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37197
I20260709 12:27:40.177654 24682 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:40.178154 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:40.178450 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:40.178505 24682 heartbeater.cc:507] Master 127.14.78.126:37197 requested a full tablet report, sending...
I20260709 12:27:40.178716 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600060178697 us; error 0 us; skew 500 ppm
I20260709 12:27:40.179528 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:40.180809 24555 ts_manager.cc:194] Registered new tserver with Master: 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621)
I20260709 12:27:40.182649 24555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55722
I20260709 12:27:40.185623 14649 webserver.cc:533] Webserver started at http://127.14.78.66:43555/ using document root <none> and password file <none>
I20260709 12:27:40.186424 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:40.186685 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:40.187043 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:40.188114 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "1bff2b69967f4234a5781e7a261c603f"
format_stamp: "Formatted at 2026-07-09 12:27:40 on dist-test-slave-vrh7"
I20260709 12:27:40.192251 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:27:40.195376 24694 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.196090 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:40.196393 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "1bff2b69967f4234a5781e7a261c603f"
format_stamp: "Formatted at 2026-07-09 12:27:40 on dist-test-slave-vrh7"
I20260709 12:27:40.196651 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:40.214743 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:40.215729 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:40.217010 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:40.219112 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:40.219280 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.219551 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:40.219708 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.256040 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:35421
I20260709 12:27:40.256152 24756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:35421 every 8 connection(s)
I20260709 12:27:40.260772 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:40.268317 24760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:40.268801 24761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:40.272100 14649 server_base.cc:1061] running on GCE node
W20260709 12:27:40.272150 24763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:40.273443 24757 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37197
I20260709 12:27:40.273816 24757 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:40.273814 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:40.274271 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:40.274471 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600060274452 us; error 0 us; skew 500 ppm
I20260709 12:27:40.274712 24757 heartbeater.cc:507] Master 127.14.78.126:37197 requested a full tablet report, sending...
I20260709 12:27:40.275182 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:40.276918 24555 ts_manager.cc:194] Registered new tserver with Master: 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:40.277854 14649 webserver.cc:533] Webserver started at http://127.14.78.67:38559/ using document root <none> and password file <none>
I20260709 12:27:40.278434 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:40.278441 24555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55726
I20260709 12:27:40.278743 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:40.279146 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:40.280414 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
format_stamp: "Formatted at 2026-07-09 12:27:40 on dist-test-slave-vrh7"
I20260709 12:27:40.284919 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:27:40.288347 24768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.289215 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:40.289467 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
format_stamp: "Formatted at 2026-07-09 12:27:40 on dist-test-slave-vrh7"
I20260709 12:27:40.289710 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:40.303071 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:40.303958 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:40.305327 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:40.307593 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:40.307806 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.308053 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:40.308220 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:40.345009 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:42639
I20260709 12:27:40.345150 24830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:42639 every 8 connection(s)
I20260709 12:27:40.358108 24831 heartbeater.cc:344] Connected to a master server at 127.14.78.126:37197
I20260709 12:27:40.358568 24831 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:40.359252 24831 heartbeater.cc:507] Master 127.14.78.126:37197 requested a full tablet report, sending...
I20260709 12:27:40.361097 24555 ts_manager.cc:194] Registered new tserver with Master: 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:40.361426 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013206563s
I20260709 12:27:40.362828 24555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55740
I20260709 12:27:40.385573 24555 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55756:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:40.387943 24555 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:40.447896 24796 tablet_service.cc:1511] Processing CreateTablet for tablet d7bc1edf0ab845bd988ff493c1c3d17b (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:40.449319 24796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bc1edf0ab845bd988ff493c1c3d17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.450096 24722 tablet_service.cc:1511] Processing CreateTablet for tablet d7bc1edf0ab845bd988ff493c1c3d17b (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:40.451507 24722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bc1edf0ab845bd988ff493c1c3d17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.453678 24795 tablet_service.cc:1511] Processing CreateTablet for tablet c525668f0eab4ebca90c9be91dff4f7c (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:40.454111 24721 tablet_service.cc:1511] Processing CreateTablet for tablet c525668f0eab4ebca90c9be91dff4f7c (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:40.455061 24795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c525668f0eab4ebca90c9be91dff4f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.455443 24721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c525668f0eab4ebca90c9be91dff4f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.458671 24720 tablet_service.cc:1511] Processing CreateTablet for tablet cc5a1009b07548898666e65ed65e5ac7 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:40.460009 24720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5a1009b07548898666e65ed65e5ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.462553 24794 tablet_service.cc:1511] Processing CreateTablet for tablet cc5a1009b07548898666e65ed65e5ac7 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:40.463887 24794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5a1009b07548898666e65ed65e5ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.464316 24719 tablet_service.cc:1511] Processing CreateTablet for tablet 98bf2205616a4637b919f36f387a4230 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:40.465788 24793 tablet_service.cc:1511] Processing CreateTablet for tablet 98bf2205616a4637b919f36f387a4230 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:40.466107 24718 tablet_service.cc:1511] Processing CreateTablet for tablet fd2e8675e57c4b249478828cfeef93f3 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:40.467119 24793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98bf2205616a4637b919f36f387a4230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.467329 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2e8675e57c4b249478828cfeef93f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.469753 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98bf2205616a4637b919f36f387a4230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.470968 24792 tablet_service.cc:1511] Processing CreateTablet for tablet fd2e8675e57c4b249478828cfeef93f3 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:40.472316 24792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2e8675e57c4b249478828cfeef93f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.474606 24717 tablet_service.cc:1511] Processing CreateTablet for tablet 8edb6eab46c14dab81a81fe18e097266 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:40.474918 24791 tablet_service.cc:1511] Processing CreateTablet for tablet 8edb6eab46c14dab81a81fe18e097266 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:40.475992 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edb6eab46c14dab81a81fe18e097266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.476158 24791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edb6eab46c14dab81a81fe18e097266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.482524 24716 tablet_service.cc:1511] Processing CreateTablet for tablet fb8a7a56ccab41cc92bf800a3bcd4cc3 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:40.483312 24790 tablet_service.cc:1511] Processing CreateTablet for tablet fb8a7a56ccab41cc92bf800a3bcd4cc3 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:40.483898 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8a7a56ccab41cc92bf800a3bcd4cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.484673 24790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8a7a56ccab41cc92bf800a3bcd4cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.490613 24715 tablet_service.cc:1511] Processing CreateTablet for tablet e85c32da046a4f30b9190e15c2fce27f (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:40.492220 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85c32da046a4f30b9190e15c2fce27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.496414 24714 tablet_service.cc:1511] Processing CreateTablet for tablet 20529acf8d714ca39c0e8ce721456d00 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:40.497880 24714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20529acf8d714ca39c0e8ce721456d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.498737 24789 tablet_service.cc:1511] Processing CreateTablet for tablet e85c32da046a4f30b9190e15c2fce27f (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:40.500240 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85c32da046a4f30b9190e15c2fce27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.505134 24788 tablet_service.cc:1511] Processing CreateTablet for tablet 20529acf8d714ca39c0e8ce721456d00 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:40.506960 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20529acf8d714ca39c0e8ce721456d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.541385 24847 tablet_bootstrap.cc:492] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.548116 24847 tablet_bootstrap.cc:654] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.577420 24646 tablet_service.cc:1511] Processing CreateTablet for tablet c525668f0eab4ebca90c9be91dff4f7c (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:40.579305 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c525668f0eab4ebca90c9be91dff4f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.586323 24642 tablet_service.cc:1511] Processing CreateTablet for tablet 8edb6eab46c14dab81a81fe18e097266 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:40.588140 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edb6eab46c14dab81a81fe18e097266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.594434 24645 tablet_service.cc:1511] Processing CreateTablet for tablet cc5a1009b07548898666e65ed65e5ac7 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:40.596210 24645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5a1009b07548898666e65ed65e5ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.598388 24643 tablet_service.cc:1511] Processing CreateTablet for tablet fd2e8675e57c4b249478828cfeef93f3 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:40.600085 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2e8675e57c4b249478828cfeef93f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.606565 24846 tablet_bootstrap.cc:492] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.606770 24641 tablet_service.cc:1511] Processing CreateTablet for tablet fb8a7a56ccab41cc92bf800a3bcd4cc3 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:40.608059 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8a7a56ccab41cc92bf800a3bcd4cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.573927 24647 tablet_service.cc:1511] Processing CreateTablet for tablet d7bc1edf0ab845bd988ff493c1c3d17b (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:40.610534 24647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bc1edf0ab845bd988ff493c1c3d17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.610703 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 20529acf8d714ca39c0e8ce721456d00 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:40.613565 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20529acf8d714ca39c0e8ce721456d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.608475 24640 tablet_service.cc:1511] Processing CreateTablet for tablet e85c32da046a4f30b9190e15c2fce27f (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:40.616137 24640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85c32da046a4f30b9190e15c2fce27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.606237 24644 tablet_service.cc:1511] Processing CreateTablet for tablet 98bf2205616a4637b919f36f387a4230 (DEFAULT_TABLE table=test-workload [id=f3a86075c1ea413086de8692263eed8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:40.619834 24644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98bf2205616a4637b919f36f387a4230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:40.639389 24846 tablet_bootstrap.cc:654] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.645949 24847 tablet_bootstrap.cc:492] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.646714 24847 ts_tablet_manager.cc:1403] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.032s
I20260709 12:27:40.650475 24847 raft_consensus.cc:359] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.651544 24847 raft_consensus.cc:385] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.652112 24847 raft_consensus.cc:740] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.653417 24847 consensus_queue.cc:260] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.659788 24849 tablet_bootstrap.cc:492] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:40.663070 24847 ts_tablet_manager.cc:1434] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:27:40.663903 24831 heartbeater.cc:499] Master 127.14.78.126:37197 was elected leader, sending a full tablet report...
I20260709 12:27:40.667459 24847 tablet_bootstrap.cc:492] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.673398 24847 tablet_bootstrap.cc:654] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.674413 24849 tablet_bootstrap.cc:654] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.680747 24846 tablet_bootstrap.cc:492] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:40.681346 24846 ts_tablet_manager.cc:1403] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.017s
I20260709 12:27:40.684865 24846 raft_consensus.cc:359] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.685609 24846 raft_consensus.cc:385] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.685945 24846 raft_consensus.cc:740] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.686877 24846 consensus_queue.cc:260] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.690169 24847 tablet_bootstrap.cc:492] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.692262 24847 ts_tablet_manager.cc:1403] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 12:27:40.696697 24849 tablet_bootstrap.cc:492] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:40.697288 24849 ts_tablet_manager.cc:1403] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260709 12:27:40.696817 24847 raft_consensus.cc:359] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.699128 24847 raft_consensus.cc:385] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.699427 24847 raft_consensus.cc:740] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.700232 24849 raft_consensus.cc:359] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.700969 24849 raft_consensus.cc:385] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.701287 24849 raft_consensus.cc:740] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.701637 24847 consensus_queue.cc:260] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.702000 24849 consensus_queue.cc:260] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.706605 24847 ts_tablet_manager.cc:1434] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:40.708527 24847 tablet_bootstrap.cc:492] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.716308 24847 tablet_bootstrap.cc:654] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.719214 24682 heartbeater.cc:499] Master 127.14.78.126:37197 was elected leader, sending a full tablet report...
I20260709 12:27:40.719640 24849 ts_tablet_manager.cc:1434] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 12:27:40.719774 24846 ts_tablet_manager.cc:1434] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.017s
I20260709 12:27:40.720445 24757 heartbeater.cc:499] Master 127.14.78.126:37197 was elected leader, sending a full tablet report...
I20260709 12:27:40.720693 24849 tablet_bootstrap.cc:492] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:40.726778 24849 tablet_bootstrap.cc:654] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.729120 24846 tablet_bootstrap.cc:492] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.733804 24847 tablet_bootstrap.cc:492] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.734367 24847 ts_tablet_manager.cc:1403] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 12:27:40.737193 24847 raft_consensus.cc:359] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.737944 24847 raft_consensus.cc:385] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.738281 24847 raft_consensus.cc:740] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.739028 24847 consensus_queue.cc:260] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.740224 24849 tablet_bootstrap.cc:492] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:40.740759 24849 ts_tablet_manager.cc:1403] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:27:40.741380 24847 ts_tablet_manager.cc:1434] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:40.742414 24847 tablet_bootstrap.cc:492] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.743489 24849 raft_consensus.cc:359] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.744272 24849 raft_consensus.cc:385] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.744566 24849 raft_consensus.cc:740] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.745746 24846 tablet_bootstrap.cc:654] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.745585 24849 consensus_queue.cc:260] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.747774 24849 ts_tablet_manager.cc:1434] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:40.748871 24849 tablet_bootstrap.cc:492] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:40.749024 24847 tablet_bootstrap.cc:654] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.757236 24849 tablet_bootstrap.cc:654] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.763724 24846 tablet_bootstrap.cc:492] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:40.764406 24846 ts_tablet_manager.cc:1403] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.017s
I20260709 12:27:40.768160 24846 raft_consensus.cc:359] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.768906 24846 raft_consensus.cc:385] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.769232 24846 raft_consensus.cc:740] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.769994 24846 consensus_queue.cc:260] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.770917 24849 tablet_bootstrap.cc:492] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:40.771414 24849 ts_tablet_manager.cc:1403] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 12:27:40.772429 24846 ts_tablet_manager.cc:1434] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:40.773521 24846 tablet_bootstrap.cc:492] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.774128 24849 raft_consensus.cc:359] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.774868 24849 raft_consensus.cc:385] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.775173 24849 raft_consensus.cc:740] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.776077 24849 consensus_queue.cc:260] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.778198 24849 ts_tablet_manager.cc:1434] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:27:40.781697 24849 tablet_bootstrap.cc:492] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:40.784384 24847 tablet_bootstrap.cc:492] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.784899 24847 ts_tablet_manager.cc:1403] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.017s
I20260709 12:27:40.785175 24846 tablet_bootstrap.cc:654] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.787532 24849 tablet_bootstrap.cc:654] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.787959 24847 raft_consensus.cc:359] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.788980 24847 raft_consensus.cc:385] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.789409 24847 raft_consensus.cc:740] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.790385 24847 consensus_queue.cc:260] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.793653 24847 ts_tablet_manager.cc:1434] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:40.794533 24847 tablet_bootstrap.cc:492] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.796015 24846 tablet_bootstrap.cc:492] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:40.796530 24846 ts_tablet_manager.cc:1403] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.012s
I20260709 12:27:40.799422 24846 raft_consensus.cc:359] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.800185 24846 raft_consensus.cc:385] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.800522 24846 raft_consensus.cc:740] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.800616 24847 tablet_bootstrap.cc:654] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.801329 24846 consensus_queue.cc:260] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.803743 24846 ts_tablet_manager.cc:1434] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:27:40.804913 24846 tablet_bootstrap.cc:492] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.811553 24846 tablet_bootstrap.cc:654] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.812125 24847 tablet_bootstrap.cc:492] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.812647 24847 ts_tablet_manager.cc:1403] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:27:40.818986 24847 raft_consensus.cc:359] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.819913 24847 raft_consensus.cc:385] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.820281 24847 raft_consensus.cc:740] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.821367 24847 consensus_queue.cc:260] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.823674 24847 ts_tablet_manager.cc:1434] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:27:40.824682 24847 tablet_bootstrap.cc:492] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.824752 24846 tablet_bootstrap.cc:492] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:40.825305 24846 ts_tablet_manager.cc:1403] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 12:27:40.828223 24846 raft_consensus.cc:359] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.828956 24846 raft_consensus.cc:385] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.829279 24846 raft_consensus.cc:740] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.830170 24846 consensus_queue.cc:260] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.831653 24847 tablet_bootstrap.cc:654] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.835307 24846 ts_tablet_manager.cc:1434] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:40.836719 24846 tablet_bootstrap.cc:492] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.843390 24847 tablet_bootstrap.cc:492] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.843914 24847 ts_tablet_manager.cc:1403] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:27:40.844149 24846 tablet_bootstrap.cc:654] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.846982 24847 raft_consensus.cc:359] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.847959 24847 raft_consensus.cc:385] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.848322 24847 raft_consensus.cc:740] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.848641 24855 raft_consensus.cc:493] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.849140 24855 raft_consensus.cc:515] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.849280 24847 consensus_queue.cc:260] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.854060 24847 ts_tablet_manager.cc:1434] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 12:27:40.855186 24847 tablet_bootstrap.cc:492] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.859509 24855 leader_election.cc:290] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:40.864549 24851 raft_consensus.cc:493] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.865300 24851 raft_consensus.cc:515] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.866163 24847 tablet_bootstrap.cc:654] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.870229 24851 leader_election.cc:290] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:40.907558 24847 tablet_bootstrap.cc:492] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.908295 24847 ts_tablet_manager.cc:1403] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.025s
I20260709 12:27:40.910844 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:40.911618 24806 raft_consensus.cc:2468] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:40.912053 24846 tablet_bootstrap.cc:492] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:40.911597 24847 raft_consensus.cc:359] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.913103 24621 leader_election.cc:304] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:40.913733 24847 raft_consensus.cc:385] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.914144 24855 raft_consensus.cc:2804] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:40.914762 24855 raft_consensus.cc:493] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.915091 24855 raft_consensus.cc:3060] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:40.914147 24847 raft_consensus.cc:740] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.916246 24847 consensus_queue.cc:260] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.921123 24847 ts_tablet_manager.cc:1434] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:40.922168 24847 tablet_bootstrap.cc:492] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.923061 24855 raft_consensus.cc:515] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.926275 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:40.926882 24806 raft_consensus.cc:3060] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:40.927637 24855 leader_election.cc:290] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:40.912611 24846 ts_tablet_manager.cc:1403] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.011s
I20260709 12:27:40.929598 24847 tablet_bootstrap.cc:654] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.932508 24846 raft_consensus.cc:359] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.933715 24846 raft_consensus.cc:385] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.934325 24846 raft_consensus.cc:740] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.938035 24846 consensus_queue.cc:260] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.944836 24851 raft_consensus.cc:493] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.946116 24846 ts_tablet_manager.cc:1434] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 12:27:40.946334 24851 raft_consensus.cc:515] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:40.948561 24846 tablet_bootstrap.cc:492] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.949182 24849 tablet_bootstrap.cc:492] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:40.949833 24849 ts_tablet_manager.cc:1403] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.168s	user 0.076s	sys 0.074s
I20260709 12:27:40.949961 24851 leader_election.cc:290] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621)
I20260709 12:27:40.950557 24851 raft_consensus.cc:493] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.950963 24851 raft_consensus.cc:515] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.952956 24851 leader_election.cc:290] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:40.955767 24806 raft_consensus.cc:2468] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:40.953019 24849 raft_consensus.cc:359] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.957460 24849 raft_consensus.cc:385] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.957612 24621 leader_election.cc:304] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:40.957823 24849 raft_consensus.cc:740] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.958498 24855 raft_consensus.cc:2804] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:40.958655 24849 consensus_queue.cc:260] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.961215 24846 tablet_bootstrap.cc:654] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.965066 24847 tablet_bootstrap.cc:492] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:40.965526 24847 ts_tablet_manager.cc:1403] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.002s
I20260709 12:27:40.968185 24847 raft_consensus.cc:359] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.968992 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20529acf8d714ca39c0e8ce721456d00" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:40.969750 24732 raft_consensus.cc:2468] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:40.971190 24846 tablet_bootstrap.cc:492] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:40.971772 24846 ts_tablet_manager.cc:1403] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 12:27:40.971897 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:40.972591 24732 raft_consensus.cc:2468] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:40.969014 24847 raft_consensus.cc:385] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.973650 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:40.973927 24847 raft_consensus.cc:740] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.974344 24731 raft_consensus.cc:2468] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:40.974651 24847 consensus_queue.cc:260] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.975057 24846 raft_consensus.cc:359] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.975800 24846 raft_consensus.cc:385] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:40.976150 24846 raft_consensus.cc:740] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.976907 24847 ts_tablet_manager.cc:1434] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:27:40.976876 24846 consensus_queue.cc:260] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.977942 24847 tablet_bootstrap.cc:492] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:40.978319 24771 leader_election.cc:304] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:40.979679 24846 ts_tablet_manager.cc:1434] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:40.979655 24771 leader_election.cc:304] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:40.981061 24846 tablet_bootstrap.cc:492] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:40.981859 24878 raft_consensus.cc:2804] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:40.982884 24878 raft_consensus.cc:493] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.983740 24878 raft_consensus.cc:3060] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:40.982319 24874 raft_consensus.cc:2804] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:40.984650 24874 raft_consensus.cc:493] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.985076 24874 raft_consensus.cc:3060] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:40.985206 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
W20260709 12:27:40.986773 24622 leader_election.cc:343] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:40.987936 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:40.988899 24657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20529acf8d714ca39c0e8ce721456d00" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:40.990418 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:40.991014 24855 raft_consensus.cc:697] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:40.991113 24656 raft_consensus.cc:2468] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:40.991670 24847 tablet_bootstrap.cc:654] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:40.992060 24855 consensus_queue.cc:237] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:40.992448 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
W20260709 12:27:40.994742 24769 leader_election.cc:343] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:40.996169 24622 leader_election.cc:343] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:40.996230 24769 leader_election.cc:343] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:40.992468 24875 raft_consensus.cc:493] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.001092 24875 raft_consensus.cc:515] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.012327 24846 tablet_bootstrap.cc:654] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:41.015111 24603 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:41.016690 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.017079 24875 leader_election.cc:290] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.017624 24771 leader_election.cc:304] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.017920 24874 raft_consensus.cc:515] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.018556 24851 raft_consensus.cc:2804] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:41.018959 24851 raft_consensus.cc:493] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.019292 24851 raft_consensus.cc:3060] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.019590 24854 raft_consensus.cc:493] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.019984 24854 raft_consensus.cc:515] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.012097 24553 catalog_manager.cc:5697] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.022264 24854 leader_election.cc:290] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.018170 24849 ts_tablet_manager.cc:1434] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.068s	user 0.026s	sys 0.008s
I20260709 12:27:41.019229 24806 raft_consensus.cc:2393] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d3390139ca74e6692e72ce6decd8a35 in current term 1: Already voted for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in this term.
I20260709 12:27:41.029379 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.037417 24849 tablet_bootstrap.cc:492] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:41.037528 24732 raft_consensus.cc:2468] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:41.039458 24622 leader_election.cc:304] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.047930 24878 raft_consensus.cc:515] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.049602 24847 tablet_bootstrap.cc:492] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:41.050182 24847 ts_tablet_manager.cc:1403] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.003s
I20260709 12:27:41.051858 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20529acf8d714ca39c0e8ce721456d00" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.053216 24849 tablet_bootstrap.cc:654] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.048971 24875 raft_consensus.cc:493] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.055101 24875 raft_consensus.cc:515] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.057271 24875 leader_election.cc:290] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.058008 24874 leader_election.cc:290] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621)
W20260709 12:27:41.053324 24769 leader_election.cc:343] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.058818 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.048930 24876 raft_consensus.cc:2804] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:41.060981 24847 raft_consensus.cc:359] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.061950 24847 raft_consensus.cc:385] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.063323 24847 raft_consensus.cc:740] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.066252 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.066437 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.066926 24806 raft_consensus.cc:2468] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:41.061470 24876 raft_consensus.cc:493] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.067775 24876 raft_consensus.cc:3060] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.061918 24851 raft_consensus.cc:515] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.070677 24851 leader_election.cc:290] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.071076 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
W20260709 12:27:41.072497 24769 leader_election.cc:343] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:41.062050 24622 leader_election.cc:343] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.062433 24874 raft_consensus.cc:493] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.073736 24874 raft_consensus.cc:515] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.076196 24874 leader_election.cc:290] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.074000 24875 raft_consensus.cc:493] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.076781 24875 raft_consensus.cc:515] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.078590 24847 consensus_queue.cc:260] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.079326 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:41.081221 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.081645 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.081900 24732 raft_consensus.cc:3060] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.082280 24731 raft_consensus.cc:3060] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.082599 24875 leader_election.cc:290] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.084352 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bf2205616a4637b919f36f387a4230" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.085018 24730 raft_consensus.cc:2468] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:41.085122 24878 leader_election.cc:290] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.086297 24622 leader_election.cc:304] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.087143 24621 leader_election.cc:304] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:41.088598 24855 raft_consensus.cc:2804] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:41.088961 24855 raft_consensus.cc:493] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.089788 24855 raft_consensus.cc:3060] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.090526 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20529acf8d714ca39c0e8ce721456d00" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.091174 24729 raft_consensus.cc:3060] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:41.081277 24769 leader_election.cc:343] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.093533 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.094957 24846 tablet_bootstrap.cc:492] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:41.095340 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e8675e57c4b249478828cfeef93f3" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.095638 24846 ts_tablet_manager.cc:1403] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.013s
I20260709 12:27:41.096047 24805 raft_consensus.cc:2468] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 0.
I20260709 12:27:41.097295 24875 raft_consensus.cc:2804] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:41.097638 24771 leader_election.cc:343] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.098287 24875 raft_consensus.cc:493] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.098466 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e8675e57c4b249478828cfeef93f3" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:41.098380 24771 leader_election.cc:304] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.099560 24878 raft_consensus.cc:2749] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:41.098810 24846 raft_consensus.cc:359] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
W20260709 12:27:41.100199 24695 leader_election.cc:343] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.100476 24846 raft_consensus.cc:385] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.100514 24875 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.100407 24732 raft_consensus.cc:2468] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 1.
I20260709 12:27:41.100693 24847 ts_tablet_manager.cc:1434] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.005s
I20260709 12:27:41.102947 24729 raft_consensus.cc:2468] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 1.
I20260709 12:27:41.104581 24731 raft_consensus.cc:2468] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 1.
I20260709 12:27:41.105907 24771 leader_election.cc:304] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:41.106300 24876 raft_consensus.cc:515] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.097976 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bf2205616a4637b919f36f387a4230" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.127030 24878 raft_consensus.cc:493] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.127657 24806 raft_consensus.cc:2468] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:41.126839 24874 raft_consensus.cc:2804] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.127735 24878 raft_consensus.cc:515] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.107265 24846 raft_consensus.cc:740] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.128542 24874 raft_consensus.cc:697] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.129161 24846 consensus_queue.cc:260] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.130023 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.130538 24878 leader_election.cc:290] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.131572 24846 ts_tablet_manager.cc:1434] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.012s
I20260709 12:27:41.127774 24771 leader_election.cc:304] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.132673 24878 raft_consensus.cc:2804] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.133204 24878 raft_consensus.cc:697] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.129616 24874 consensus_queue.cc:237] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.134002 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:41.117136 24849 tablet_bootstrap.cc:492] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:41.134332 24878 consensus_queue.cc:237] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.135094 24849 ts_tablet_manager.cc:1403] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.098s	user 0.006s	sys 0.014s
I20260709 12:27:41.107205 24855 raft_consensus.cc:515] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.110803 24696 leader_election.cc:304] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.126961 24655 raft_consensus.cc:2393] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in current term 1: Already voted for candidate 8d3390139ca74e6692e72ce6decd8a35 in this term.
I20260709 12:27:41.138873 24854 raft_consensus.cc:2804] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:41.139233 24854 raft_consensus.cc:493] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.139537 24854 raft_consensus.cc:3060] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.140015 24855 leader_election.cc:290] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.141094 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bf2205616a4637b919f36f387a4230" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.141706 24729 raft_consensus.cc:3060] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.115192 24875 raft_consensus.cc:515] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
W20260709 12:27:41.135795 24769 leader_election.cc:343] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.144793 24849 raft_consensus.cc:359] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.145581 24849 raft_consensus.cc:385] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.145916 24849 raft_consensus.cc:740] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.146632 24849 consensus_queue.cc:260] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.147199 24875 leader_election.cc:290] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.147825 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.136060 24846 tablet_bootstrap.cc:492] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:41.136961 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.150779 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bf2205616a4637b919f36f387a4230" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.151417 24806 raft_consensus.cc:3060] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.151541 24731 raft_consensus.cc:2393] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d3390139ca74e6692e72ce6decd8a35 in current term 1: Already voted for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in this term.
I20260709 12:27:41.151628 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.137604 24876 leader_election.cc:290] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.152411 24805 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.148569 24854 raft_consensus.cc:515] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.158536 24771 leader_election.cc:304] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.159345 24854 leader_election.cc:290] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.159584 24851 raft_consensus.cc:2804] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.160240 24851 raft_consensus.cc:697] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.160975 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e8675e57c4b249478828cfeef93f3" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.161741 24804 raft_consensus.cc:3060] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.161290 24851 consensus_queue.cc:237] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.159402 24876 raft_consensus.cc:493] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:41.149335 24622 leader_election.cc:343] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.163316 24846 tablet_bootstrap.cc:654] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.149887 24849 ts_tablet_manager.cc:1434] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:27:41.165848 24622 leader_election.cc:304] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:41.168478 24806 raft_consensus.cc:2468] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:41.168653 24805 raft_consensus.cc:2468] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:41.170486 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e8675e57c4b249478828cfeef93f3" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.172508 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.176117 24731 raft_consensus.cc:2468] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
W20260709 12:27:41.177357 24695 leader_election.cc:343] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.177994 24621 leader_election.cc:304] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.173774 24849 tablet_bootstrap.cc:492] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:41.171816 24876 raft_consensus.cc:515] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.174129 24875 raft_consensus.cc:2749] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:41.179229 24855 raft_consensus.cc:2804] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.182301 24855 raft_consensus.cc:697] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.183652 24855 consensus_queue.cc:237] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.178231 24771 leader_election.cc:304] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.189247 24621 leader_election.cc:304] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:41.189992 24804 raft_consensus.cc:2468] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 1.
I20260709 12:27:41.190971 24875 raft_consensus.cc:2804] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.191674 24875 raft_consensus.cc:697] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.191607 24696 leader_election.cc:304] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.192876 24854 raft_consensus.cc:2804] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.204042 24874 raft_consensus.cc:2804] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:41.205669 24874 raft_consensus.cc:493] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.206027 24874 raft_consensus.cc:3060] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.208057 24875 consensus_queue.cc:237] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.212906 24553 catalog_manager.cc:5697] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.206926 24854 raft_consensus.cc:697] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:41.219039 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20529acf8d714ca39c0e8ce721456d00" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.218940 24854 consensus_queue.cc:237] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.219890 24731 raft_consensus.cc:2393] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d3390139ca74e6692e72ce6decd8a35 in current term 1: Already voted for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in this term.
I20260709 12:27:41.222186 24876 leader_election.cc:290] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.224381 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20529acf8d714ca39c0e8ce721456d00" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.226092 24621 leader_election.cc:304] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:41.226872 24876 raft_consensus.cc:3060] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.231104 24846 tablet_bootstrap.cc:492] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:41.231693 24846 ts_tablet_manager.cc:1403] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.015s
I20260709 12:27:41.227890 24729 raft_consensus.cc:2468] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:41.234793 24874 raft_consensus.cc:515] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.235564 24846 raft_consensus.cc:359] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.239609 24849 tablet_bootstrap.cc:654] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.242645 24846 raft_consensus.cc:385] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.245914 24846 raft_consensus.cc:740] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.243672 24874 leader_election.cc:290] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.244648 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.252358 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.252812 24876 raft_consensus.cc:2749] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:41.253028 24729 raft_consensus.cc:3060] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:41.258268 24769 leader_election.cc:343] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:41.260504 24846 consensus_queue.cc:260] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.266048 24553 catalog_manager.cc:5697] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.270988 24729 raft_consensus.cc:2468] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 1.
I20260709 12:27:41.272491 24771 leader_election.cc:304] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.279162 24874 raft_consensus.cc:2804] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.280064 24874 raft_consensus.cc:697] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.280961 24874 consensus_queue.cc:237] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.285902 24849 tablet_bootstrap.cc:492] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:41.286461 24849 ts_tablet_manager.cc:1403] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.026s
I20260709 12:27:41.287036 24846 ts_tablet_manager.cc:1434] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.004s
I20260709 12:27:41.288048 24846 tablet_bootstrap.cc:492] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:41.286605 24554 catalog_manager.cc:5697] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.289647 24849 raft_consensus.cc:359] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.290442 24849 raft_consensus.cc:385] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.290730 24849 raft_consensus.cc:740] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.291708 24849 consensus_queue.cc:260] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.289517 24554 catalog_manager.cc:5697] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.294251 24849 ts_tablet_manager.cc:1434] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:41.294816 24846 tablet_bootstrap.cc:654] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.298038 24849 tablet_bootstrap.cc:492] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:41.307401 24849 tablet_bootstrap.cc:654] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.308979 24555 catalog_manager.cc:5697] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.314539 24846 tablet_bootstrap.cc:492] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:41.315025 24846 ts_tablet_manager.cc:1403] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.007s
I20260709 12:27:41.317948 24846 raft_consensus.cc:359] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.318385 24846 raft_consensus.cc:385] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.318538 24846 raft_consensus.cc:740] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.319075 24846 consensus_queue.cc:260] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.320729 24846 ts_tablet_manager.cc:1434] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:41.322585 24849 tablet_bootstrap.cc:492] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:41.323064 24849 ts_tablet_manager.cc:1403] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.002s
I20260709 12:27:41.322453 24553 catalog_manager.cc:5697] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.325549 24849 raft_consensus.cc:359] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.326148 24849 raft_consensus.cc:385] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.326455 24849 raft_consensus.cc:740] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.327098 24849 consensus_queue.cc:260] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.329478 24849 ts_tablet_manager.cc:1434] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.006s
I20260709 12:27:41.330376 24849 tablet_bootstrap.cc:492] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:41.337082 24849 tablet_bootstrap.cc:654] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.339040 24876 raft_consensus.cc:493] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.338840 24552 catalog_manager.cc:5697] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.339710 24876 raft_consensus.cc:515] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.342656 24876 leader_election.cc:290] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.344357 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.344882 24729 raft_consensus.cc:2468] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:41.345471 24849 tablet_bootstrap.cc:492] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:41.345933 24849 ts_tablet_manager.cc:1403] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 12:27:41.348331 24849 raft_consensus.cc:359] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.348670 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.348963 24849 raft_consensus.cc:385] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.349408 24849 raft_consensus.cc:740] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.349514 24804 raft_consensus.cc:2468] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:41.349812 24622 leader_election.cc:304] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.350696 24876 raft_consensus.cc:2804] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:41.350102 24849 consensus_queue.cc:260] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.351068 24876 raft_consensus.cc:493] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.351615 24876 raft_consensus.cc:3060] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.352916 24849 ts_tablet_manager.cc:1434] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:41.353961 24849 tablet_bootstrap.cc:492] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:41.360248 24849 tablet_bootstrap.cc:654] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:41.360558 24876 raft_consensus.cc:515] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.363677 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.364295 24729 raft_consensus.cc:3060] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.364183 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.364938 24849 tablet_bootstrap.cc:492] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:41.364925 24804 raft_consensus.cc:3060] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.365082 24876 leader_election.cc:290] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.365653 24849 ts_tablet_manager.cc:1403] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.009s
I20260709 12:27:41.368372 24849 raft_consensus.cc:359] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.368988 24849 raft_consensus.cc:385] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:41.369270 24849 raft_consensus.cc:740] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.370143 24729 raft_consensus.cc:2468] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:41.369930 24849 consensus_queue.cc:260] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.371196 24622 leader_election.cc:304] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.372033 24849 ts_tablet_manager.cc:1434] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:27:41.372035 24875 raft_consensus.cc:2804] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:41.373159 24875 raft_consensus.cc:697] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.373940 24804 raft_consensus.cc:2468] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:41.374008 24875 consensus_queue.cc:237] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.382970 24553 catalog_manager.cc:5697] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.466387 24854 raft_consensus.cc:493] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.466970 24854 raft_consensus.cc:515] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.468647 24854 leader_election.cc:290] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.469731 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:41.469789 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.470726 24804 raft_consensus.cc:2393] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1bff2b69967f4234a5781e7a261c603f in current term 1: Already voted for candidate 8d3390139ca74e6692e72ce6decd8a35 in this term.
I20260709 12:27:41.471581 24696 leader_election.cc:304] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.472220 24854 raft_consensus.cc:3060] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.477101 24854 raft_consensus.cc:2749] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:41.529150 24874 consensus_queue.cc:1048] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.540246 24851 consensus_queue.cc:1048] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.556017 24875 consensus_queue.cc:1048] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.563158 24804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
mode: GRACEFUL
new_leader_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:41982
I20260709 12:27:41.563648 24804 raft_consensus.cc:606] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Received request to transfer leadership to TS 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.567672 24876 consensus_queue.cc:1048] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.571851 24874 consensus_queue.cc:1048] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.576337 24805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
mode: GRACEFUL
new_leader_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:41982
I20260709 12:27:41.576921 24805 raft_consensus.cc:606] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Received request to transfer leadership to TS 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.588675 24804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
mode: GRACEFUL
new_leader_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:41982
I20260709 12:27:41.589275 24804 raft_consensus.cc:606] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Received request to transfer leadership to TS 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:41.596572 24655 raft_consensus.cc:3060] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.607941 24876 raft_consensus.cc:493] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.608384 24876 raft_consensus.cc:515] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.612142 24851 consensus_queue.cc:1048] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.613101 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.614585 24876 leader_election.cc:290] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.615828 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.616178 24851 consensus_queue.cc:1048] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.617527 24621 leader_election.cc:304] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:41.618283 24876 raft_consensus.cc:2749] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:41.619056 24655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:41.619649 24655 raft_consensus.cc:606] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:41.625231 24851 raft_consensus.cc:993] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: : Instructing follower 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:41.625658 24851 raft_consensus.cc:1081] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Signalling peer 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:41.630908 24655 raft_consensus.cc:3060] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.632236 24657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:41.632901 24657 raft_consensus.cc:606] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:41.640262 24854 consensus_queue.cc:1048] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.642550 24874 consensus_queue.cc:1048] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.643800 24657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:41.644462 24657 raft_consensus.cc:606] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:41.627228 24656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:39396
I20260709 12:27:41.646095 24656 raft_consensus.cc:493] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.646530 24656 raft_consensus.cc:3060] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.654086 24854 consensus_queue.cc:1048] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:41.656757 24656 raft_consensus.cc:515] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.659155 24876 consensus_queue.cc:1048] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:41.665746 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.666383 24731 raft_consensus.cc:3060] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.667986 24729 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.672582 24876 consensus_queue.cc:1048] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.675030 24731 raft_consensus.cc:2468] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:41.676321 24622 leader_election.cc:304] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.677317 24876 raft_consensus.cc:2804] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:41.678725 24656 leader_election.cc:290] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.678921 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5a1009b07548898666e65ed65e5ac7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.679704 24805 raft_consensus.cc:3055] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:41.680070 24805 raft_consensus.cc:740] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.681396 24876 raft_consensus.cc:697] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.682343 24876 consensus_queue.cc:237] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.680912 24805 consensus_queue.cc:260] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.685763 24805 raft_consensus.cc:3060] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.686352 24879 consensus_queue.cc:1048] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.695346 24805 raft_consensus.cc:2468] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:41.698266 24851 consensus_queue.cc:1048] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.700269 24851 raft_consensus.cc:993] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: : Instructing follower 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:41.700917 24885 raft_consensus.cc:1081] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Signalling peer 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:41.703478 24654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:39396
I20260709 12:27:41.704020 24654 raft_consensus.cc:493] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.704391 24654 raft_consensus.cc:3060] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.714402 24654 raft_consensus.cc:515] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.716512 24876 raft_consensus.cc:493] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.717051 24876 raft_consensus.cc:515] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.717433 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.718170 24805 raft_consensus.cc:3055] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:41.718536 24805 raft_consensus.cc:740] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.719178 24876 leader_election.cc:290] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.720331 24656 raft_consensus.cc:3060] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:41.720734 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:41.725867 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:41.727192 24621 leader_election.cc:304] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:41.731639 24876 raft_consensus.cc:2749] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:41.732116 24805 consensus_queue.cc:260] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.732335 24878 consensus_queue.cc:1048] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:41.733379 24805 raft_consensus.cc:3060] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.739042 24654 leader_election.cc:290] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Requested vote from peers 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:41.738457 24552 catalog_manager.cc:5697] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 1 to 2, leader changed from 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67) to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.741134 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bc1edf0ab845bd988ff493c1c3d17b" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.741748 24731 raft_consensus.cc:3060] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.746924 24805 raft_consensus.cc:2468] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:41.748474 24621 leader_election.cc:304] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.748711 24731 raft_consensus.cc:2468] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:41.749513 24876 raft_consensus.cc:2804] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:41.750263 24876 raft_consensus.cc:697] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.751740 24875 raft_consensus.cc:993] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:41.752543 24855 raft_consensus.cc:1081] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:41.752619 24876 consensus_queue.cc:237] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } }
I20260709 12:27:41.757362 24732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:41.757853 24732 raft_consensus.cc:493] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.758222 24732 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.758873 24879 consensus_queue.cc:1048] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.764369 24878 raft_consensus.cc:993] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: : Instructing follower 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:41.764868 24878 raft_consensus.cc:1081] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Signalling peer 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:41.767964 24732 raft_consensus.cc:515] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.768690 24655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:39396
I20260709 12:27:41.769277 24855 consensus_queue.cc:1048] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:41.768699 24552 catalog_manager.cc:5697] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 1 to 2, leader changed from 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67) to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.770147 24732 leader_election.cc:290] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.769460 24655 raft_consensus.cc:493] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.770792 24655 raft_consensus.cc:3060] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.771235 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.771842 24654 raft_consensus.cc:3055] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:41.772164 24654 raft_consensus.cc:740] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.772900 24654 consensus_queue.cc:260] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.773991 24654 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.776593 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.777213 24805 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.784737 24805 raft_consensus.cc:2468] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:41.785480 24804 raft_consensus.cc:1240] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Rejecting Update request from peer 8d3390139ca74e6692e72ce6decd8a35 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:41.787096 24654 raft_consensus.cc:2468] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:41.788362 24695 leader_election.cc:304] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.789456 24893 raft_consensus.cc:2804] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:41.789934 24893 raft_consensus.cc:697] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:41.790593 24655 raft_consensus.cc:515] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.790745 24893 consensus_queue.cc:237] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.792887 24655 leader_election.cc:290] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.791405 24879 raft_consensus.cc:993] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:41.793629 24879 raft_consensus.cc:1081] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:41.795863 24729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:41.800855 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:41.801616 24729 raft_consensus.cc:493] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.802052 24729 raft_consensus.cc:3060] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.803192 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c525668f0eab4ebca90c9be91dff4f7c" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.803634 24805 raft_consensus.cc:3055] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:41.803960 24805 raft_consensus.cc:740] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:41.801424 24732 raft_consensus.cc:3060] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.804764 24805 consensus_queue.cc:260] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.806008 24805 raft_consensus.cc:3060] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.809217 24729 raft_consensus.cc:515] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.812539 24732 raft_consensus.cc:2468] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:41.812527 24855 consensus_queue.cc:1048] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:41.814253 24622 leader_election.cc:304] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:41.815019 24927 raft_consensus.cc:2804] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:41.815497 24927 raft_consensus.cc:697] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.816363 24927 consensus_queue.cc:237] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.817011 24553 catalog_manager.cc:5697] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.822358 24729 leader_election.cc:290] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.823835 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.824443 24655 raft_consensus.cc:3055] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:41.824755 24655 raft_consensus.cc:740] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.825680 24655 consensus_queue.cc:260] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.826453 24805 raft_consensus.cc:2468] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:41.826787 24655 raft_consensus.cc:3060] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.827139 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edb6eab46c14dab81a81fe18e097266" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.828076 24552 catalog_manager.cc:5697] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 1 to 2, leader changed from 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67) to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.834010 24655 raft_consensus.cc:2468] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:41.835111 24695 leader_election.cc:304] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:41.835978 24893 raft_consensus.cc:2804] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:41.836472 24893 raft_consensus.cc:697] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:41.837320 24893 consensus_queue.cc:237] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.844121 24553 catalog_manager.cc:5697] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.953935 24855 raft_consensus.cc:993] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:41.954355 24927 raft_consensus.cc:1081] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:41.955667 24729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:41.956130 24729 raft_consensus.cc:493] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.956441 24729 raft_consensus.cc:3060] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.961373 24729 raft_consensus.cc:515] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.963052 24729 leader_election.cc:290] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:41.963945 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:41.964076 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85c32da046a4f30b9190e15c2fce27f" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:41.964679 24655 raft_consensus.cc:3055] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:41.964692 24804 raft_consensus.cc:3060] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.965174 24655 raft_consensus.cc:740] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:41.966051 24655 consensus_queue.cc:260] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.967303 24655 raft_consensus.cc:3060] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.972071 24804 raft_consensus.cc:2468] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:41.973451 24696 leader_election.cc:304] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:41.974270 24893 raft_consensus.cc:2804] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:41.974371 24655 raft_consensus.cc:2468] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:41.974753 24893 raft_consensus.cc:697] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:41.975636 24893 consensus_queue.cc:237] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:41.981663 24552 catalog_manager.cc:5697] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:42.072024 24729 raft_consensus.cc:1275] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.073287 24927 consensus_queue.cc:1048] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.080852 24804 raft_consensus.cc:1275] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.082505 24855 consensus_queue.cc:1048] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.202651 24804 raft_consensus.cc:1275] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.203879 24855 consensus_queue.cc:1048] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.210585 24729 raft_consensus.cc:1275] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.212004 24879 consensus_queue.cc:1048] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.213080 24729 raft_consensus.cc:1275] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.215173 24855 consensus_queue.cc:1048] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.222870 24804 raft_consensus.cc:1275] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.226824 24855 consensus_queue.cc:1048] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.242761 24804 raft_consensus.cc:3060] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.248155 24804 raft_consensus.cc:1275] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.249293 24854 consensus_queue.cc:1048] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.256632 24655 raft_consensus.cc:1275] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.258031 24854 consensus_queue.cc:1048] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.295620 24655 raft_consensus.cc:1275] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.296941 24854 consensus_queue.cc:1048] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.304795 24804 raft_consensus.cc:1275] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.306380 24930 consensus_queue.cc:1048] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:42.498303 24655 raft_consensus.cc:1275] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.499692 24930 consensus_queue.cc:1048] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:42.508365 24804 raft_consensus.cc:1275] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:42.510072 24930 consensus_queue.cc:1048] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:44.703099 24554 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55764:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:44.705631 24554 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:44.756824 24645 tablet_service.cc:1511] Processing CreateTablet for tablet 1d146e2166a744538f75bf3b26770f81 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:44.758107 24645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d146e2166a744538f75bf3b26770f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.759423 24715 tablet_service.cc:1511] Processing CreateTablet for tablet 1d146e2166a744538f75bf3b26770f81 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:44.760131 24793 tablet_service.cc:1511] Processing CreateTablet for tablet 1d146e2166a744538f75bf3b26770f81 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:44.760807 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d146e2166a744538f75bf3b26770f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.761412 24793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d146e2166a744538f75bf3b26770f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.762310 24646 tablet_service.cc:1511] Processing CreateTablet for tablet 62ab20e2fa7e420c97c2af6dfbd46dcd (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:44.763640 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ab20e2fa7e420c97c2af6dfbd46dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.767084 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 62ab20e2fa7e420c97c2af6dfbd46dcd (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:44.767336 24790 tablet_service.cc:1511] Processing CreateTablet for tablet 62ab20e2fa7e420c97c2af6dfbd46dcd (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:44.767427 24643 tablet_service.cc:1511] Processing CreateTablet for tablet 222e4e450f6a4cc2a087af9f14b4775d (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:44.768476 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ab20e2fa7e420c97c2af6dfbd46dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.768687 24790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ab20e2fa7e420c97c2af6dfbd46dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.768893 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e4e450f6a4cc2a087af9f14b4775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.772354 24642 tablet_service.cc:1511] Processing CreateTablet for tablet e78ff4984192494f9608daab2c65c726 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:44.772581 24791 tablet_service.cc:1511] Processing CreateTablet for tablet 222e4e450f6a4cc2a087af9f14b4775d (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:44.774047 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78ff4984192494f9608daab2c65c726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.774305 24791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e4e450f6a4cc2a087af9f14b4775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.777872 24719 tablet_service.cc:1511] Processing CreateTablet for tablet 222e4e450f6a4cc2a087af9f14b4775d (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:44.779276 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222e4e450f6a4cc2a087af9f14b4775d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.779805 24721 tablet_service.cc:1511] Processing CreateTablet for tablet e78ff4984192494f9608daab2c65c726 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:44.781170 24721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78ff4984192494f9608daab2c65c726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.781761 24792 tablet_service.cc:1511] Processing CreateTablet for tablet e78ff4984192494f9608daab2c65c726 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:44.782943 24792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78ff4984192494f9608daab2c65c726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.783030 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 2fdf111c2a074317827ab0b0252e29fd (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:44.784451 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fdf111c2a074317827ab0b0252e29fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.786582 24722 tablet_service.cc:1511] Processing CreateTablet for tablet 2fdf111c2a074317827ab0b0252e29fd (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:44.787950 24722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fdf111c2a074317827ab0b0252e29fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.788177 24794 tablet_service.cc:1511] Processing CreateTablet for tablet 2fdf111c2a074317827ab0b0252e29fd (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:44.789400 24794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fdf111c2a074317827ab0b0252e29fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.790082 24640 tablet_service.cc:1511] Processing CreateTablet for tablet c794abe3cf0f41d59fc5824e5ed8b449 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:44.791473 24640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c794abe3cf0f41d59fc5824e5ed8b449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.794098 24717 tablet_service.cc:1511] Processing CreateTablet for tablet c794abe3cf0f41d59fc5824e5ed8b449 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:44.795483 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c794abe3cf0f41d59fc5824e5ed8b449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.797406 24796 tablet_service.cc:1511] Processing CreateTablet for tablet c794abe3cf0f41d59fc5824e5ed8b449 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:44.797634 24718 tablet_service.cc:1511] Processing CreateTablet for tablet 3cea60c5eaed44159f39640911e4b0f7 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:44.798671 24796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c794abe3cf0f41d59fc5824e5ed8b449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.799027 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea60c5eaed44159f39640911e4b0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.800968 24647 tablet_service.cc:1511] Processing CreateTablet for tablet e992d8c0f9c1492aae8a4609160dd7dc (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:44.802332 24647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e992d8c0f9c1492aae8a4609160dd7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.802835 24795 tablet_service.cc:1511] Processing CreateTablet for tablet 3cea60c5eaed44159f39640911e4b0f7 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:44.804034 24795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea60c5eaed44159f39640911e4b0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.806102 24714 tablet_service.cc:1511] Processing CreateTablet for tablet e992d8c0f9c1492aae8a4609160dd7dc (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:44.806388 24644 tablet_service.cc:1511] Processing CreateTablet for tablet ac381f21a2b64525bbd3bf60fb314a7a (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:44.807454 24714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e992d8c0f9c1492aae8a4609160dd7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.807600 24644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac381f21a2b64525bbd3bf60fb314a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.810194 24720 tablet_service.cc:1511] Processing CreateTablet for tablet ac381f21a2b64525bbd3bf60fb314a7a (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:44.811425 24720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac381f21a2b64525bbd3bf60fb314a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.811941 24788 tablet_service.cc:1511] Processing CreateTablet for tablet e992d8c0f9c1492aae8a4609160dd7dc (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:44.813191 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e992d8c0f9c1492aae8a4609160dd7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.795567 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 3cea60c5eaed44159f39640911e4b0f7 (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:44.815977 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cea60c5eaed44159f39640911e4b0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.826573 24789 tablet_service.cc:1511] Processing CreateTablet for tablet ac381f21a2b64525bbd3bf60fb314a7a (DEFAULT_TABLE table=soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:44.828017 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac381f21a2b64525bbd3bf60fb314a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.892202 24942 tablet_bootstrap.cc:492] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:44.948029 24942 tablet_bootstrap.cc:654] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.957954 24945 tablet_bootstrap.cc:492] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:44.958633 24944 tablet_bootstrap.cc:492] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.003260 24945 tablet_bootstrap.cc:654] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.017995 24942 tablet_bootstrap.cc:492] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.019253 24942 ts_tablet_manager.cc:1403] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.007s
I20260709 12:27:45.019750 24944 tablet_bootstrap.cc:654] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.026610 24942 raft_consensus.cc:359] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.028645 24942 raft_consensus.cc:385] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.029197 24942 raft_consensus.cc:740] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.030462 24942 consensus_queue.cc:260] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.035197 24942 ts_tablet_manager.cc:1434] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.010s
I20260709 12:27:45.037429 24942 tablet_bootstrap.cc:492] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.039515 24944 tablet_bootstrap.cc:492] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.040535 24944 ts_tablet_manager.cc:1403] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.009s
I20260709 12:27:45.045060 24944 raft_consensus.cc:359] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.046085 24944 raft_consensus.cc:385] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.046499 24944 raft_consensus.cc:740] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.047595 24944 consensus_queue.cc:260] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.052937 24944 ts_tablet_manager.cc:1434] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:27:45.061285 24942 tablet_bootstrap.cc:654] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.066268 24944 tablet_bootstrap.cc:492] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.074560 24945 tablet_bootstrap.cc:492] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.075424 24945 ts_tablet_manager.cc:1403] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.042s
W20260709 12:27:45.077893 24603 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:45.080134 24945 raft_consensus.cc:359] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.081166 24944 tablet_bootstrap.cc:654] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.081135 24945 raft_consensus.cc:385] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.082981 24945 raft_consensus.cc:740] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.083036 24950 raft_consensus.cc:493] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.083848 24950 raft_consensus.cc:515] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.084017 24945 consensus_queue.cc:260] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.088271 24945 ts_tablet_manager.cc:1434] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:27:45.088315 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
W20260709 12:27:45.090705 24622 leader_election.cc:343] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.092593 24945 tablet_bootstrap.cc:492] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.095378 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.096556 24942 tablet_bootstrap.cc:492] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.097136 24950 leader_election.cc:290] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
W20260709 12:27:45.097487 24621 leader_election.cc:343] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.098098 24621 leader_election.cc:304] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:45.098644 24942 ts_tablet_manager.cc:1403] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.028s
I20260709 12:27:45.099134 24927 raft_consensus.cc:2749] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.102250 24942 raft_consensus.cc:359] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.103034 24942 raft_consensus.cc:385] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.103307 24942 raft_consensus.cc:740] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.104141 24945 tablet_bootstrap.cc:654] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.104219 24942 consensus_queue.cc:260] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.106956 24942 ts_tablet_manager.cc:1434] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:27:45.108261 24942 tablet_bootstrap.cc:492] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.112468 24944 tablet_bootstrap.cc:492] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.113056 24944 ts_tablet_manager.cc:1403] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.005s
I20260709 12:27:45.113276 24945 tablet_bootstrap.cc:492] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.113844 24945 ts_tablet_manager.cc:1403] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:27:45.116719 24942 tablet_bootstrap.cc:654] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.116360 24944 raft_consensus.cc:359] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.117126 24945 raft_consensus.cc:359] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.117895 24944 raft_consensus.cc:385] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.117997 24945 raft_consensus.cc:385] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.118484 24945 raft_consensus.cc:740] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.118319 24944 raft_consensus.cc:740] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.119545 24944 consensus_queue.cc:260] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.119431 24945 consensus_queue.cc:260] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.122573 24944 ts_tablet_manager.cc:1434] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:27:45.123061 24945 ts_tablet_manager.cc:1434] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:27:45.124677 24945 tablet_bootstrap.cc:492] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.128592 24944 tablet_bootstrap.cc:492] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.130525 24942 tablet_bootstrap.cc:492] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.131036 24942 ts_tablet_manager.cc:1403] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:27:45.133661 24945 tablet_bootstrap.cc:654] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.134351 24942 raft_consensus.cc:359] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.135113 24942 raft_consensus.cc:385] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.135433 24942 raft_consensus.cc:740] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.136338 24942 consensus_queue.cc:260] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.137326 24944 tablet_bootstrap.cc:654] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.138787 24942 ts_tablet_manager.cc:1434] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:45.140406 24942 tablet_bootstrap.cc:492] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.147620 24942 tablet_bootstrap.cc:654] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.150758 24944 tablet_bootstrap.cc:492] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.151327 24945 tablet_bootstrap.cc:492] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.151348 24944 ts_tablet_manager.cc:1403] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.006s
I20260709 12:27:45.152132 24945 ts_tablet_manager.cc:1403] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 12:27:45.157460 24945 raft_consensus.cc:359] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.158063 24945 raft_consensus.cc:385] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.158521 24945 raft_consensus.cc:740] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.159296 24945 consensus_queue.cc:260] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.160573 24944 raft_consensus.cc:359] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.161573 24944 raft_consensus.cc:385] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.161818 24945 ts_tablet_manager.cc:1434] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:27:45.162036 24944 raft_consensus.cc:740] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.163455 24945 tablet_bootstrap.cc:492] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.165413 24942 tablet_bootstrap.cc:492] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.166006 24942 ts_tablet_manager.cc:1403] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 12:27:45.168440 24930 raft_consensus.cc:493] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.168969 24930 raft_consensus.cc:515] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.171408 24945 tablet_bootstrap.cc:654] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.163384 24944 consensus_queue.cc:260] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.174337 24944 ts_tablet_manager.cc:1434] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:27:45.175781 24944 tablet_bootstrap.cc:492] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.178562 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.180519 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.184276 24944 tablet_bootstrap.cc:654] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:45.188706 24696 leader_election.cc:343] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:45.190589 24695 leader_election.cc:343] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.191313 24695 leader_election.cc:304] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.194522 24949 raft_consensus.cc:2749] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.198065 24930 leader_election.cc:290] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.211870 24942 raft_consensus.cc:359] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.212708 24942 raft_consensus.cc:385] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.212883 24945 tablet_bootstrap.cc:492] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.213093 24942 raft_consensus.cc:740] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.213555 24945 ts_tablet_manager.cc:1403] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.041s
I20260709 12:27:45.213963 24942 consensus_queue.cc:260] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.216601 24942 ts_tablet_manager.cc:1434] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:27:45.216905 24945 raft_consensus.cc:359] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.217810 24945 raft_consensus.cc:385] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.218107 24942 tablet_bootstrap.cc:492] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.218183 24945 raft_consensus.cc:740] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.219224 24944 tablet_bootstrap.cc:492] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.219390 24945 consensus_queue.cc:260] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.220091 24944 ts_tablet_manager.cc:1403] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.011s
I20260709 12:27:45.222242 24945 ts_tablet_manager.cc:1434] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:27:45.223807 24945 tablet_bootstrap.cc:492] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.225558 24944 raft_consensus.cc:359] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.226438 24944 raft_consensus.cc:385] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.226799 24944 raft_consensus.cc:740] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.227496 24851 raft_consensus.cc:493] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.227723 24944 consensus_queue.cc:260] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.228088 24851 raft_consensus.cc:515] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.231487 24950 raft_consensus.cc:493] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.231762 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78ff4984192494f9608daab2c65c726" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.231967 24950 raft_consensus.cc:515] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.232438 24655 raft_consensus.cc:2468] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:45.232820 24851 leader_election.cc:290] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.234095 24944 ts_tablet_manager.cc:1434] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:27:45.234515 24950 leader_election.cc:290] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.236521 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.236956 24944 tablet_bootstrap.cc:492] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.237926 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.238991 24942 tablet_bootstrap.cc:654] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.231760 24945 tablet_bootstrap.cc:654] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.234826 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78ff4984192494f9608daab2c65c726" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.247227 24944 tablet_bootstrap.cc:654] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:45.248741 24621 leader_election.cc:343] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.238869 24729 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.250478 24945 tablet_bootstrap.cc:492] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.251009 24945 ts_tablet_manager.cc:1403] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 12:27:45.251600 24622 leader_election.cc:304] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:45.252818 24950 raft_consensus.cc:2804] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.253213 24950 raft_consensus.cc:493] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.253556 24950 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.255713 24945 raft_consensus.cc:359] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.256568 24945 raft_consensus.cc:385] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.256945 24945 raft_consensus.cc:740] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.238014 24769 leader_election.cc:304] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.257403 24851 raft_consensus.cc:493] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.259187 24851 raft_consensus.cc:515] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
W20260709 12:27:45.260856 24771 leader_election.cc:343] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.261476 24851 leader_election.cc:290] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.262035 24851 raft_consensus.cc:2804] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.262393 24851 raft_consensus.cc:493] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.262709 24851 raft_consensus.cc:3060] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.264505 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.258328 24945 consensus_queue.cc:260] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
W20260709 12:27:45.269938 24771 leader_election.cc:343] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.277143 24945 ts_tablet_manager.cc:1434] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:27:45.282213 24945 tablet_bootstrap.cc:492] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.290261 24945 tablet_bootstrap.cc:654] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.280535 24851 raft_consensus.cc:515] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
W20260709 12:27:45.293442 24769 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.78.65:43621, user_credentials={real_user=slave}} blocked reactor thread for 55639.6us
I20260709 12:27:45.294170 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78ff4984192494f9608daab2c65c726" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
W20260709 12:27:45.295428 24771 leader_election.cc:343] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.296301 24851 leader_election.cc:290] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.297186 24927 raft_consensus.cc:493] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.297704 24927 raft_consensus.cc:515] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.300045 24927 leader_election.cc:290] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.300668 24960 raft_consensus.cc:493] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.301424 24960 raft_consensus.cc:515] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.303442 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78ff4984192494f9608daab2c65c726" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:45.304031 24960 leader_election.cc:290] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.304374 24654 raft_consensus.cc:3060] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.307060 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.308012 24805 raft_consensus.cc:2468] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.309652 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.310526 24944 tablet_bootstrap.cc:492] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
W20260709 12:27:45.311775 24695 leader_election.cc:343] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.313618 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.317759 24944 ts_tablet_manager.cc:1403] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.035s
W20260709 12:27:45.321815 24696 leader_election.cc:343] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.322471 24696 leader_election.cc:304] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.322331 24944 raft_consensus.cc:359] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.323455 24944 raft_consensus.cc:385] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.323834 24944 raft_consensus.cc:740] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.324117 24949 raft_consensus.cc:2749] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.325074 24944 consensus_queue.cc:260] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.325768 24621 leader_election.cc:304] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.327356 24927 raft_consensus.cc:2804] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.327828 24927 raft_consensus.cc:493] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.328250 24927 raft_consensus.cc:3060] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.328656 24944 ts_tablet_manager.cc:1434] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 12:27:45.330341 24944 tablet_bootstrap.cc:492] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.333410 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.307284 24960 raft_consensus.cc:493] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.334249 24960 raft_consensus.cc:515] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.337483 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
W20260709 12:27:45.338994 24696 leader_election.cc:343] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.338984 24657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.340512 24657 raft_consensus.cc:2468] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 0.
I20260709 12:27:45.341534 24960 leader_election.cc:290] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.342608 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.342667 24695 leader_election.cc:304] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2
W20260709 12:27:45.345846 24622 leader_election.cc:343] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.347129 24960 raft_consensus.cc:2804] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.347723 24960 raft_consensus.cc:493] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.348228 24960 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.364274 24960 raft_consensus.cc:515] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.352459 24944 tablet_bootstrap.cc:654] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.371371 24950 raft_consensus.cc:515] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.374770 24657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:45.375569 24657 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.376384 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.377206 24804 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.378616 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:45.379411 24729 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.387813 24657 raft_consensus.cc:2468] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 1.
I20260709 12:27:45.389191 24654 raft_consensus.cc:2468] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 1.
I20260709 12:27:45.389823 24695 leader_election.cc:304] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.390973 24949 raft_consensus.cc:2804] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.390784 24769 leader_election.cc:304] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:45.391695 24949 raft_consensus.cc:697] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:45.392469 24851 raft_consensus.cc:2804] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.393448 24851 raft_consensus.cc:697] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:45.392907 24949 consensus_queue.cc:237] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.394557 24851 consensus_queue.cc:237] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.387816 24729 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.399170 24950 leader_election.cc:290] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.406641 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.406998 24622 leader_election.cc:304] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.407975 24950 raft_consensus.cc:2804] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.408581 24950 raft_consensus.cc:697] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
W20260709 12:27:45.409253 24696 leader_election.cc:343] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.409520 24950 consensus_queue.cc:237] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.388726 24804 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.414734 24942 tablet_bootstrap.cc:492] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.415431 24942 ts_tablet_manager.cc:1403] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.198s	user 0.063s	sys 0.095s
I20260709 12:27:45.401800 24927 raft_consensus.cc:515] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.417810 24655 raft_consensus.cc:2393] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in current term 1: Already voted for candidate 8d3390139ca74e6692e72ce6decd8a35 in this term.
I20260709 12:27:45.422344 24945 tablet_bootstrap.cc:492] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.422850 24945 ts_tablet_manager.cc:1403] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.141s	user 0.029s	sys 0.062s
I20260709 12:27:45.423915 24553 catalog_manager.cc:5697] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.419797 24942 raft_consensus.cc:359] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.426018 24942 raft_consensus.cc:385] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.426394 24942 raft_consensus.cc:740] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.426297 24945 raft_consensus.cc:359] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.429234 24945 raft_consensus.cc:385] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.429989 24945 raft_consensus.cc:740] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.405350 24960 leader_election.cc:290] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.433951 24945 consensus_queue.cc:260] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.399542 24944 tablet_bootstrap.cc:492] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.436463 24944 ts_tablet_manager.cc:1403] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.013s
I20260709 12:27:45.433075 24927 leader_election.cc:290] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.427407 24942 consensus_queue.cc:260] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.439908 24942 ts_tablet_manager.cc:1434] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 12:27:45.441287 24942 tablet_bootstrap.cc:492] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.442883 24555 catalog_manager.cc:5697] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 1 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.436836 24945 ts_tablet_manager.cc:1434] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:27:45.446166 24945 tablet_bootstrap.cc:492] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.446686 24944 raft_consensus.cc:359] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.447515 24944 raft_consensus.cc:385] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.447867 24944 raft_consensus.cc:740] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.448916 24944 consensus_queue.cc:260] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.452978 24944 ts_tablet_manager.cc:1434] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:27:45.454768 24944 tablet_bootstrap.cc:492] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.455191 24945 tablet_bootstrap.cc:654] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.460449 24942 tablet_bootstrap.cc:654] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.463294 24944 tablet_bootstrap.cc:654] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.463512 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
W20260709 12:27:45.463819 24621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:42639, user_credentials={real_user=slave}} blocked reactor thread for 51847us
I20260709 12:27:45.464208 24729 raft_consensus.cc:3060] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.464903 24769 leader_election.cc:304] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.466459 24851 raft_consensus.cc:3060] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.470292 24942 tablet_bootstrap.cc:492] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.470808 24942 ts_tablet_manager.cc:1403] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:27:45.472539 24729 raft_consensus.cc:2468] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.473366 24960 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.474277 24942 raft_consensus.cc:359] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.475018 24942 raft_consensus.cc:385] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.475291 24942 raft_consensus.cc:740] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.476018 24942 consensus_queue.cc:260] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.479002 24942 ts_tablet_manager.cc:1434] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:45.478693 24960 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.479210 24964 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.479768 24964 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.481910 24964 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.482191 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.483875 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
W20260709 12:27:45.484279 24695 leader_election.cc:343] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.484505 24729 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:45.485479 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.485872 24771 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:45.486783 24804 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 0.
I20260709 12:27:45.487259 24964 raft_consensus.cc:2804] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.487643 24964 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.488057 24964 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.488637 24696 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.489867 24949 raft_consensus.cc:2804] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.490346 24949 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.490736 24949 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.493242 24960 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.485162 24942 tablet_bootstrap.cc:492] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.498209 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.498930 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:45.500558 24851 raft_consensus.cc:2749] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.507375 24945 tablet_bootstrap.cc:492] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.507968 24945 ts_tablet_manager.cc:1403] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.017s
W20260709 12:27:45.507869 24769 leader_election.cc:343] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.509398 24804 raft_consensus.cc:2468] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.511584 24621 leader_election.cc:304] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.511713 24945 raft_consensus.cc:359] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.512565 24945 raft_consensus.cc:385] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.512933 24945 raft_consensus.cc:740] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.513146 24967 raft_consensus.cc:2804] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.513789 24967 raft_consensus.cc:697] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:45.513509 24552 catalog_manager.cc:5697] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.513940 24945 consensus_queue.cc:260] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.515322 24967 consensus_queue.cc:237] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.520156 24964 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.522017 24945 ts_tablet_manager.cc:1434] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:45.523277 24945 tablet_bootstrap.cc:492] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.524210 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:45.524471 24942 tablet_bootstrap.cc:654] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:45.525704 24769 leader_election.cc:343] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.530671 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:45.520341 24949 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.533540 24729 raft_consensus.cc:2393] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in current term 1: Already voted for candidate 1bff2b69967f4234a5781e7a261c603f in this term.
I20260709 12:27:45.532471 24964 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.536571 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
W20260709 12:27:45.538719 24695 leader_election.cc:343] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.540899 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.541730 24945 tablet_bootstrap.cc:654] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.541939 24804 raft_consensus.cc:2393] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1bff2b69967f4234a5781e7a261c603f in current term 1: Already voted for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in this term.
I20260709 12:27:45.544549 24696 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f; no voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.545367 24771 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.547204 24944 tablet_bootstrap.cc:492] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.547720 24944 ts_tablet_manager.cc:1403] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.043s
I20260709 12:27:45.548146 24960 raft_consensus.cc:2749] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.542301 24949 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.549367 24964 raft_consensus.cc:2749] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.552068 24944 raft_consensus.cc:359] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.552793 24944 raft_consensus.cc:385] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.553102 24944 raft_consensus.cc:740] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.553848 24944 consensus_queue.cc:260] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.554455 24945 tablet_bootstrap.cc:492] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.555006 24945 ts_tablet_manager.cc:1403] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:27:45.556208 24944 ts_tablet_manager.cc:1434] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:27:45.557848 24945 raft_consensus.cc:359] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.557871 24944 tablet_bootstrap.cc:492] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.558701 24945 raft_consensus.cc:385] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.559090 24945 raft_consensus.cc:740] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.559864 24945 consensus_queue.cc:260] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.562177 24945 ts_tablet_manager.cc:1434] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:45.563290 24945 tablet_bootstrap.cc:492] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: Bootstrap starting.
I20260709 12:27:45.565915 24944 tablet_bootstrap.cc:654] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.568367 24945 tablet_bootstrap.cc:654] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.570261 24552 catalog_manager.cc:5697] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.574070 24945 tablet_bootstrap.cc:492] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: No bootstrap required, opened a new log
I20260709 12:27:45.574084 24942 tablet_bootstrap.cc:492] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.574955 24945 ts_tablet_manager.cc:1403] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:27:45.574996 24942 ts_tablet_manager.cc:1403] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.002s
I20260709 12:27:45.577860 24942 raft_consensus.cc:359] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.578329 24942 raft_consensus.cc:385] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.578500 24942 raft_consensus.cc:740] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.579273 24942 consensus_queue.cc:260] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.581331 24945 raft_consensus.cc:359] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.582050 24945 raft_consensus.cc:385] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.582329 24945 raft_consensus.cc:740] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.582954 24945 consensus_queue.cc:260] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.583410 24944 tablet_bootstrap.cc:492] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.584261 24964 raft_consensus.cc:493] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.584362 24944 ts_tablet_manager.cc:1403] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.002s
I20260709 12:27:45.584738 24964 raft_consensus.cc:515] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.581679 24942 ts_tablet_manager.cc:1434] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:27:45.586207 24942 tablet_bootstrap.cc:492] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.586911 24964 leader_election.cc:290] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.587179 24944 raft_consensus.cc:359] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.587875 24944 raft_consensus.cc:385] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.588130 24944 raft_consensus.cc:740] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.588533 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
W20260709 12:27:45.590132 24769 leader_election.cc:343] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.592685 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.585150 24945 ts_tablet_manager.cc:1434] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:45.593357 24729 raft_consensus.cc:2468] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 0.
I20260709 12:27:45.593357 24942 tablet_bootstrap.cc:654] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.594661 24771 leader_election.cc:304] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.595692 24944 consensus_queue.cc:260] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.597743 24944 ts_tablet_manager.cc:1434] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:27:45.599220 24942 tablet_bootstrap.cc:492] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.599836 24942 ts_tablet_manager.cc:1403] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:27:45.600199 24964 raft_consensus.cc:2804] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.602598 24964 raft_consensus.cc:493] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.602584 24942 raft_consensus.cc:359] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.603245 24964 raft_consensus.cc:3060] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.603332 24942 raft_consensus.cc:385] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.603749 24942 raft_consensus.cc:740] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.604511 24942 consensus_queue.cc:260] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.607072 24944 tablet_bootstrap.cc:492] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: Bootstrap starting.
I20260709 12:27:45.611109 24964 raft_consensus.cc:515] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.612171 24942 ts_tablet_manager.cc:1434] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:27:45.613179 24942 tablet_bootstrap.cc:492] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: Bootstrap starting.
I20260709 12:27:45.613795 24944 tablet_bootstrap.cc:654] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:45.614171 24964 leader_election.cc:290] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:45.615224 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:45.617007 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:45.617817 24729 raft_consensus.cc:3060] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.620339 24942 tablet_bootstrap.cc:654] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:45.621068 24769 leader_election.cc:343] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:45.625522 24942 tablet_bootstrap.cc:492] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: No bootstrap required, opened a new log
I20260709 12:27:45.625634 24944 tablet_bootstrap.cc:492] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: No bootstrap required, opened a new log
I20260709 12:27:45.626047 24942 ts_tablet_manager.cc:1403] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:27:45.626163 24944 ts_tablet_manager.cc:1403] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:27:45.627790 24729 raft_consensus.cc:2468] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 1.
I20260709 12:27:45.628351 24944 raft_consensus.cc:359] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.628906 24771 leader_election.cc:304] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:45.629384 24944 raft_consensus.cc:385] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.628893 24942 raft_consensus.cc:359] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.629695 24944 raft_consensus.cc:740] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.629777 24942 raft_consensus.cc:385] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:45.629900 24964 raft_consensus.cc:2804] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.630237 24942 raft_consensus.cc:740] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Initialized, Role: FOLLOWER
I20260709 12:27:45.630535 24964 raft_consensus.cc:697] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:45.630585 24944 consensus_queue.cc:260] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.631321 24942 consensus_queue.cc:260] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.631486 24964 consensus_queue.cc:237] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.633347 24942 ts_tablet_manager.cc:1434] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:45.635649 24944 ts_tablet_manager.cc:1434] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:27:45.641670 24555 catalog_manager.cc:5697] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 1 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.663234 24967 raft_consensus.cc:493] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.663602 24967 raft_consensus.cc:515] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.665341 24967 leader_election.cc:290] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.665894 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ab20e2fa7e420c97c2af6dfbd46dcd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.666210 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ab20e2fa7e420c97c2af6dfbd46dcd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.666474 24729 raft_consensus.cc:2468] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.666815 24804 raft_consensus.cc:2468] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.667411 24622 leader_election.cc:304] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.668048 24967 raft_consensus.cc:2804] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.668375 24967 raft_consensus.cc:493] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.668609 24967 raft_consensus.cc:3060] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.670876 24972 raft_consensus.cc:493] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.671300 24972 raft_consensus.cc:515] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.673192 24972 leader_election.cc:290] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.673784 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.674154 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.674437 24729 raft_consensus.cc:2468] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.674731 24804 raft_consensus.cc:2468] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.675629 24622 leader_election.cc:304] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.675568 24967 raft_consensus.cc:515] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.676590 24972 raft_consensus.cc:2804] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.676949 24972 raft_consensus.cc:493] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.677302 24972 raft_consensus.cc:3060] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.677851 24967 leader_election.cc:290] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.678826 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ab20e2fa7e420c97c2af6dfbd46dcd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.679373 24804 raft_consensus.cc:3060] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.679716 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ab20e2fa7e420c97c2af6dfbd46dcd" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:45.680351 24729 raft_consensus.cc:3060] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.683172 24972 raft_consensus.cc:515] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.684942 24972 leader_election.cc:290] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.685681 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:45.685956 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.686205 24804 raft_consensus.cc:2468] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.686308 24732 raft_consensus.cc:3060] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.686594 24805 raft_consensus.cc:3060] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.688169 24729 raft_consensus.cc:2468] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.689294 24622 leader_election.cc:304] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.690068 24972 raft_consensus.cc:2804] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.690578 24972 raft_consensus.cc:697] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:45.691452 24972 consensus_queue.cc:237] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.693507 24805 raft_consensus.cc:2468] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.693818 24732 raft_consensus.cc:2468] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.694516 24621 leader_election.cc:304] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.695633 24967 raft_consensus.cc:2804] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.696084 24967 raft_consensus.cc:697] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:45.696789 24967 consensus_queue.cc:237] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.700691 24554 catalog_manager.cc:5697] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.714021 24554 catalog_manager.cc:5697] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.725119 24967 raft_consensus.cc:493] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.725620 24967 raft_consensus.cc:515] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.727200 24967 leader_election.cc:290] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.727823 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.728075 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.728461 24732 raft_consensus.cc:2468] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.728767 24805 raft_consensus.cc:2468] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 0.
I20260709 12:27:45.729527 24622 leader_election.cc:304] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.730301 24967 raft_consensus.cc:2804] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:45.730607 24967 raft_consensus.cc:493] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.730875 24967 raft_consensus.cc:3060] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.735862 24967 raft_consensus.cc:515] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.738009 24967 leader_election.cc:290] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.738286 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:45.738569 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:45.738895 24732 raft_consensus.cc:3060] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.739143 24805 raft_consensus.cc:3060] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.745983 24805 raft_consensus.cc:2468] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.745987 24732 raft_consensus.cc:2468] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 1.
I20260709 12:27:45.747170 24621 leader_election.cc:304] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:45.747828 24967 raft_consensus.cc:2804] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:45.748260 24967 raft_consensus.cc:697] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:45.749168 24967 consensus_queue.cc:237] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.755740 24554 catalog_manager.cc:5697] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.786206 24967 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.786649 24967 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.788851 24967 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.789629 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.789834 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.790485 24732 raft_consensus.cc:2393] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d3390139ca74e6692e72ce6decd8a35 in current term 1: Already voted for candidate 1bff2b69967f4234a5781e7a261c603f in this term.
I20260709 12:27:45.790701 24805 raft_consensus.cc:2393] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d3390139ca74e6692e72ce6decd8a35 in current term 1: Already voted for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in this term.
I20260709 12:27:45.792068 24622 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:45.792716 24967 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.797672 24967 raft_consensus.cc:2749] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.802990 24804 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.808265 24949 consensus_queue.cc:1048] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.818475 24732 raft_consensus.cc:3060] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.823259 24960 consensus_queue.cc:1048] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.830185 24964 consensus_queue.cc:1048] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.841192 24972 consensus_queue.cc:1048] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.843793 24970 consensus_queue.cc:1048] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.844547 24851 consensus_queue.cc:1048] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.873339 24967 raft_consensus.cc:493] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.873854 24967 raft_consensus.cc:515] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:45.875957 24967 leader_election.cc:290] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:45.877730 24732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff2b69967f4234a5781e7a261c603f" is_pre_election: true
I20260709 12:27:45.878171 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac381f21a2b64525bbd3bf60fb314a7a" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:45.878589 24732 raft_consensus.cc:2393] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d3390139ca74e6692e72ce6decd8a35 in current term 1: Already voted for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in this term.
I20260709 12:27:45.879674 24621 leader_election.cc:304] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d3390139ca74e6692e72ce6decd8a35; no voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:45.880896 24967 raft_consensus.cc:3060] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:45.887310 24967 raft_consensus.cc:2749] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:45.932260 24967 consensus_queue.cc:1048] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.942866 24970 consensus_queue.cc:1048] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:46.081027 24603 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:46.101739 24851 consensus_queue.cc:1048] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.113230 24964 consensus_queue.cc:1048] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.125634 24970 consensus_queue.cc:1048] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.135448 24950 consensus_queue.cc:1048] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.157140 24950 consensus_queue.cc:1048] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.167785 24950 consensus_queue.cc:1048] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.220721 24950 consensus_queue.cc:1048] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:46.230211 24967 consensus_queue.cc:1048] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:47.083950 24603 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:47.420954 24930 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.421561 24930 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:47.423761 24930 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:47.425189 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" is_pre_election: true
I20260709 12:27:47.425998 24805 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 1.
I20260709 12:27:47.426406 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35" is_pre_election: true
I20260709 12:27:47.427146 24655 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 1.
I20260709 12:27:47.427217 24696 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:47.428122 24930 raft_consensus.cc:2804] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:47.428534 24930 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.428903 24930 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:47.434437 24930 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:47.436079 24930 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:47.436647 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:47.437139 24655 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:47.437088 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:47.437728 24805 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:47.442013 24655 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:47.442545 24805 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:47.442873 24695 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:47.443660 24930 raft_consensus.cc:2804] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:47.444051 24930 raft_consensus.cc:697] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:47.444670 24930 consensus_queue.cc:237] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:47.452108 24555 catalog_manager.cc:5697] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 0 to 2, leader changed from <none> to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.848778 24655 raft_consensus.cc:1275] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:47.853220 24960 consensus_queue.cc:1048] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.914660 24805 raft_consensus.cc:1275] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:47.916301 24930 consensus_queue.cc:1048] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.938452 24730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
mode: GRACEFUL
new_leader_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:49744
I20260709 12:27:47.939050 24730 raft_consensus.cc:606] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Received request to transfer leadership to TS 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:47.946235 24730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
mode: GRACEFUL
new_leader_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:49744
I20260709 12:27:47.946714 24730 raft_consensus.cc:606] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Received request to transfer leadership to TS 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:47.951300 24805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e78ff4984192494f9608daab2c65c726"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
mode: GRACEFUL
new_leader_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:41982
I20260709 12:27:47.951799 24805 raft_consensus.cc:606] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Received request to transfer leadership to TS 8d3390139ca74e6692e72ce6decd8a35
I20260709 12:27:47.956311 24656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:47.956777 24656 raft_consensus.cc:606] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:47.961382 24656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:47.962090 24656 raft_consensus.cc:606] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:47.966315 24656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:47.966703 24656 raft_consensus.cc:606] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:47.970808 24656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:39428
I20260709 12:27:47.971194 24656 raft_consensus.cc:606] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 1bff2b69967f4234a5781e7a261c603f
I20260709 12:27:47.995476 25018 raft_consensus.cc:993] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:47.995882 24972 raft_consensus.cc:1081] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:47.997141 24730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:47.997624 24730 raft_consensus.cc:493] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:47.998024 24730 raft_consensus.cc:3060] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.002635 25018 raft_consensus.cc:993] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:48.003123 24972 raft_consensus.cc:1081] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:48.004709 24729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:48.005244 24729 raft_consensus.cc:493] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.005005 24730 raft_consensus.cc:515] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.005656 24729 raft_consensus.cc:3060] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.007678 24730 leader_election.cc:290] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.007694 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:48.008486 24656 raft_consensus.cc:3055] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.008821 24656 raft_consensus.cc:740] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.009541 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fdf111c2a074317827ab0b0252e29fd" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.009650 24656 consensus_queue.cc:260] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.010279 24805 raft_consensus.cc:3060] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.011065 24656 raft_consensus.cc:3060] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.011799 24729 raft_consensus.cc:515] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.013389 24729 leader_election.cc:290] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.014019 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:48.014586 24655 raft_consensus.cc:3055] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.014850 24655 raft_consensus.cc:740] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.015208 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e992d8c0f9c1492aae8a4609160dd7dc" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.015722 24804 raft_consensus.cc:3060] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.015839 24655 consensus_queue.cc:260] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.017024 24655 raft_consensus.cc:3060] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.017812 24805 raft_consensus.cc:2468] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.018920 24656 raft_consensus.cc:2468] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.018894 24696 leader_election.cc:304] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:48.020160 25019 raft_consensus.cc:2804] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.020517 25019 raft_consensus.cc:697] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:48.021253 25019 consensus_queue.cc:237] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.022401 24804 raft_consensus.cc:2468] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.023916 24655 raft_consensus.cc:2468] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.024997 24695 leader_election.cc:304] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:48.026439 25019 raft_consensus.cc:2804] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.027226 25019 raft_consensus.cc:697] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:48.027943 25019 consensus_queue.cc:237] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.031665 24555 catalog_manager.cc:5697] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.044692 24555 catalog_manager.cc:5697] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.324824 24964 raft_consensus.cc:993] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: : Instructing follower 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:48.325340 25022 raft_consensus.cc:1081] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Signalling peer 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:48.326680 24655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e78ff4984192494f9608daab2c65c726"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:39396
I20260709 12:27:48.327117 24655 raft_consensus.cc:493] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.327378 24655 raft_consensus.cc:3060] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.331967 24655 raft_consensus.cc:515] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.333617 24655 leader_election.cc:290] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.334281 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78ff4984192494f9608daab2c65c726" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:48.334877 24729 raft_consensus.cc:3060] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.335069 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78ff4984192494f9608daab2c65c726" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.335580 24805 raft_consensus.cc:3055] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.335807 24805 raft_consensus.cc:740] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:48.336355 24805 consensus_queue.cc:260] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.337337 24805 raft_consensus.cc:3060] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.339550 24729 raft_consensus.cc:2468] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:48.340894 24622 leader_election.cc:304] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:48.341918 25018 raft_consensus.cc:2804] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.342347 25018 raft_consensus.cc:697] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.342995 24972 raft_consensus.cc:993] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:48.343147 24805 raft_consensus.cc:2468] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:48.343556 24972 raft_consensus.cc:1081] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:48.343151 25018 consensus_queue.cc:237] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.345093 24729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:48.345482 25019 raft_consensus.cc:993] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: : Instructing follower 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:48.345613 24729 raft_consensus.cc:493] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.345976 24960 raft_consensus.cc:1081] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Signalling peer 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:48.346076 24729 raft_consensus.cc:3060] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.350049 24655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:39412
I20260709 12:27:48.350477 24655 raft_consensus.cc:493] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.350855 24655 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.351969 24729 raft_consensus.cc:515] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.353464 24729 leader_election.cc:290] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.353320 24555 catalog_manager.cc:5697] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 1 to 2, leader changed from 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67) to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.354111 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:48.354739 24656 raft_consensus.cc:3055] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.355052 24656 raft_consensus.cc:740] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.355662 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c794abe3cf0f41d59fc5824e5ed8b449" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.356227 24805 raft_consensus.cc:3060] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.355804 24656 consensus_queue.cc:260] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.357107 24656 raft_consensus.cc:3060] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.358711 24655 raft_consensus.cc:515] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.362337 24805 raft_consensus.cc:2468] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.363188 24655 leader_election.cc:290] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.363847 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:48.364493 24729 raft_consensus.cc:3055] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.364840 24729 raft_consensus.cc:740] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:48.365207 24656 raft_consensus.cc:2468] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.365630 24729 consensus_queue.cc:260] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.366451 24695 leader_election.cc:304] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:48.366887 24729 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.366798 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.367272 24960 raft_consensus.cc:2804] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.367555 24805 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.367811 24960 raft_consensus.cc:697] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:48.368607 24960 consensus_queue.cc:237] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.372023 24805 raft_consensus.cc:2468] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:48.373138 24729 raft_consensus.cc:2468] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 2.
I20260709 12:27:48.374472 24622 leader_election.cc:304] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:48.375144 25018 raft_consensus.cc:2804] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.375627 25018 raft_consensus.cc:697] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.376374 25018 consensus_queue.cc:237] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.384528 24555 catalog_manager.cc:5697] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.384610 24552 catalog_manager.cc:5697] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 1 to 2, leader changed from 1bff2b69967f4234a5781e7a261c603f (127.14.78.66) to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.389873 25019 raft_consensus.cc:993] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: : Instructing follower 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:48.390357 25019 raft_consensus.cc:1081] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Signalling peer 8d3390139ca74e6692e72ce6decd8a35 to start an election
I20260709 12:27:48.392096 24656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
 from {username='slave'} at 127.0.0.1:39412
I20260709 12:27:48.392408 25018 raft_consensus.cc:993] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:48.392704 24656 raft_consensus.cc:493] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.392989 24967 raft_consensus.cc:1081] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 1bff2b69967f4234a5781e7a261c603f to start an election
I20260709 12:27:48.393186 24656 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.394658 24729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
 from {username='slave'} at 127.0.0.1:49726
I20260709 12:27:48.395277 24729 raft_consensus.cc:493] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:48.396150 24729 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.401499 24656 raft_consensus.cc:515] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.403240 24656 leader_election.cc:290] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 3 election: Requested vote from peers 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.403293 24729 raft_consensus.cc:515] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.403853 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:48.404452 24730 raft_consensus.cc:3055] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:48.404848 24730 raft_consensus.cc:740] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:48.405637 24805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222e4e450f6a4cc2a087af9f14b4775d" candidate_uuid: "8d3390139ca74e6692e72ce6decd8a35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.406059 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:48.406375 24805 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.406603 24656 raft_consensus.cc:3055] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:48.406970 24656 raft_consensus.cc:740] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.407791 24656 consensus_queue.cc:260] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.408619 24656 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.411556 24730 consensus_queue.cc:260] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.413125 24730 raft_consensus.cc:3060] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.413061 24805 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 3.
I20260709 12:27:48.414881 24621 leader_election.cc:304] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:48.415347 24656 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.415755 24967 raft_consensus.cc:2804] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:48.416301 24967 raft_consensus.cc:697] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 3 LEADER]: Becoming Leader. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:48.417232 24804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "1bff2b69967f4234a5781e7a261c603f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
I20260709 12:27:48.417160 24967 consensus_queue.cc:237] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.417922 24804 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.420171 24730 raft_consensus.cc:2468] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d3390139ca74e6692e72ce6decd8a35 in term 3.
I20260709 12:27:48.421880 24695 leader_election.cc:304] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:48.422802 25019 raft_consensus.cc:2804] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.423625 24729 leader_election.cc:290] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639)
I20260709 12:27:48.426584 24804 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bff2b69967f4234a5781e7a261c603f in term 2.
I20260709 12:27:48.426827 24555 catalog_manager.cc:5697] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 reported cstate change: term changed from 2 to 3, leader changed from 1bff2b69967f4234a5781e7a261c603f (127.14.78.66) to 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "8d3390139ca74e6692e72ce6decd8a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.428359 25019 raft_consensus.cc:697] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Leader. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:48.429301 25019 consensus_queue.cc:237] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:48.437335 24552 catalog_manager.cc:5697] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 1bff2b69967f4234a5781e7a261c603f (127.14.78.66). New cstate: current_term: 2 leader_uuid: "1bff2b69967f4234a5781e7a261c603f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:48.475801 24656 raft_consensus.cc:1275] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.477073 25036 consensus_queue.cc:1048] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.478259 24804 raft_consensus.cc:1275] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.479815 25036 consensus_queue.cc:1048] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.501155 24804 raft_consensus.cc:1275] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.501637 24656 raft_consensus.cc:1275] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.502776 25019 consensus_queue.cc:1048] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.505352 25019 consensus_queue.cc:1048] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:48.629240 24678 debug-util.cc:398] Leaking SignalData structure 0x7b08000626e0 after lost signal to thread 14652
W20260709 12:27:48.630355 24678 debug-util.cc:398] Leaking SignalData structure 0x7b08003e50c0 after lost signal to thread 24589
W20260709 12:27:48.631453 24678 debug-util.cc:398] Leaking SignalData structure 0x7b080022f100 after lost signal to thread 24681
W20260709 12:27:48.633020 24678 debug-util.cc:398] Leaking SignalData structure 0x7b08000f4c20 after lost signal to thread 24830
I20260709 12:27:48.746227 24729 raft_consensus.cc:1275] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.747552 24967 consensus_queue.cc:1048] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.757687 24804 raft_consensus.cc:1275] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.759066 24972 consensus_queue.cc:1048] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.796779 24804 raft_consensus.cc:1275] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.798097 24972 consensus_queue.cc:1048] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.809840 24729 raft_consensus.cc:1275] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.811592 24972 consensus_queue.cc:1048] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.816478 24804 raft_consensus.cc:1275] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:48.819424 24972 consensus_queue.cc:1048] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.831387 24729 raft_consensus.cc:1275] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Refusing update from remote peer 8d3390139ca74e6692e72ce6decd8a35: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:48.833204 25017 consensus_queue.cc:1048] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.858192 24805 raft_consensus.cc:1275] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.859360 24960 consensus_queue.cc:1048] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.870995 24655 raft_consensus.cc:1275] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.873308 25036 consensus_queue.cc:1048] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.901957 24805 raft_consensus.cc:1275] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.903156 25036 consensus_queue.cc:1048] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:48.914321 24655 raft_consensus.cc:1275] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 1bff2b69967f4234a5781e7a261c603f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:48.915714 25036 consensus_queue.cc:1048] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.976503 24554 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55764:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:50.997351 24554 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55764:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:51.028577 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:51.241883 25092 tablet.cc:1724] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:51.245645 25087 log.cc:927] Time spent T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:27:51.271041 25080 log.cc:927] Time spent T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:27:51.298319 25077 log.cc:927] Time spent T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:27:51.310992 24656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:27:51.311029 25094 tablet.cc:1724] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.311859 24656 raft_consensus.cc:606] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Received request to transfer leadership to TS 4d9a3ef1de664b39b7fdb5af753c47c2
W20260709 12:27:51.430131 24622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.66:35421, user_credentials={real_user=slave}} blocked reactor thread for 78776.7us
W20260709 12:27:51.438611 24832 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:222e4e450f6a4cc2a087af9f14b4775d)
I20260709 12:27:51.429733 25119 tablet.cc:1724] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:51.440178 25108 log.cc:927] Time spent T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:27:51.447099 24832 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:222e4e450f6a4cc2a087af9f14b4775d)
W20260709 12:27:51.449210 24832 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:222e4e450f6a4cc2a087af9f14b4775d)
W20260709 12:27:51.470479 25107 log.cc:927] Time spent T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:27:51.460043 25117 tablet.cc:1724] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.448776 25114 tablet.cc:1724] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:51.488739 25112 log.cc:927] Time spent T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 12:27:51.510871 25120 tablet.cc:1724] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:51.520558 25104 log.cc:927] Time spent T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260709 12:27:51.522233 25106 log.cc:927] Time spent T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:27:51.519809 25111 tablet.cc:1724] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:51.528296 24621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:42639, user_credentials={real_user=slave}} blocked reactor thread for 55427.8us
I20260709 12:27:51.536043 25122 tablet.cc:1724] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.539616 24967 raft_consensus.cc:993] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:51.540287 25115 raft_consensus.cc:1081] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Signalling peer 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:51.544128 25121 tablet.cc:1724] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.551676 25094 tablet.cc:1724] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.552157 25092 tablet.cc:1724] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.554209 25120 tablet.cc:1724] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.558533 25114 tablet.cc:1724] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.569526 24803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:41960
I20260709 12:27:51.570132 24803 raft_consensus.cc:493] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.570510 24803 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.575591 25128 tablet.cc:1724] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.597506 25122 tablet.cc:1724] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.582342 25092 tablet.cc:1724] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.588657 24730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
mode: GRACEFUL
new_leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:45976
I20260709 12:27:51.592898 25114 tablet.cc:1724] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.580317 24803 raft_consensus.cc:515] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.624287 24804 raft_consensus.cc:1240] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Rejecting Update request from peer 8d3390139ca74e6692e72ce6decd8a35 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:51.624877 24730 raft_consensus.cc:606] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Received request to transfer leadership to TS 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:51.602779 25117 tablet.cc:1724] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.609207 25126 tablet.cc:1724] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.616482 25111 tablet.cc:1724] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.629784 25118 consensus_queue.cc:1059] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:51.630666 25118 raft_consensus.cc:3055] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.631023 25118 raft_consensus.cc:740] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:51.631793 25118 consensus_queue.cc:260] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.611950 25119 tablet.cc:1724] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.621945 25094 tablet.cc:1724] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.627066 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:27:51.633749 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:51.639477 25044 raft_consensus.cc:993] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: : Instructing follower 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:51.640117 25098 raft_consensus.cc:1081] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Signalling peer 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:51.638375 25118 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.648272 24655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98bf2205616a4637b919f36f387a4230"
dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
mode: GRACEFUL
new_leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:27:51.649422 24655 raft_consensus.cc:606] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Received request to transfer leadership to TS 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:51.651351 24803 leader_election.cc:290] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 3 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:51.652362 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:51.653127 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d146e2166a744538f75bf3b26770f81" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:51.653762 24730 raft_consensus.cc:3060] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.660089 24728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3"
dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
mode: GRACEFUL
new_leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:45976
I20260709 12:27:51.660732 24728 raft_consensus.cc:606] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Received request to transfer leadership to TS 4d9a3ef1de664b39b7fdb5af753c47c2
I20260709 12:27:51.662914 24730 raft_consensus.cc:2468] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 3.
I20260709 12:27:51.663472 24801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:41966
I20260709 12:27:51.665191 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:51.624305 25121 tablet.cc:1724] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.671917 24655 raft_consensus.cc:2468] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 3.
I20260709 12:27:51.669734 25128 tablet.cc:1724] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.681021 25126 tablet.cc:1724] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.695957 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:51.698457 24801 raft_consensus.cc:493] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.698915 24801 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.680161 25120 tablet.cc:1724] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:51.709697 24769 leader_election.cc:304] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:51.710529 25022 raft_consensus.cc:2804] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:51.711012 25022 raft_consensus.cc:697] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:51.711812 25022 consensus_queue.cc:237] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.729425 24801 raft_consensus.cc:515] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.732560 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:51.732870 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cea60c5eaed44159f39640911e4b0f7" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:51.733338 24655 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.733630 24730 raft_consensus.cc:3055] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.734025 24730 raft_consensus.cc:740] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:51.734905 24730 consensus_queue.cc:260] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.736128 24730 raft_consensus.cc:3060] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.741411 24655 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 3.
I20260709 12:27:51.742162 25085 raft_consensus.cc:993] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: : Instructing follower 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:51.742599 24769 leader_election.cc:304] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:51.742652 25085 raft_consensus.cc:1081] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Signalling peer 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:51.743566 25022 raft_consensus.cc:2804] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:51.743846 24730 raft_consensus.cc:2468] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 3.
I20260709 12:27:51.744114 25022 raft_consensus.cc:697] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:51.745059 24803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:41966
I20260709 12:27:51.745235 24801 leader_election.cc:290] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 3 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:51.745779 24803 raft_consensus.cc:493] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.745186 25022 consensus_queue.cc:237] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.746225 24803 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.752470 24803 raft_consensus.cc:515] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.754418 24803 leader_election.cc:290] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 3 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:51.755055 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:51.755628 24655 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.755508 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8a7a56ccab41cc92bf800a3bcd4cc3" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:51.756294 24730 raft_consensus.cc:3055] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.756623 24730 raft_consensus.cc:740] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1bff2b69967f4234a5781e7a261c603f, State: Running, Role: LEADER
I20260709 12:27:51.757494 24730 consensus_queue.cc:260] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.758867 24730 raft_consensus.cc:3060] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.760164 24552 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881: soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c] alter complete (version 1)
I20260709 12:27:51.763885 24655 raft_consensus.cc:2468] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 3.
I20260709 12:27:51.765125 24769 leader_election.cc:304] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d9a3ef1de664b39b7fdb5af753c47c2, 8d3390139ca74e6692e72ce6decd8a35; no voters: 
I20260709 12:27:51.765990 25022 raft_consensus.cc:2804] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:51.766456 25022 raft_consensus.cc:697] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:51.767266 25022 consensus_queue.cc:237] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:51.769614 24730 raft_consensus.cc:2468] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 3.
I20260709 12:27:51.771989 24553 catalog_manager.cc:5697] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 2 to 3, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:51.773952 24553 catalog_manager.cc:5789] TS 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67:42639) does not have the latest schema for tablet 1d146e2166a744538f75bf3b26770f81 (table soft_deleted_table [id=778ca80dc99941efa59f466f7fd9e34c]). Expected version 1 got 0
I20260709 12:27:51.774904 24553 catalog_manager.cc:5697] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 2 to 3, leader changed from 1bff2b69967f4234a5781e7a261c603f (127.14.78.66) to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:51.796501 24553 catalog_manager.cc:5697] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 2 to 3, leader changed from 1bff2b69967f4234a5781e7a261c603f (127.14.78.66) to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 3 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.014158 25118 raft_consensus.cc:993] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: : Instructing follower 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:52.014802 25127 raft_consensus.cc:1081] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Signalling peer 4d9a3ef1de664b39b7fdb5af753c47c2 to start an election
I20260709 12:27:52.016533 24803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98bf2205616a4637b919f36f387a4230"
dest_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2"
 from {username='slave'} at 127.0.0.1:41960
I20260709 12:27:52.017133 24803 raft_consensus.cc:493] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.017508 24803 raft_consensus.cc:3060] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.022496 24803 raft_consensus.cc:515] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:52.024144 24803 leader_election.cc:290] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 2 election: Requested vote from peers 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621), 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421)
I20260709 12:27:52.025264 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bf2205616a4637b919f36f387a4230" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bff2b69967f4234a5781e7a261c603f"
I20260709 12:27:52.025805 24728 raft_consensus.cc:3060] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.031210 24728 raft_consensus.cc:2468] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 2.
I20260709 12:27:52.032277 24771 leader_election.cc:304] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff2b69967f4234a5781e7a261c603f, 4d9a3ef1de664b39b7fdb5af753c47c2; no voters: 
I20260709 12:27:52.032477 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bf2205616a4637b919f36f387a4230" candidate_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d3390139ca74e6692e72ce6decd8a35"
I20260709 12:27:52.033084 24655 raft_consensus.cc:3055] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.033198 25022 raft_consensus.cc:2804] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.033464 24655 raft_consensus.cc:740] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d3390139ca74e6692e72ce6decd8a35, State: Running, Role: LEADER
I20260709 12:27:52.033795 25022 raft_consensus.cc:697] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 LEADER]: Becoming Leader. State: Replica: 4d9a3ef1de664b39b7fdb5af753c47c2, State: Running, Role: LEADER
I20260709 12:27:52.034458 24655 consensus_queue.cc:260] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:52.035727 24655 raft_consensus.cc:3060] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.035372 25022 consensus_queue.cc:237] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } }
I20260709 12:27:52.045564 24655 raft_consensus.cc:2468] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d9a3ef1de664b39b7fdb5af753c47c2 in term 2.
I20260709 12:27:52.051142 24553 catalog_manager.cc:5697] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 reported cstate change: term changed from 1 to 2, leader changed from 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65) to 4d9a3ef1de664b39b7fdb5af753c47c2 (127.14.78.67). New cstate: current_term: 2 leader_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d9a3ef1de664b39b7fdb5af753c47c2" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 42639 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.144528 24655 raft_consensus.cc:1275] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:52.145735 25022 consensus_queue.cc:1048] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:52.151825 25117 tablet.cc:1724] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:52.164529 24652 raft_consensus.cc:1275] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:52.168737 24730 raft_consensus.cc:1275] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:52.168737 24728 raft_consensus.cc:1275] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:52.167121 25138 consensus_queue.cc:1048] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:27:52.172336 25022 consensus_queue.cc:1048] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:52.174502 25136 consensus_queue.cc:1048] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:27:52.218528 24731 raft_consensus.cc:1275] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:52.220516 25136 consensus_queue.cc:1048] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:52.232867 25117 tablet.cc:1719] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:27:52.234862 25086 mvcc.cc:204] Tried to move back new op lower bound from 7305625895623356416 to 7305625893742424064. Current Snapshot: MvccSnapshot[applied={T|T < 7305625895623356416}]
I20260709 12:27:52.261933 25146 tablet.cc:1719] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:27:52.264374 24652 raft_consensus.cc:1275] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:52.266884 25022 consensus_queue.cc:1048] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:52.277733 25147 tablet.cc:1719] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: Skipping requested alter to schema version 1, tablet already version 1
I20260709 12:27:52.607686 24731 raft_consensus.cc:1275] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:52.608762 25075 consensus_queue.cc:1048] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff2b69967f4234a5781e7a261c603f" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:52.616137 24652 raft_consensus.cc:1275] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Refusing update from remote peer 4d9a3ef1de664b39b7fdb5af753c47c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:52.617762 25075 consensus_queue.cc:1048] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d3390139ca74e6692e72ce6decd8a35" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:52.697186 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:52.703310 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:52.703817 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:52.708935 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:52.709358 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:53.710531 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:53.716456 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:53.716966 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:53.722451 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:53.722755 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:54.723706 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:54.729235 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:54.729632 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:54.735453 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:54.735891 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:55.737071 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:55.742908 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:55.743348 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:55.748060 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:55.748566 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:56.781754 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:56.787406 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:56.787779 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:56.792486 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:56.792791 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:27:56.955520 24586 debug-util.cc:398] Leaking SignalData structure 0x7b080013f4c0 after lost signal to thread 14652
W20260709 12:27:56.956661 24586 debug-util.cc:398] Leaking SignalData structure 0x7b08002b00e0 after lost signal to thread 24589
W20260709 12:27:56.957796 24586 debug-util.cc:398] Leaking SignalData structure 0x7b0800138fe0 after lost signal to thread 24681
W20260709 12:27:56.958717 24586 debug-util.cc:398] Leaking SignalData structure 0x7b080023cf80 after lost signal to thread 24756
W20260709 12:27:56.959931 24586 debug-util.cc:398] Leaking SignalData structure 0x7b080026e700 after lost signal to thread 24830
I20260709 12:27:57.793712 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:57.799127 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:57.799539 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:57.804252 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:57.804630 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:58.805651 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:58.810781 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:58.811249 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:58.815789 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:58.816152 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:59.817133 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:59.823951 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:59.824421 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:59.829596 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:59.830017 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:00.830941 14649 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:00.836125 14649 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:00.836568 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:00.841156 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:00.841511 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:01.899668 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
W20260709 12:28:01.919302 24695 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:28:01.927074 24695 consensus_peers.cc:597] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:01.941546 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:01.942399 14649 tablet_replica.cc:333] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.943320 14649 raft_consensus.cc:2243] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.944132 14649 raft_consensus.cc:2272] T c794abe3cf0f41d59fc5824e5ed8b449 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.947618 14649 tablet_replica.cc:333] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.948508 14649 raft_consensus.cc:2243] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.949079 14649 raft_consensus.cc:2272] T e992d8c0f9c1492aae8a4609160dd7dc P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.951442 14649 tablet_replica.cc:333] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.952124 14649 raft_consensus.cc:2243] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.952623 14649 raft_consensus.cc:2272] T 2fdf111c2a074317827ab0b0252e29fd P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.954990 14649 tablet_replica.cc:333] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.955489 14649 raft_consensus.cc:2243] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:01.956314 14649 raft_consensus.cc:2272] T 222e4e450f6a4cc2a087af9f14b4775d P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.958707 14649 tablet_replica.cc:333] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.959249 14649 raft_consensus.cc:2243] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:01.960016 14649 raft_consensus.cc:2272] T e78ff4984192494f9608daab2c65c726 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.962416 14649 tablet_replica.cc:333] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.962915 14649 raft_consensus.cc:2243] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.963541 14649 raft_consensus.cc:2272] T 1d146e2166a744538f75bf3b26770f81 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.966537 14649 tablet_replica.cc:333] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.967252 14649 raft_consensus.cc:2243] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.967854 14649 raft_consensus.cc:2272] T 20529acf8d714ca39c0e8ce721456d00 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.970268 14649 tablet_replica.cc:333] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.970726 14649 raft_consensus.cc:2243] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:01.971575 14649 raft_consensus.cc:2272] T cc5a1009b07548898666e65ed65e5ac7 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.973961 14649 tablet_replica.cc:333] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.974530 14649 raft_consensus.cc:2243] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:01.975237 14649 raft_consensus.cc:2272] T c525668f0eab4ebca90c9be91dff4f7c P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.977542 14649 tablet_replica.cc:333] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.978024 14649 raft_consensus.cc:2243] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.978495 14649 raft_consensus.cc:2272] T ac381f21a2b64525bbd3bf60fb314a7a P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.981422 14649 tablet_replica.cc:333] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.982223 14649 raft_consensus.cc:2243] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.982656 14649 raft_consensus.cc:2272] T fd2e8675e57c4b249478828cfeef93f3 P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.984895 14649 tablet_replica.cc:333] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.985435 14649 raft_consensus.cc:2243] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.985951 14649 raft_consensus.cc:2272] T 3cea60c5eaed44159f39640911e4b0f7 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.988879 14649 tablet_replica.cc:333] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.989655 14649 raft_consensus.cc:2243] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:01.990928 14649 raft_consensus.cc:2272] T d7bc1edf0ab845bd988ff493c1c3d17b P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:01.991351 24769 consensus_peers.cc:597] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:01.993680 14649 tablet_replica.cc:333] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.994395 14649 raft_consensus.cc:2243] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.995203 14649 raft_consensus.cc:2272] T e85c32da046a4f30b9190e15c2fce27f P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:01.998113 14649 tablet_replica.cc:333] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:01.998693 14649 raft_consensus.cc:2243] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:01.999163 14649 raft_consensus.cc:2272] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 8d3390139ca74e6692e72ce6decd8a35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.001570 14649 tablet_replica.cc:333] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:02.002104 14649 raft_consensus.cc:2243] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.002535 14649 raft_consensus.cc:2272] T 98bf2205616a4637b919f36f387a4230 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.004750 14649 tablet_replica.cc:333] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:02.005419 14649 raft_consensus.cc:2243] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.006559 14649 raft_consensus.cc:2272] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 8d3390139ca74e6692e72ce6decd8a35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:02.010190 24695 consensus_peers.cc:597] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.010185 14649 tablet_replica.cc:333] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35: stopping tablet replica
I20260709 12:28:02.010977 14649 raft_consensus.cc:2243] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.011651 14649 raft_consensus.cc:2272] T 8edb6eab46c14dab81a81fe18e097266 P 8d3390139ca74e6692e72ce6decd8a35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.073132 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
W20260709 12:28:02.083068 24769 consensus_peers.cc:597] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:43621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:02.093706 24769 consensus_peers.cc:597] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:43621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.119234 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
I20260709 12:28:02.149667 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:02.150578 14649 tablet_replica.cc:333] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.151891 14649 raft_consensus.cc:2243] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.152768 14649 raft_consensus.cc:2272] T e992d8c0f9c1492aae8a4609160dd7dc P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.155053 14649 tablet_replica.cc:333] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.155607 14649 raft_consensus.cc:2243] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.156426 14649 raft_consensus.cc:2272] T 2fdf111c2a074317827ab0b0252e29fd P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.158746 14649 tablet_replica.cc:333] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.159282 14649 raft_consensus.cc:2243] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.159720 14649 raft_consensus.cc:2272] T e78ff4984192494f9608daab2c65c726 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.161819 14649 tablet_replica.cc:333] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.162343 14649 raft_consensus.cc:2243] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.162834 14649 raft_consensus.cc:2272] T 222e4e450f6a4cc2a087af9f14b4775d P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.164896 14649 tablet_replica.cc:333] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.165493 14649 raft_consensus.cc:2243] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.166260 14649 raft_consensus.cc:2272] T c794abe3cf0f41d59fc5824e5ed8b449 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.168491 14649 tablet_replica.cc:333] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.169143 14649 raft_consensus.cc:2243] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.169837 14649 raft_consensus.cc:2272] T 1d146e2166a744538f75bf3b26770f81 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.172106 14649 tablet_replica.cc:333] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.172610 14649 raft_consensus.cc:2243] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.173476 14649 raft_consensus.cc:2272] T fd2e8675e57c4b249478828cfeef93f3 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.175590 14649 tablet_replica.cc:333] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.176159 14649 raft_consensus.cc:2243] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.176614 14649 raft_consensus.cc:2272] T ac381f21a2b64525bbd3bf60fb314a7a P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.178678 14649 tablet_replica.cc:333] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.179174 14649 raft_consensus.cc:2243] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.179620 14649 raft_consensus.cc:2272] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.181600 14649 tablet_replica.cc:333] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.182277 14649 raft_consensus.cc:2243] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.183195 14649 raft_consensus.cc:2272] T e85c32da046a4f30b9190e15c2fce27f P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.185115 14649 tablet_replica.cc:333] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.185654 14649 raft_consensus.cc:2243] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.186077 14649 raft_consensus.cc:2272] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.187988 14649 tablet_replica.cc:333] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.188442 14649 raft_consensus.cc:2243] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.189213 14649 raft_consensus.cc:2272] T 8edb6eab46c14dab81a81fe18e097266 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.191277 14649 tablet_replica.cc:333] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.191756 14649 raft_consensus.cc:2243] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.192215 14649 raft_consensus.cc:2272] T 98bf2205616a4637b919f36f387a4230 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.194905 14649 tablet_replica.cc:333] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.195525 14649 raft_consensus.cc:2243] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:02.195647 24771 consensus_peers.cc:597] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Couldn't send request to peer 1bff2b69967f4234a5781e7a261c603f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.196123 14649 raft_consensus.cc:2272] T c525668f0eab4ebca90c9be91dff4f7c P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.198680 14649 tablet_replica.cc:333] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.199178 14649 raft_consensus.cc:2243] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.199621 14649 raft_consensus.cc:2272] T 20529acf8d714ca39c0e8ce721456d00 P 1bff2b69967f4234a5781e7a261c603f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:02.200723 24771 consensus_peers.cc:597] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Couldn't send request to peer 1bff2b69967f4234a5781e7a261c603f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.201988 14649 tablet_replica.cc:333] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.202544 14649 raft_consensus.cc:2243] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.202992 14649 raft_consensus.cc:2272] T cc5a1009b07548898666e65ed65e5ac7 P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.204959 14649 tablet_replica.cc:333] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.205502 14649 raft_consensus.cc:2243] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.205989 14649 raft_consensus.cc:2272] T 3cea60c5eaed44159f39640911e4b0f7 P 1bff2b69967f4234a5781e7a261c603f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.208052 14649 tablet_replica.cc:333] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f: stopping tablet replica
I20260709 12:28:02.208621 14649 raft_consensus.cc:2243] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.209108 14649 raft_consensus.cc:2272] T d7bc1edf0ab845bd988ff493c1c3d17b P 1bff2b69967f4234a5781e7a261c603f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:02.239418 24771 consensus_peers.cc:597] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 1bff2b69967f4234a5781e7a261c603f (127.14.78.66:35421): Couldn't send request to peer 1bff2b69967f4234a5781e7a261c603f. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:35421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.252971 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
W20260709 12:28:02.255034 24769 consensus_peers.cc:597] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:43621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.291870 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
I20260709 12:28:02.321718 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:02.322422 14649 tablet_replica.cc:333] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.323097 14649 raft_consensus.cc:2243] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.323650 14649 raft_consensus.cc:2272] T e992d8c0f9c1492aae8a4609160dd7dc P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.326021 14649 tablet_replica.cc:333] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.326625 14649 raft_consensus.cc:2243] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.327529 14649 raft_consensus.cc:2272] T 1d146e2166a744538f75bf3b26770f81 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.329658 14649 tablet_replica.cc:333] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.330225 14649 raft_consensus.cc:2243] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.330706 14649 raft_consensus.cc:2272] T c794abe3cf0f41d59fc5824e5ed8b449 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.332779 14649 tablet_replica.cc:333] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.333366 14649 raft_consensus.cc:2243] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.334044 14649 raft_consensus.cc:2272] T 2fdf111c2a074317827ab0b0252e29fd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.336583 14649 tablet_replica.cc:333] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.337235 14649 raft_consensus.cc:2243] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.337778 14649 raft_consensus.cc:2272] T 222e4e450f6a4cc2a087af9f14b4775d P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:02.338171 24769 consensus_peers.cc:597] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 -> Peer 8d3390139ca74e6692e72ce6decd8a35 (127.14.78.65:43621): Couldn't send request to peer 8d3390139ca74e6692e72ce6decd8a35. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:43621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.339998 14649 tablet_replica.cc:333] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.340610 14649 raft_consensus.cc:2243] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.341118 14649 raft_consensus.cc:2272] T e78ff4984192494f9608daab2c65c726 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.343045 14649 tablet_replica.cc:333] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.343524 14649 raft_consensus.cc:2243] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.344295 14649 raft_consensus.cc:2272] T 98bf2205616a4637b919f36f387a4230 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.346350 14649 tablet_replica.cc:333] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.346875 14649 raft_consensus.cc:2243] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.347245 14649 raft_consensus.cc:2272] T c525668f0eab4ebca90c9be91dff4f7c P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.349278 14649 tablet_replica.cc:333] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.349792 14649 raft_consensus.cc:2243] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.350507 14649 raft_consensus.cc:2272] T 20529acf8d714ca39c0e8ce721456d00 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.352496 14649 tablet_replica.cc:333] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.352962 14649 raft_consensus.cc:2243] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.353417 14649 raft_consensus.cc:2272] T cc5a1009b07548898666e65ed65e5ac7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.355418 14649 tablet_replica.cc:333] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.355907 14649 raft_consensus.cc:2243] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.356326 14649 raft_consensus.cc:2272] T 62ab20e2fa7e420c97c2af6dfbd46dcd P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.358410 14649 tablet_replica.cc:333] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.358870 14649 raft_consensus.cc:2243] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.359251 14649 raft_consensus.cc:2272] T 8edb6eab46c14dab81a81fe18e097266 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.361228 14649 tablet_replica.cc:333] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.361694 14649 raft_consensus.cc:2243] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.362092 14649 raft_consensus.cc:2272] T e85c32da046a4f30b9190e15c2fce27f P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.364151 14649 tablet_replica.cc:333] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.364606 14649 raft_consensus.cc:2243] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.365365 14649 raft_consensus.cc:2272] T fb8a7a56ccab41cc92bf800a3bcd4cc3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.367262 14649 tablet_replica.cc:333] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.367717 14649 raft_consensus.cc:2243] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.368495 14649 raft_consensus.cc:2272] T ac381f21a2b64525bbd3bf60fb314a7a P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.370376 14649 tablet_replica.cc:333] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.370827 14649 raft_consensus.cc:2243] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.371165 14649 raft_consensus.cc:2272] T fd2e8675e57c4b249478828cfeef93f3 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.372928 14649 tablet_replica.cc:333] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.373350 14649 raft_consensus.cc:2243] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.374059 14649 raft_consensus.cc:2272] T 3cea60c5eaed44159f39640911e4b0f7 P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.375919 14649 tablet_replica.cc:333] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2: stopping tablet replica
I20260709 12:28:02.376302 14649 raft_consensus.cc:2243] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.376796 14649 raft_consensus.cc:2272] T d7bc1edf0ab845bd988ff493c1c3d17b P 4d9a3ef1de664b39b7fdb5af753c47c2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.416023 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
I20260709 12:28:02.452149 14649 master.cc:562] Master@127.14.78.126:37197 shutting down...
I20260709 12:28:02.476941 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.477655 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.478006 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P f3f0241de12a4ca0a057657530656881: stopping tablet replica
I20260709 12:28:02.515733 14649 master.cc:584] Master@127.14.78.126:37197 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22684 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:28:02.571437 14649 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.78.126:42075
I20260709 12:28:02.572610 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:02.578118 25172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.578501 25173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.579348 25175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:02.579596 14649 server_base.cc:1061] running on GCE node
I20260709 12:28:02.580644 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:02.580848 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:02.581302 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600082580992 us; error 0 us; skew 500 ppm
I20260709 12:28:02.581831 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:02.584003 14649 webserver.cc:533] Webserver started at http://127.14.78.126:42051/ using document root <none> and password file <none>
I20260709 12:28:02.584489 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:02.584698 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:02.584980 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:02.586186 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/master-0-root/instance:
uuid: "a0d7848ed3f94ebeb754f85ba9c56530"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.590585 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:02.593672 25180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.594386 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:02.594656 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/master-0-root
uuid: "a0d7848ed3f94ebeb754f85ba9c56530"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.594933 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:02.607699 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:02.608834 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:02.645980 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.126:42075
I20260709 12:28:02.646106 25231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.126:42075 every 8 connection(s)
I20260709 12:28:02.649807 25232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:02.660718 25232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530: Bootstrap starting.
I20260709 12:28:02.665467 25232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.669741 25232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530: No bootstrap required, opened a new log
I20260709 12:28:02.672006 25232 raft_consensus.cc:359] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" member_type: VOTER }
I20260709 12:28:02.672407 25232 raft_consensus.cc:385] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.672684 25232 raft_consensus.cc:740] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d7848ed3f94ebeb754f85ba9c56530, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.673281 25232 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" member_type: VOTER }
I20260709 12:28:02.673761 25232 raft_consensus.cc:399] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:02.673993 25232 raft_consensus.cc:493] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:02.674265 25232 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.678778 25232 raft_consensus.cc:515] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" member_type: VOTER }
I20260709 12:28:02.679283 25232 leader_election.cc:304] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0d7848ed3f94ebeb754f85ba9c56530; no voters: 
I20260709 12:28:02.680369 25232 leader_election.cc:290] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:02.680761 25235 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.682117 25235 raft_consensus.cc:697] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 1 LEADER]: Becoming Leader. State: Replica: a0d7848ed3f94ebeb754f85ba9c56530, State: Running, Role: LEADER
I20260709 12:28:02.682789 25235 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" member_type: VOTER }
I20260709 12:28:02.683257 25232 sys_catalog.cc:565] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:02.688444 25236 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" member_type: VOTER } }
I20260709 12:28:02.689169 25236 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:02.689405 25237 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0d7848ed3f94ebeb754f85ba9c56530. Latest consensus state: current_term: 1 leader_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d7848ed3f94ebeb754f85ba9c56530" member_type: VOTER } }
I20260709 12:28:02.690143 25237 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:02.692806 25243 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:02.697690 25243 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:02.701102 14649 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:02.706389 25243 catalog_manager.cc:1383] Generated new cluster ID: 4bae043b5c214770a1b655b3462e5d96
I20260709 12:28:02.706653 25243 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:02.721319 25243 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:02.722539 25243 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:02.738919 25243 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530: Generated new TSK 0
I20260709 12:28:02.739478 25243 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:02.767769 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:02.773625 25253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.775750 25254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.778538 25256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:02.779241 14649 server_base.cc:1061] running on GCE node
I20260709 12:28:02.780200 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:02.780386 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:02.780507 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600082780496 us; error 0 us; skew 500 ppm
I20260709 12:28:02.780946 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:02.783051 14649 webserver.cc:533] Webserver started at http://127.14.78.65:40587/ using document root <none> and password file <none>
I20260709 12:28:02.783476 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:02.783627 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:02.783825 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:02.785121 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-0-root/instance:
uuid: "b111caf8dbec46cbbc4089a376eed9d8"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.789404 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:28:02.792443 25261 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.793228 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:28:02.793514 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-0-root
uuid: "b111caf8dbec46cbbc4089a376eed9d8"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.793790 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:02.805377 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:02.806484 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:02.807978 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:02.810197 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:02.810420 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.810658 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:02.810843 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.849776 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.65:42045
I20260709 12:28:02.849885 25323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.65:42045 every 8 connection(s)
I20260709 12:28:02.854449 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:02.861927 25328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.863538 25329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.867535 25331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:02.867949 14649 server_base.cc:1061] running on GCE node
I20260709 12:28:02.869509 25324 heartbeater.cc:344] Connected to a master server at 127.14.78.126:42075
I20260709 12:28:02.869653 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:02.869943 25324 heartbeater.cc:461] Registering TS with master...
W20260709 12:28:02.869993 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:02.870316 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600082870299 us; error 0 us; skew 500 ppm
I20260709 12:28:02.870894 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:02.870810 25324 heartbeater.cc:507] Master 127.14.78.126:42075 requested a full tablet report, sending...
I20260709 12:28:02.873219 25197 ts_manager.cc:194] Registered new tserver with Master: b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045)
I20260709 12:28:02.873927 14649 webserver.cc:533] Webserver started at http://127.14.78.66:36707/ using document root <none> and password file <none>
I20260709 12:28:02.874591 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:02.874833 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:02.875159 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:02.875771 25197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43256
I20260709 12:28:02.876725 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-1-root/instance:
uuid: "4a048992a7f94b00849e378603ec4ae6"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.881166 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:28:02.884354 25336 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.885332 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:02.885608 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-1-root
uuid: "4a048992a7f94b00849e378603ec4ae6"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.885843 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:02.907164 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:02.908267 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:02.909786 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:02.911918 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:02.912129 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.912385 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:02.912546 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.951545 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.66:37723
I20260709 12:28:02.951644 25398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.66:37723 every 8 connection(s)
I20260709 12:28:02.956382 14649 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:02.962910 25402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:02.965250 25403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:02.966109 14649 server_base.cc:1061] running on GCE node
W20260709 12:28:02.966794 25405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:02.967909 14649 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:02.968180 14649 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:02.968405 14649 hybrid_clock.cc:648] HybridClock initialized: now 1783600082968386 us; error 0 us; skew 500 ppm
I20260709 12:28:02.968499 25399 heartbeater.cc:344] Connected to a master server at 127.14.78.126:42075
I20260709 12:28:02.968982 25399 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:02.969210 14649 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:02.969801 25399 heartbeater.cc:507] Master 127.14.78.126:42075 requested a full tablet report, sending...
I20260709 12:28:02.972015 25197 ts_manager.cc:194] Registered new tserver with Master: 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:02.972280 14649 webserver.cc:533] Webserver started at http://127.14.78.67:35935/ using document root <none> and password file <none>
I20260709 12:28:02.972957 14649 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:02.973222 14649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:02.973562 14649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:02.973928 25197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43266
I20260709 12:28:02.975118 14649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-2-root/instance:
uuid: "af6560cefe984f6e964ec81cd195ddde"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.979542 14649 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:28:02.982754 25410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:02.983477 14649 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:28:02.983772 14649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-2-root
uuid: "af6560cefe984f6e964ec81cd195ddde"
format_stamp: "Formatted at 2026-07-09 12:28:02 on dist-test-slave-vrh7"
I20260709 12:28:02.984050 14649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:03.002792 14649 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:03.003891 14649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:03.005295 14649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:03.007404 14649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:03.007628 14649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.007872 14649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:03.008045 14649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.045748 14649 rpc_server.cc:307] RPC server started. Bound to: 127.14.78.67:45289
I20260709 12:28:03.045842 25472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.78.67:45289 every 8 connection(s)
I20260709 12:28:03.059207 25473 heartbeater.cc:344] Connected to a master server at 127.14.78.126:42075
I20260709 12:28:03.059695 25473 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:03.060408 25473 heartbeater.cc:507] Master 127.14.78.126:42075 requested a full tablet report, sending...
I20260709 12:28:03.062227 25197 ts_manager.cc:194] Registered new tserver with Master: af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.062350 14649 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013533158s
I20260709 12:28:03.063599 25197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43268
I20260709 12:28:03.086136 25197 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43274:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:03.088919 25197 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:03.162820 25364 tablet_service.cc:1511] Processing CreateTablet for tablet e55a8dfb5a094f83ba09e9acc49bbe55 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:03.164311 25364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55a8dfb5a094f83ba09e9acc49bbe55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.173271 25438 tablet_service.cc:1511] Processing CreateTablet for tablet e55a8dfb5a094f83ba09e9acc49bbe55 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:03.174712 25438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55a8dfb5a094f83ba09e9acc49bbe55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.176332 25432 tablet_service.cc:1511] Processing CreateTablet for tablet ab1dfe9b37c6480495e7ad61f3068358 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:03.177233 25431 tablet_service.cc:1511] Processing CreateTablet for tablet 6f77b9b635e4433791979648f28c0ecb (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:03.177758 25432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1dfe9b37c6480495e7ad61f3068358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.177906 25437 tablet_service.cc:1511] Processing CreateTablet for tablet 78ce2d227220499b8a45c74150b65632 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:03.178553 25431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f77b9b635e4433791979648f28c0ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.178722 25433 tablet_service.cc:1511] Processing CreateTablet for tablet 94639ef55f6d46d8b77e672e1580d1d8 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:03.179313 25437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ce2d227220499b8a45c74150b65632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.180052 25433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94639ef55f6d46d8b77e672e1580d1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.179912 25430 tablet_service.cc:1511] Processing CreateTablet for tablet f381a053607e43a79f6be90d737ee089 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:03.180899 25436 tablet_service.cc:1511] Processing CreateTablet for tablet 7042106730424de6bfbaf01a1c846b12 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:03.181473 25434 tablet_service.cc:1511] Processing CreateTablet for tablet 9493dad0e0a74e6eb3f00267c3c34e8e (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:03.182304 25436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7042106730424de6bfbaf01a1c846b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.183858 25434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9493dad0e0a74e6eb3f00267c3c34e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.182250 25435 tablet_service.cc:1511] Processing CreateTablet for tablet 5128e8a2ec9a4f6d93a220f15ba4702b (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:03.185477 25435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5128e8a2ec9a4f6d93a220f15ba4702b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.193363 25430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f381a053607e43a79f6be90d737ee089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.202534 25488 tablet_bootstrap.cc:492] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.210851 25488 tablet_bootstrap.cc:654] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.220925 25289 tablet_service.cc:1511] Processing CreateTablet for tablet e55a8dfb5a094f83ba09e9acc49bbe55 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:03.221329 25363 tablet_service.cc:1511] Processing CreateTablet for tablet 78ce2d227220499b8a45c74150b65632 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:03.222354 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55a8dfb5a094f83ba09e9acc49bbe55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.222661 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ce2d227220499b8a45c74150b65632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.225231 25362 tablet_service.cc:1511] Processing CreateTablet for tablet 7042106730424de6bfbaf01a1c846b12 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:03.226133 25488 tablet_bootstrap.cc:492] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.226531 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7042106730424de6bfbaf01a1c846b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.226711 25488 ts_tablet_manager.cc:1403] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 12:28:03.229951 25488 raft_consensus.cc:359] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.230189 25361 tablet_service.cc:1511] Processing CreateTablet for tablet 5128e8a2ec9a4f6d93a220f15ba4702b (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:03.230726 25488 raft_consensus.cc:385] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.231174 25488 raft_consensus.cc:740] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.231518 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5128e8a2ec9a4f6d93a220f15ba4702b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.232086 25488 consensus_queue.cc:260] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.234122 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 9493dad0e0a74e6eb3f00267c3c34e8e (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:03.235399 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9493dad0e0a74e6eb3f00267c3c34e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.238204 25359 tablet_service.cc:1511] Processing CreateTablet for tablet 94639ef55f6d46d8b77e672e1580d1d8 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:03.239513 25359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94639ef55f6d46d8b77e672e1580d1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.242080 25358 tablet_service.cc:1511] Processing CreateTablet for tablet ab1dfe9b37c6480495e7ad61f3068358 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:03.243407 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1dfe9b37c6480495e7ad61f3068358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.243141 25288 tablet_service.cc:1511] Processing CreateTablet for tablet 78ce2d227220499b8a45c74150b65632 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:03.246173 25357 tablet_service.cc:1511] Processing CreateTablet for tablet 6f77b9b635e4433791979648f28c0ecb (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:03.246361 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 7042106730424de6bfbaf01a1c846b12 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:03.247438 25357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f77b9b635e4433791979648f28c0ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.249404 25286 tablet_service.cc:1511] Processing CreateTablet for tablet 5128e8a2ec9a4f6d93a220f15ba4702b (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:03.250193 25356 tablet_service.cc:1511] Processing CreateTablet for tablet f381a053607e43a79f6be90d737ee089 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:03.251482 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f381a053607e43a79f6be90d737ee089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.252405 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 9493dad0e0a74e6eb3f00267c3c34e8e (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:03.254786 25284 tablet_service.cc:1511] Processing CreateTablet for tablet 94639ef55f6d46d8b77e672e1580d1d8 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:03.257071 25283 tablet_service.cc:1511] Processing CreateTablet for tablet ab1dfe9b37c6480495e7ad61f3068358 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:03.261102 25282 tablet_service.cc:1511] Processing CreateTablet for tablet 6f77b9b635e4433791979648f28c0ecb (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:03.262787 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ce2d227220499b8a45c74150b65632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.259249 25281 tablet_service.cc:1511] Processing CreateTablet for tablet f381a053607e43a79f6be90d737ee089 (DEFAULT_TABLE table=test-workload [id=9bb0c941c70a42a69ec5174b00c01702]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:03.266310 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f381a053607e43a79f6be90d737ee089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.269934 25282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f77b9b635e4433791979648f28c0ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.273365 25283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1dfe9b37c6480495e7ad61f3068358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.274623 25284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94639ef55f6d46d8b77e672e1580d1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.281378 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9493dad0e0a74e6eb3f00267c3c34e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.285420 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7042106730424de6bfbaf01a1c846b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.287606 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5128e8a2ec9a4f6d93a220f15ba4702b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.321171 25490 tablet_bootstrap.cc:492] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.323315 25488 ts_tablet_manager.cc:1434] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.096s	user 0.015s	sys 0.019s
I20260709 12:28:03.324074 25473 heartbeater.cc:499] Master 127.14.78.126:42075 was elected leader, sending a full tablet report...
I20260709 12:28:03.324391 25488 tablet_bootstrap.cc:492] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.329545 25490 tablet_bootstrap.cc:654] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.331202 25488 tablet_bootstrap.cc:654] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.333863 25492 tablet_bootstrap.cc:492] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.350808 25492 tablet_bootstrap.cc:654] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.358254 25490 tablet_bootstrap.cc:492] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.358777 25490 ts_tablet_manager.cc:1403] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.024s
I20260709 12:28:03.362074 25490 raft_consensus.cc:359] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.362864 25490 raft_consensus.cc:385] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.363201 25490 raft_consensus.cc:740] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.364110 25490 consensus_queue.cc:260] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.372380 25488 tablet_bootstrap.cc:492] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.372902 25488 ts_tablet_manager.cc:1403] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.010s
I20260709 12:28:03.374954 25488 raft_consensus.cc:359] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.375478 25488 raft_consensus.cc:385] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.375728 25488 raft_consensus.cc:740] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.376458 25488 consensus_queue.cc:260] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.381311 25488 ts_tablet_manager.cc:1434] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:28:03.382581 25399 heartbeater.cc:499] Master 127.14.78.126:42075 was elected leader, sending a full tablet report...
I20260709 12:28:03.383119 25490 ts_tablet_manager.cc:1434] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.016s
I20260709 12:28:03.383118 25488 tablet_bootstrap.cc:492] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.384138 25490 tablet_bootstrap.cc:492] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.382115 25492 tablet_bootstrap.cc:492] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.387292 25492 ts_tablet_manager.cc:1403] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.003s
I20260709 12:28:03.390540 25488 tablet_bootstrap.cc:654] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.390537 25492 raft_consensus.cc:359] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.391722 25490 tablet_bootstrap.cc:654] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.391700 25492 raft_consensus.cc:385] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.392210 25492 raft_consensus.cc:740] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.393190 25492 consensus_queue.cc:260] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.402658 25492 ts_tablet_manager.cc:1434] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:28:03.403622 25324 heartbeater.cc:499] Master 127.14.78.126:42075 was elected leader, sending a full tablet report...
I20260709 12:28:03.413493 25492 tablet_bootstrap.cc:492] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.420570 25488 tablet_bootstrap.cc:492] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.420745 25492 tablet_bootstrap.cc:654] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.421185 25488 ts_tablet_manager.cc:1403] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.013s
I20260709 12:28:03.424371 25488 raft_consensus.cc:359] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.425171 25488 raft_consensus.cc:385] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.425467 25488 raft_consensus.cc:740] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.426334 25488 consensus_queue.cc:260] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.430168 25490 tablet_bootstrap.cc:492] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.430559 25488 ts_tablet_manager.cc:1434] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:28:03.430915 25490 ts_tablet_manager.cc:1403] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.009s
I20260709 12:28:03.431695 25488 tablet_bootstrap.cc:492] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.434501 25490 raft_consensus.cc:359] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.435415 25490 raft_consensus.cc:385] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.435855 25490 raft_consensus.cc:740] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.437023 25490 consensus_queue.cc:260] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.439867 25490 ts_tablet_manager.cc:1434] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:03.441195 25490 tablet_bootstrap.cc:492] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.441360 25488 tablet_bootstrap.cc:654] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.451054 25490 tablet_bootstrap.cc:654] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.451736 25492 tablet_bootstrap.cc:492] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.452319 25492 ts_tablet_manager.cc:1403] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.018s
I20260709 12:28:03.453732 25488 tablet_bootstrap.cc:492] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.454269 25488 ts_tablet_manager.cc:1403] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
W20260709 12:28:03.455583 25400 tablet.cc:2406] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:03.455667 25492 raft_consensus.cc:359] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.456524 25492 raft_consensus.cc:385] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.456825 25492 raft_consensus.cc:740] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.456888 25488 raft_consensus.cc:359] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.457628 25488 raft_consensus.cc:385] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.457948 25488 raft_consensus.cc:740] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.457988 25492 consensus_queue.cc:260] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.458941 25488 consensus_queue.cc:260] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.462540 25488 ts_tablet_manager.cc:1434] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:03.463627 25488 tablet_bootstrap.cc:492] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.464195 25490 tablet_bootstrap.cc:492] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.464725 25490 ts_tablet_manager.cc:1403] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 12:28:03.465116 25492 ts_tablet_manager.cc:1434] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 12:28:03.466102 25492 tablet_bootstrap.cc:492] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.467763 25490 raft_consensus.cc:359] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.468868 25490 raft_consensus.cc:385] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.469298 25490 raft_consensus.cc:740] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.470384 25490 consensus_queue.cc:260] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.471134 25488 tablet_bootstrap.cc:654] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.474906 25490 ts_tablet_manager.cc:1434] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:28:03.475730 25492 tablet_bootstrap.cc:654] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.475944 25490 tablet_bootstrap.cc:492] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.483700 25490 tablet_bootstrap.cc:654] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.484162 25488 tablet_bootstrap.cc:492] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.484719 25488 ts_tablet_manager.cc:1403] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 12:28:03.487771 25488 raft_consensus.cc:359] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.488495 25488 raft_consensus.cc:385] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.488987 25490 tablet_bootstrap.cc:492] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.488790 25488 raft_consensus.cc:740] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.489595 25490 ts_tablet_manager.cc:1403] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:28:03.490015 25488 consensus_queue.cc:260] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.491446 25492 tablet_bootstrap.cc:492] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.491958 25492 ts_tablet_manager.cc:1403] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:28:03.492357 25488 ts_tablet_manager.cc:1434] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:03.492599 25490 raft_consensus.cc:359] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.493340 25490 raft_consensus.cc:385] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.493486 25488 tablet_bootstrap.cc:492] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.493655 25490 raft_consensus.cc:740] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.494535 25490 consensus_queue.cc:260] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.494958 25492 raft_consensus.cc:359] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.495746 25492 raft_consensus.cc:385] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.496151 25492 raft_consensus.cc:740] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.496949 25492 consensus_queue.cc:260] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.499912 25490 ts_tablet_manager.cc:1434] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:03.500375 25491 raft_consensus.cc:493] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.500634 25488 tablet_bootstrap.cc:654] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.500964 25490 tablet_bootstrap.cc:492] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.500898 25491 raft_consensus.cc:515] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.503554 25491 leader_election.cc:290] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.507541 25492 ts_tablet_manager.cc:1434] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:28:03.508792 25492 tablet_bootstrap.cc:492] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.511394 25490 tablet_bootstrap.cc:654] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.519352 25492 tablet_bootstrap.cc:654] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.520077 25491 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.520653 25491 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.522929 25491 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.535218 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.538497 25488 tablet_bootstrap.cc:492] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.538368 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.539130 25488 ts_tablet_manager.cc:1403] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.004s
W20260709 12:28:03.540796 25414 leader_election.cc:343] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.541674 25488 raft_consensus.cc:359] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
W20260709 12:28:03.541953 25414 leader_election.cc:343] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.542493 25488 raft_consensus.cc:385] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.542863 25488 raft_consensus.cc:740] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.543766 25490 tablet_bootstrap.cc:492] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.543723 25488 consensus_queue.cc:260] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.544425 25490 ts_tablet_manager.cc:1403] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.012s
I20260709 12:28:03.544221 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:03.545423 25374 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:03.546345 25488 ts_tablet_manager.cc:1434] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:03.547381 25488 tablet_bootstrap.cc:492] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.547765 25490 raft_consensus.cc:359] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.548604 25490 raft_consensus.cc:385] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.548941 25490 raft_consensus.cc:740] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.549765 25490 consensus_queue.cc:260] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.554304 25488 tablet_bootstrap.cc:654] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.555007 25490 ts_tablet_manager.cc:1434] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:03.556129 25490 tablet_bootstrap.cc:492] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.564055 25490 tablet_bootstrap.cc:654] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.565969 25488 tablet_bootstrap.cc:492] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.566481 25488 ts_tablet_manager.cc:1403] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:28:03.570179 25488 raft_consensus.cc:359] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.570899 25488 raft_consensus.cc:385] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.571190 25488 raft_consensus.cc:740] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.574353 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:03.575620 25488 consensus_queue.cc:260] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.576388 25495 raft_consensus.cc:493] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.577167 25495 raft_consensus.cc:515] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.578658 25488 ts_tablet_manager.cc:1434] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:28:03.580870 25490 tablet_bootstrap.cc:492] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.581171 25488 tablet_bootstrap.cc:492] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.582033 25495 leader_election.cc:290] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.585825 25414 leader_election.cc:304] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.587257 25491 raft_consensus.cc:2804] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.587703 25491 raft_consensus.cc:493] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.588135 25491 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:03.587894 25414 leader_election.cc:343] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.590893 25414 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.599459 25488 tablet_bootstrap.cc:654] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.600765 25491 raft_consensus.cc:515] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.606285 25491 leader_election.cc:290] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.607023 25491 raft_consensus.cc:2749] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.600931 25490 ts_tablet_manager.cc:1403] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.008s
I20260709 12:28:03.611428 25488 tablet_bootstrap.cc:492] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.615630 25488 ts_tablet_manager.cc:1403] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 12:28:03.615959 25490 raft_consensus.cc:359] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.613157 25492 tablet_bootstrap.cc:492] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.617115 25490 raft_consensus.cc:385] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.617439 25492 ts_tablet_manager.cc:1403] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.109s	user 0.045s	sys 0.042s
I20260709 12:28:03.617476 25490 raft_consensus.cc:740] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.618564 25490 consensus_queue.cc:260] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.621186 25492 raft_consensus.cc:359] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.622036 25492 raft_consensus.cc:385] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.622370 25492 raft_consensus.cc:740] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.623181 25492 consensus_queue.cc:260] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.624900 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.625609 25299 raft_consensus.cc:2468] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.626057 25488 raft_consensus.cc:359] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.626624 25495 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.626824 25488 raft_consensus.cc:385] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.627131 25488 raft_consensus.cc:740] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.627197 25495 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.627885 25488 consensus_queue.cc:260] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.629503 25495 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.631402 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.631690 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.632108 25448 raft_consensus.cc:2468] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.632251 25299 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.632587 25490 ts_tablet_manager.cc:1434] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:28:03.632536 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:03.633404 25374 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.634964 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.635648 25447 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.637195 25337 leader_election.cc:304] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:03.638144 25337 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:03.639760 25495 raft_consensus.cc:2804] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.640115 25495 raft_consensus.cc:493] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.640468 25495 raft_consensus.cc:3060] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.641469 25299 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:03.642066 25374 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:03.643498 25516 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.644217 25488 ts_tablet_manager.cc:1434] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:28:03.643540 25414 leader_election.cc:304] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:03.644876 25490 tablet_bootstrap.cc:492] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.645224 25514 raft_consensus.cc:2804] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.645869 25514 raft_consensus.cc:697] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:03.646355 25492 ts_tablet_manager.cc:1434] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 12:28:03.646855 25514 consensus_queue.cc:237] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.645401 25488 tablet_bootstrap.cc:492] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:03.652843 25490 tablet_bootstrap.cc:654] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.644445 25516 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.653575 25516 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.647493 25492 tablet_bootstrap.cc:492] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.661820 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
W20260709 12:28:03.663465 25340 leader_election.cc:343] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.664783 25490 tablet_bootstrap.cc:492] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.665427 25490 ts_tablet_manager.cc:1403] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 12:28:03.666559 25488 tablet_bootstrap.cc:654] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.663414 25492 tablet_bootstrap.cc:654] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.669070 25490 raft_consensus.cc:359] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.670363 25490 raft_consensus.cc:385] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.670747 25490 raft_consensus.cc:740] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.670467 25516 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.671773 25490 consensus_queue.cc:260] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.672129 25196 catalog_manager.cc:5697] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 0 to 1, leader changed from <none> to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 1 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.673992 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.674681 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
W20260709 12:28:03.675313 25340 leader_election.cc:343] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.675554 25447 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.679708 25488 tablet_bootstrap.cc:492] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:03.680277 25488 ts_tablet_manager.cc:1403] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 12:28:03.681313 25514 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.681815 25514 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.683759 25447 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.685143 25337 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.687146 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.686919 25495 raft_consensus.cc:515] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
W20260709 12:28:03.688831 25414 leader_election.cc:343] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.683887 25514 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.690630 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.691416 25299 raft_consensus.cc:3060] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.693496 25488 raft_consensus.cc:359] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.694383 25488 raft_consensus.cc:385] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.694753 25488 raft_consensus.cc:740] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.695899 25488 consensus_queue.cc:260] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
W20260709 12:28:03.696662 25245 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:03.697096 25516 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.697865 25516 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.698274 25516 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.698624 25488 ts_tablet_manager.cc:1434] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:28:03.699150 25495 leader_election.cc:290] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.699715 25495 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.700090 25495 raft_consensus.cc:697] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:03.700263 25514 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.700717 25514 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.703006 25514 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.703444 25299 raft_consensus.cc:2468] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.703708 25524 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.704264 25524 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.705056 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.705106 25340 leader_election.cc:304] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:03.706223 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
W20260709 12:28:03.708146 25414 leader_election.cc:343] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.708274 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:03.708976 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.709142 25374 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
W20260709 12:28:03.711012 25414 leader_election.cc:343] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.711407 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.711475 25414 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.712131 25448 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
W20260709 12:28:03.710772 25340 leader_election.cc:343] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.714021 25522 raft_consensus.cc:2804] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.713902 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.714550 25490 ts_tablet_manager.cc:1434] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.049s	user 0.019s	sys 0.021s
I20260709 12:28:03.712754 25414 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.714949 25298 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.715561 25491 raft_consensus.cc:2804] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.715811 25490 tablet_bootstrap.cc:492] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.715957 25491 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.716069 25340 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:03.716461 25491 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.716681 25492 tablet_bootstrap.cc:492] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.717262 25492 ts_tablet_manager.cc:1403] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.008s
I20260709 12:28:03.700933 25495 consensus_queue.cc:237] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.720144 25492 raft_consensus.cc:359] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.714573 25522 raft_consensus.cc:697] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:03.722025 25522 consensus_queue.cc:237] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.723006 25490 tablet_bootstrap.cc:654] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.723110 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:03.723872 25447 raft_consensus.cc:3060] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.714547 25514 raft_consensus.cc:2749] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.714655 25337 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.726521 25516 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.730207 25516 raft_consensus.cc:2804] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.730561 25516 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.730891 25516 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.720892 25492 raft_consensus.cc:385] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.731827 25492 raft_consensus.cc:740] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.732970 25492 consensus_queue.cc:260] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.727322 25491 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.735435 25524 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.735994 25524 raft_consensus.cc:2804] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.736313 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
W20260709 12:28:03.738058 25414 leader_election.cc:343] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.735468 25492 ts_tablet_manager.cc:1434] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:28:03.742331 25492 tablet_bootstrap.cc:492] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.743034 25491 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.743110 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:03.736321 25524 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.747023 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.747646 25448 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.748140 25194 catalog_manager.cc:5697] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.750095 25447 raft_consensus.cc:2468] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.750123 25516 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.753636 25492 tablet_bootstrap.cc:654] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.751672 25524 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.756443 25516 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.756368 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.757499 25298 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.756368 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:03.761754 25447 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.768993 25298 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.769950 25447 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.770267 25340 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:03.771224 25522 raft_consensus.cc:2804] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.771697 25522 raft_consensus.cc:697] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:03.773222 25516 raft_consensus.cc:493] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.773140 25522 consensus_queue.cc:237] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.773707 25516 raft_consensus.cc:515] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.776146 25524 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.776738 25516 leader_election.cc:290] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.776930 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.777531 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.777334 25374 raft_consensus.cc:2393] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate af6560cefe984f6e964ec81cd195ddde in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:03.778303 25447 raft_consensus.cc:2468] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.779240 25524 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.779455 25337 leader_election.cc:304] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:03.780299 25524 raft_consensus.cc:2804] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.780648 25524 raft_consensus.cc:493] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.780977 25524 raft_consensus.cc:3060] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.781340 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
W20260709 12:28:03.781853 25340 leader_election.cc:343] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.782182 25448 raft_consensus.cc:2393] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a048992a7f94b00849e378603ec4ae6 in current term 1: Already voted for candidate af6560cefe984f6e964ec81cd195ddde in this term.
I20260709 12:28:03.782096 25414 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.783015 25491 raft_consensus.cc:2749] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.783540 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
W20260709 12:28:03.785027 25340 leader_election.cc:343] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.785604 25340 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.787427 25516 raft_consensus.cc:2749] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.787793 25524 raft_consensus.cc:515] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.790117 25490 tablet_bootstrap.cc:492] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.790593 25491 raft_consensus.cc:493] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.790611 25490 ts_tablet_manager.cc:1403] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.009s
I20260709 12:28:03.790593 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.791097 25491 raft_consensus.cc:515] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.791005 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
W20260709 12:28:03.792825 25340 leader_election.cc:343] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.793134 25448 raft_consensus.cc:3060] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.791038 25492 tablet_bootstrap.cc:492] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.793481 25491 leader_election.cc:290] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.794010 25492 ts_tablet_manager.cc:1403] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.011s
I20260709 12:28:03.794885 25490 raft_consensus.cc:359] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.795358 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.795663 25490 raft_consensus.cc:385] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.795945 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:03.796109 25490 raft_consensus.cc:740] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.796059 25298 raft_consensus.cc:2468] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:03.796788 25374 raft_consensus.cc:2468] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:03.797343 25490 consensus_queue.cc:260] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.797735 25414 leader_election.cc:304] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:03.798619 25491 raft_consensus.cc:2804] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.799921 25490 ts_tablet_manager.cc:1434] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:03.800932 25490 tablet_bootstrap.cc:492] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:03.802506 25492 raft_consensus.cc:359] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.803264 25492 raft_consensus.cc:385] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.803581 25492 raft_consensus.cc:740] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.803118 25196 catalog_manager.cc:5697] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.804394 25492 consensus_queue.cc:260] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.798964 25491 raft_consensus.cc:493] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.805058 25448 raft_consensus.cc:2468] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.805336 25491 raft_consensus.cc:3060] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.806263 25337 leader_election.cc:304] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.807088 25522 raft_consensus.cc:2804] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.807590 25522 raft_consensus.cc:697] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:03.808485 25522 consensus_queue.cc:237] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.811079 25490 tablet_bootstrap.cc:654] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.804966 25196 catalog_manager.cc:5697] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.812407 25524 leader_election.cc:290] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.813663 25492 ts_tablet_manager.cc:1434] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:28:03.821236 25492 tablet_bootstrap.cc:492] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.827427 25492 tablet_bootstrap.cc:654] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.828989 25491 raft_consensus.cc:515] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.831441 25491 leader_election.cc:290] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:03.833094 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.833721 25298 raft_consensus.cc:3060] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.836833 25490 tablet_bootstrap.cc:492] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:03.837302 25490 ts_tablet_manager.cc:1403] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.011s
I20260709 12:28:03.837365 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:03.838019 25374 raft_consensus.cc:3060] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.839406 25490 raft_consensus.cc:359] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.839963 25490 raft_consensus.cc:385] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.840214 25490 raft_consensus.cc:740] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.839607 25196 catalog_manager.cc:5697] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.840844 25490 consensus_queue.cc:260] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.842870 25490 ts_tablet_manager.cc:1434] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:03.843287 25524 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.843690 25524 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.845369 25524 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.845535 25374 raft_consensus.cc:2468] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:03.846438 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.846717 25414 leader_election.cc:304] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:03.847489 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.847584 25491 raft_consensus.cc:2804] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:03.847644 25340 leader_election.cc:343] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.848299 25448 raft_consensus.cc:2468] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:03.848551 25491 raft_consensus.cc:697] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:03.848801 25524 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.849264 25524 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.849414 25337 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.849525 25491 consensus_queue.cc:237] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.850651 25522 raft_consensus.cc:2804] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.851023 25522 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.851362 25522 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.851933 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:03.852507 25524 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.853984 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.854614 25448 raft_consensus.cc:2468] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
W20260709 12:28:03.855865 25340 leader_election.cc:343] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.856904 25337 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.858693 25298 raft_consensus.cc:2468] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:03.858800 25522 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.861150 25522 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.861667 25522 raft_consensus.cc:2804] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.862004 25522 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.862322 25522 raft_consensus.cc:3060] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.862640 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:03.863335 25448 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.864043 25195 catalog_manager.cc:5697] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 0 to 1, leader changed from <none> to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 1 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.869375 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
W20260709 12:28:03.873046 25340 leader_election.cc:343] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.870013 25522 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.871384 25448 raft_consensus.cc:2468] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.874763 25337 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.875180 25522 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.875775 25522 raft_consensus.cc:2804] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.875869 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:03.876250 25522 raft_consensus.cc:697] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
W20260709 12:28:03.877058 25340 leader_election.cc:343] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.877357 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:03.877091 25522 consensus_queue.cc:237] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.877914 25448 raft_consensus.cc:3060] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.883809 25448 raft_consensus.cc:2468] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:03.884827 25337 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:03.885882 25522 raft_consensus.cc:2804] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.886595 25522 raft_consensus.cc:697] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:03.885881 25195 catalog_manager.cc:5697] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.887394 25522 consensus_queue.cc:237] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.890345 25492 tablet_bootstrap.cc:492] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.890900 25492 ts_tablet_manager.cc:1403] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.070s	user 0.004s	sys 0.011s
I20260709 12:28:03.894045 25492 raft_consensus.cc:359] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.894635 25492 raft_consensus.cc:385] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.894933 25492 raft_consensus.cc:740] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.895761 25492 consensus_queue.cc:260] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.899442 25492 ts_tablet_manager.cc:1434] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:28:03.900415 25492 tablet_bootstrap.cc:492] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.902927 25195 catalog_manager.cc:5697] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.905376 25492 tablet_bootstrap.cc:654] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.911965 25492 tablet_bootstrap.cc:492] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.912340 25492 ts_tablet_manager.cc:1403] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:28:03.914114 25498 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.914546 25498 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.914983 25492 raft_consensus.cc:359] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.915732 25492 raft_consensus.cc:385] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.915988 25492 raft_consensus.cc:740] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.916610 25492 consensus_queue.cc:260] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.920645 25498 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.921298 25492 ts_tablet_manager.cc:1434] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:28:03.922166 25492 tablet_bootstrap.cc:492] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:03.927578 25492 tablet_bootstrap.cc:654] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.931177 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:03.934398 25492 tablet_bootstrap.cc:492] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:03.934495 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.935027 25492 ts_tablet_manager.cc:1403] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:28:03.935346 25448 raft_consensus.cc:2393] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:03.936530 25262 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:03.937467 25541 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.937822 25492 raft_consensus.cc:359] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.938360 25492 raft_consensus.cc:385] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.938613 25492 raft_consensus.cc:740] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.939262 25492 consensus_queue.cc:260] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.941196 25492 ts_tablet_manager.cc:1434] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:03.944195 25541 raft_consensus.cc:2749] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.949206 25541 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.949669 25541 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:03.951920 25541 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:03.952461 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:03.952838 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:03.953145 25374 raft_consensus.cc:2393] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:03.953567 25448 raft_consensus.cc:2393] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 1: Already voted for candidate af6560cefe984f6e964ec81cd195ddde in this term.
I20260709 12:28:03.954479 25262 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:03.955021 25541 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.959908 25541 raft_consensus.cc:2749] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.063702 25541 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.064172 25541 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:04.066005 25541 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:04.066785 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:04.067018 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:04.067798 25448 raft_consensus.cc:2393] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:04.068652 25262 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:04.069263 25541 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.074164 25541 raft_consensus.cc:2749] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.076684 25541 raft_consensus.cc:493] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.077059 25541 raft_consensus.cc:515] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:04.078531 25541 leader_election.cc:290] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:04.079349 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:04.079509 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:04.080217 25448 raft_consensus.cc:2393] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:04.081341 25262 leader_election.cc:304] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:04.081910 25541 raft_consensus.cc:3060] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.086396 25541 raft_consensus.cc:2749] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.116169 25522 consensus_queue.cc:1048] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.126647 25522 consensus_queue.cc:1048] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.205103 25491 consensus_queue.cc:1048] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.215623 25551 consensus_queue.cc:1048] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.231715 25516 consensus_queue.cc:1048] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.234285 25516 consensus_queue.cc:1048] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.236199 25516 consensus_queue.cc:1048] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.252763 25524 consensus_queue.cc:1048] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.286469 25541 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.286896 25541 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:04.288941 25541 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:04.289508 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:04.290071 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:04.290796 25448 raft_consensus.cc:2393] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:04.291651 25262 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:04.292309 25541 raft_consensus.cc:3060] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.297551 25541 raft_consensus.cc:2749] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.300858 25524 consensus_queue.cc:1048] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.311021 25524 consensus_queue.cc:1048] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.344758 25524 consensus_queue.cc:1048] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.346586 25551 consensus_queue.cc:1048] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.355058 25524 consensus_queue.cc:1048] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.361205 25514 consensus_queue.cc:1048] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.372857 25527 consensus_queue.cc:1048] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.386518 25524 consensus_queue.cc:1048] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:04.700779 25245 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:05.434175 25514 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.435143 25514 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:05.437367 25514 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:05.438334 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:05.438527 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:05.439276 25299 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:05.439383 25374 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:05.440764 25414 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:05.441545 25514 raft_consensus.cc:2804] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:05.441900 25514 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.442200 25514 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:05.450207 25514 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:05.451838 25514 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:05.452589 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:05.452880 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:05.453279 25299 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:05.453492 25374 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:05.463363 25299 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:05.463474 25374 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:05.464890 25414 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:05.465595 25514 raft_consensus.cc:2804] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:05.466492 25514 raft_consensus.cc:697] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:05.467679 25514 consensus_queue.cc:237] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:05.475638 25196 catalog_manager.cc:5697] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 0 to 2, leader changed from <none> to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 2 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.881366 25374 raft_consensus.cc:1275] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:05.882426 25374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:05.882733 25514 consensus_queue.cc:1048] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.883149 25374 raft_consensus.cc:606] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:05.890741 25374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ce2d227220499b8a45c74150b65632"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:05.894258 25374 raft_consensus.cc:606] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:05.898452 25299 raft_consensus.cc:1275] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:05.900148 25514 consensus_queue.cc:1048] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.908190 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:05.908885 25373 raft_consensus.cc:606] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:05.933513 25447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:59178
I20260709 12:28:05.934077 25447 raft_consensus.cc:606] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:05.939427 25447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
mode: GRACEFUL
new_leader_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:59178
I20260709 12:28:05.939916 25447 raft_consensus.cc:606] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Received request to transfer leadership to TS 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:05.944502 25447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
mode: GRACEFUL
new_leader_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:59178
I20260709 12:28:05.944981 25447 raft_consensus.cc:606] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Received request to transfer leadership to TS 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:05.954377 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f381a053607e43a79f6be90d737ee089"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:05.954861 25373 raft_consensus.cc:606] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:06.074843 25567 raft_consensus.cc:993] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: : Instructing follower 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:06.075326 25514 raft_consensus.cc:1081] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Signalling peer 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:06.076768 25373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:46226
I20260709 12:28:06.077247 25373 raft_consensus.cc:493] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.077518 25373 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.083863 25373 raft_consensus.cc:515] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.085915 25373 leader_election.cc:290] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:06.086685 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:06.086982 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:06.087488 25299 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.087580 25447 raft_consensus.cc:3055] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:06.088029 25447 raft_consensus.cc:740] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:06.089223 25447 consensus_queue.cc:260] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.090698 25447 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.096087 25299 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:06.097405 25340 leader_election.cc:304] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.098246 25566 raft_consensus.cc:2804] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:06.098727 25566 raft_consensus.cc:697] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:06.099237 25447 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:06.099861 25566 consensus_queue.cc:237] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.103619 25567 raft_consensus.cc:993] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: : Instructing follower 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:06.104162 25514 raft_consensus.cc:1081] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Signalling peer 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:06.105880 25373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:46226
I20260709 12:28:06.106395 25373 raft_consensus.cc:493] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.106705 25373 raft_consensus.cc:3060] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.107740 25196 catalog_manager.cc:5697] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 1 to 2, leader changed from af6560cefe984f6e964ec81cd195ddde (127.14.78.67) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.112941 25524 raft_consensus.cc:993] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.113507 25524 raft_consensus.cc:1081] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.113200 25373 raft_consensus.cc:515] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.115295 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:28:06.115897 25299 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.116115 25373 leader_election.cc:290] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:06.116253 25299 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.116523 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:06.117373 25447 raft_consensus.cc:3055] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:06.117556 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:06.117848 25447 raft_consensus.cc:740] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:06.118299 25298 raft_consensus.cc:3060] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.119218 25447 consensus_queue.cc:260] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.120874 25447 raft_consensus.cc:3060] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.125989 25299 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.127450 25298 raft_consensus.cc:2468] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:06.128768 25340 leader_election.cc:304] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.129403 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:06.130043 25566 raft_consensus.cc:2804] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:06.130167 25299 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:06.130347 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:06.130949 25566 raft_consensus.cc:697] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:06.131096 25448 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.130071 25373 raft_consensus.cc:3055] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:06.132489 25373 raft_consensus.cc:740] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:06.132161 25566 consensus_queue.cc:237] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.133548 25373 consensus_queue.cc:260] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.135054 25373 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.138859 25448 raft_consensus.cc:2468] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:06.141937 25262 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.143020 25373 raft_consensus.cc:2468] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:06.143579 25447 raft_consensus.cc:2468] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:06.143802 25578 raft_consensus.cc:2804] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:06.145352 25578 raft_consensus.cc:697] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:06.144616 25196 catalog_manager.cc:5697] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 1 to 2, leader changed from af6560cefe984f6e964ec81cd195ddde (127.14.78.67) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.146378 25578 consensus_queue.cc:237] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.154771 25195 catalog_manager.cc:5697] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.253084 25524 raft_consensus.cc:993] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.253590 25566 raft_consensus.cc:1081] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.255199 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:28:06.255671 25299 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.255976 25299 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.260813 25299 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.262498 25299 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:06.263208 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:06.263530 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:06.263856 25373 raft_consensus.cc:3055] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:06.264118 25447 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.264209 25373 raft_consensus.cc:740] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:06.265211 25373 consensus_queue.cc:260] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.266175 25373 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.269563 25447 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:06.270571 25262 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.271395 25578 raft_consensus.cc:2804] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:06.271822 25578 raft_consensus.cc:697] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:06.272027 25373 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:06.272900 25578 consensus_queue.cc:237] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.279127 25524 raft_consensus.cc:993] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.279546 25566 raft_consensus.cc:1081] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.280405 25195 catalog_manager.cc:5697] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.280959 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ce2d227220499b8a45c74150b65632"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:28:06.281584 25299 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.281883 25299 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.288535 25299 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.290351 25299 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:06.291056 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:06.291363 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:06.291707 25373 raft_consensus.cc:3055] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:06.291909 25447 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.292092 25373 raft_consensus.cc:740] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:06.293097 25373 consensus_queue.cc:260] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.294109 25373 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.297374 25447 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:06.298288 25262 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.298945 25578 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:06.299425 25578 raft_consensus.cc:697] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:06.299657 25373 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:06.300391 25578 consensus_queue.cc:237] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.306810 25195 catalog_manager.cc:5697] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.316954 25524 raft_consensus.cc:993] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:06.317425 25566 raft_consensus.cc:1081] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:06.318809 25447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f381a053607e43a79f6be90d737ee089"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:28:06.319257 25447 raft_consensus.cc:493] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.319555 25447 raft_consensus.cc:3060] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.324572 25447 raft_consensus.cc:515] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.326045 25447 leader_election.cc:290] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:06.326838 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:06.327085 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f381a053607e43a79f6be90d737ee089" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:06.327417 25299 raft_consensus.cc:3060] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.327698 25373 raft_consensus.cc:3055] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:06.327991 25373 raft_consensus.cc:740] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:06.328707 25373 consensus_queue.cc:260] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.329818 25373 raft_consensus.cc:3060] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:06.332621 25299 raft_consensus.cc:2468] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:06.333983 25414 leader_election.cc:304] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.335058 25591 raft_consensus.cc:2804] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:06.335582 25373 raft_consensus.cc:2468] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:06.335533 25591 raft_consensus.cc:697] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:06.338374 25567 raft_consensus.cc:993] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.338074 25591 consensus_queue.cc:237] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.338827 25514 raft_consensus.cc:1081] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:06.340777 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46196
I20260709 12:28:06.341255 25299 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:06.341555 25299 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:06.346393 25195 catalog_manager.cc:5697] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 2 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:06.348043 25299 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.349849 25299 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:06.350442 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:06.351284 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:06.351388 25373 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:06.351846 25447 raft_consensus.cc:3055] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:06.352167 25447 raft_consensus.cc:740] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:06.352952 25447 consensus_queue.cc:260] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.354090 25447 raft_consensus.cc:3060] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:06.357549 25373 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 3.
I20260709 12:28:06.358577 25265 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:06.359252 25578 raft_consensus.cc:2804] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:06.359625 25578 raft_consensus.cc:697] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 3 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:06.359897 25447 raft_consensus.cc:2468] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 3.
I20260709 12:28:06.360513 25578 consensus_queue.cc:237] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:06.366182 25195 catalog_manager.cc:5697] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 2 to 3, leader changed from af6560cefe984f6e964ec81cd195ddde (127.14.78.67) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.556660 25447 raft_consensus.cc:1275] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.557916 25578 consensus_queue.cc:1048] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.566201 25299 raft_consensus.cc:1275] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.568444 25566 consensus_queue.cc:1048] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.573422 25373 raft_consensus.cc:1275] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.574913 25578 consensus_queue.cc:1048] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.584640 25447 raft_consensus.cc:1275] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.586541 25566 consensus_queue.cc:1048] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.634111 25298 raft_consensus.cc:1275] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.635432 25600 consensus_queue.cc:1048] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.644537 25447 raft_consensus.cc:1275] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.646466 25601 consensus_queue.cc:1048] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:06.661793 25447 raft_consensus.cc:1275] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.662899 25578 consensus_queue.cc:1048] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.671653 25373 raft_consensus.cc:1275] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.673272 25596 consensus_queue.cc:1048] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:06.747991 25447 raft_consensus.cc:1275] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.749274 25596 consensus_queue.cc:1048] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.757900 25373 raft_consensus.cc:1275] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.759310 25596 consensus_queue.cc:1048] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.766145 25298 raft_consensus.cc:1275] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.768060 25591 consensus_queue.cc:1048] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.770445 25373 raft_consensus.cc:1275] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:06.771736 25591 consensus_queue.cc:1048] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.874102 25447 raft_consensus.cc:1275] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:06.875222 25596 consensus_queue.cc:1048] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.882761 25373 raft_consensus.cc:1275] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:06.884137 25578 consensus_queue.cc:1048] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:09.082680 25395 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8a80 after lost signal to thread 14652
W20260709 12:28:09.083760 25395 debug-util.cc:398] Leaking SignalData structure 0x7b08001da4e0 after lost signal to thread 25231
W20260709 12:28:09.084964 25395 debug-util.cc:398] Leaking SignalData structure 0x7b08000dabe0 after lost signal to thread 25323
W20260709 12:28:09.086090 25395 debug-util.cc:398] Leaking SignalData structure 0x7b080005aa00 after lost signal to thread 25398
W20260709 12:28:09.087167 25395 debug-util.cc:398] Leaking SignalData structure 0x7b08002671a0 after lost signal to thread 25472
I20260709 12:28:09.245262 25196 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:09.247819 25196 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:09.305603 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:09.307021 25362 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:09.307458 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.308542 25362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.310817 25430 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:09.312290 25430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.311879 25435 tablet_service.cc:1511] Processing CreateTablet for tablet bec2509b88c54187acb6e491188960f3 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:09.313341 25435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec2509b88c54187acb6e491188960f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.323457 25438 tablet_service.cc:1511] Processing CreateTablet for tablet faf6a3d0f5e04742bef671e9876c9f8a (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:09.324887 25438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf6a3d0f5e04742bef671e9876c9f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.324720 25286 tablet_service.cc:1511] Processing CreateTablet for tablet bec2509b88c54187acb6e491188960f3 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:09.326071 25286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec2509b88c54187acb6e491188960f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.339071 25357 tablet_service.cc:1511] Processing CreateTablet for tablet bec2509b88c54187acb6e491188960f3 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:09.340477 25357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec2509b88c54187acb6e491188960f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.351869 25282 tablet_service.cc:1511] Processing CreateTablet for tablet faf6a3d0f5e04742bef671e9876c9f8a (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:09.353296 25282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf6a3d0f5e04742bef671e9876c9f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.362813 25359 tablet_service.cc:1511] Processing CreateTablet for tablet faf6a3d0f5e04742bef671e9876c9f8a (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:09.363210 25432 tablet_service.cc:1511] Processing CreateTablet for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:09.364207 25359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf6a3d0f5e04742bef671e9876c9f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.365089 25432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.375574 25287 tablet_service.cc:1511] Processing CreateTablet for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:09.376223 25361 tablet_service.cc:1511] Processing CreateTablet for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:09.377111 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.377569 25361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.395244 25288 tablet_service.cc:1511] Processing CreateTablet for tablet fc27ec7172664142b174ef62a077ba9c (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:09.396737 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc27ec7172664142b174ef62a077ba9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.397347 25437 tablet_service.cc:1511] Processing CreateTablet for tablet fc27ec7172664142b174ef62a077ba9c (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:09.396737 25629 tablet_bootstrap.cc:492] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:09.404266 25430 tablet_service.cc:1511] Processing CreateTablet for tablet 9e26345ef00f4ed18f2bc07151c34224 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:09.410764 25437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc27ec7172664142b174ef62a077ba9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.414916 25358 tablet_service.cc:1511] Processing CreateTablet for tablet fc27ec7172664142b174ef62a077ba9c (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:09.415700 25285 tablet_service.cc:1511] Processing CreateTablet for tablet 9e26345ef00f4ed18f2bc07151c34224 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:09.416301 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc27ec7172664142b174ef62a077ba9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.417014 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e26345ef00f4ed18f2bc07151c34224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.416757 25360 tablet_service.cc:1511] Processing CreateTablet for tablet 9e26345ef00f4ed18f2bc07151c34224 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:09.418198 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e26345ef00f4ed18f2bc07151c34224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.427903 25430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e26345ef00f4ed18f2bc07151c34224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.432595 25289 tablet_service.cc:1511] Processing CreateTablet for tablet e7d2268ad3324f9d80a3465852da568d (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:09.434167 25289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d2268ad3324f9d80a3465852da568d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.414192 25629 tablet_bootstrap.cc:654] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.441432 25438 tablet_service.cc:1511] Processing CreateTablet for tablet e7d2268ad3324f9d80a3465852da568d (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:09.442791 25438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d2268ad3324f9d80a3465852da568d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.468719 25627 tablet_bootstrap.cc:492] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.474706 25432 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2cad4e90934a738b4cc8354078f905 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:09.475704 25627 tablet_bootstrap.cc:654] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.476118 25432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2cad4e90934a738b4cc8354078f905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.480518 25628 tablet_bootstrap.cc:492] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.488857 25356 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba28bf13bf74b6abf948410461d2d86 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:09.490171 25363 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2cad4e90934a738b4cc8354078f905 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:09.490417 25287 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba28bf13bf74b6abf948410461d2d86 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:09.484846 25358 tablet_service.cc:1511] Processing CreateTablet for tablet e7d2268ad3324f9d80a3465852da568d (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:09.497493 25287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba28bf13bf74b6abf948410461d2d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.490217 25356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba28bf13bf74b6abf948410461d2d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.511428 25358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d2268ad3324f9d80a3465852da568d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.512398 25363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2cad4e90934a738b4cc8354078f905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.526492 25430 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba28bf13bf74b6abf948410461d2d86 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:09.527772 25430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba28bf13bf74b6abf948410461d2d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.529795 25628 tablet_bootstrap.cc:654] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.538348 25281 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2cad4e90934a738b4cc8354078f905 (DEFAULT_TABLE table=soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:09.555514 25281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2cad4e90934a738b4cc8354078f905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.569756 25629 tablet_bootstrap.cc:492] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:09.570402 25629 ts_tablet_manager.cc:1403] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.174s	user 0.021s	sys 0.000s
I20260709 12:28:09.573612 25629 raft_consensus.cc:359] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.574347 25629 raft_consensus.cc:385] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.574656 25629 raft_consensus.cc:740] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.575385 25629 consensus_queue.cc:260] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.586480 25628 tablet_bootstrap.cc:492] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.587045 25628 ts_tablet_manager.cc:1403] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.006s
I20260709 12:28:09.587795 25627 tablet_bootstrap.cc:492] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.588344 25627 ts_tablet_manager.cc:1403] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.120s	user 0.003s	sys 0.019s
I20260709 12:28:09.589979 25628 raft_consensus.cc:359] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.590764 25628 raft_consensus.cc:385] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.591068 25628 raft_consensus.cc:740] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.591240 25627 raft_consensus.cc:359] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.592031 25627 raft_consensus.cc:385] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.591814 25628 consensus_queue.cc:260] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.592352 25627 raft_consensus.cc:740] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.600586 25628 ts_tablet_manager.cc:1434] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.004s
I20260709 12:28:09.600417 25627 consensus_queue.cc:260] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.601727 25628 tablet_bootstrap.cc:492] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.603041 25627 ts_tablet_manager.cc:1434] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:28:09.603574 25629 ts_tablet_manager.cc:1434] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.005s
I20260709 12:28:09.608289 25628 tablet_bootstrap.cc:654] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.616933 25629 tablet_bootstrap.cc:492] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:09.617357 25627 tablet_bootstrap.cc:492] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.624577 25627 tablet_bootstrap.cc:654] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.633718 25627 tablet_bootstrap.cc:492] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.634323 25627 ts_tablet_manager.cc:1403] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.009s
I20260709 12:28:09.642488 25627 raft_consensus.cc:359] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.643481 25627 raft_consensus.cc:385] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.643883 25627 raft_consensus.cc:740] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.644852 25627 consensus_queue.cc:260] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.650760 25627 ts_tablet_manager.cc:1434] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:28:09.651832 25627 tablet_bootstrap.cc:492] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.662921 25627 tablet_bootstrap.cc:654] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.675700 25629 tablet_bootstrap.cc:654] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.676638 25628 tablet_bootstrap.cc:492] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.677354 25628 ts_tablet_manager.cc:1403] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.076s	user 0.032s	sys 0.042s
I20260709 12:28:09.679930 25627 tablet_bootstrap.cc:492] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.680498 25627 ts_tablet_manager.cc:1403] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.013s
I20260709 12:28:09.680547 25628 raft_consensus.cc:359] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.681463 25628 raft_consensus.cc:385] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.681759 25628 raft_consensus.cc:740] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.682520 25628 consensus_queue.cc:260] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.684670 25628 ts_tablet_manager.cc:1434] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:28:09.685729 25628 tablet_bootstrap.cc:492] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.692641 25628 tablet_bootstrap.cc:654] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.697993 25629 tablet_bootstrap.cc:492] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:09.698474 25629 ts_tablet_manager.cc:1403] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.016s
I20260709 12:28:09.698850 25628 tablet_bootstrap.cc:492] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.699398 25628 ts_tablet_manager.cc:1403] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 12:28:09.700624 25627 raft_consensus.cc:359] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.701486 25627 raft_consensus.cc:385] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.701848 25627 raft_consensus.cc:740] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.701619 25629 raft_consensus.cc:359] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.702500 25629 raft_consensus.cc:385] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.702382 25628 raft_consensus.cc:359] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.703184 25628 raft_consensus.cc:385] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.702937 25629 raft_consensus.cc:740] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.703689 25628 raft_consensus.cc:740] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.702916 25627 consensus_queue.cc:260] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.704504 25628 consensus_queue.cc:260] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.704493 25629 consensus_queue.cc:260] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.707181 25628 ts_tablet_manager.cc:1434] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:09.708279 25628 tablet_bootstrap.cc:492] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.714798 25628 tablet_bootstrap.cc:654] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.715319 25629 ts_tablet_manager.cc:1434] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:28:09.723624 25629 tablet_bootstrap.cc:492] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:09.726341 25628 tablet_bootstrap.cc:492] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.726847 25628 ts_tablet_manager.cc:1403] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:28:09.729803 25628 raft_consensus.cc:359] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.730317 25629 tablet_bootstrap.cc:654] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.730499 25628 raft_consensus.cc:385] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.730858 25628 raft_consensus.cc:740] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.731751 25628 consensus_queue.cc:260] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.734002 25628 ts_tablet_manager.cc:1434] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:28:09.735105 25628 tablet_bootstrap.cc:492] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.743399 25628 tablet_bootstrap.cc:654] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.744021 25630 raft_consensus.cc:493] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.744513 25630 raft_consensus.cc:515] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.746675 25627 ts_tablet_manager.cc:1434] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:28:09.746881 25630 leader_election.cc:290] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.748346 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c63ddbbe4a8bb3107a8d91a1728d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:09.748719 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c63ddbbe4a8bb3107a8d91a1728d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:09.748957 25373 raft_consensus.cc:2468] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 0.
I20260709 12:28:09.749408 25447 raft_consensus.cc:2468] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 0.
I20260709 12:28:09.750403 25265 leader_election.cc:304] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:09.751771 25630 raft_consensus.cc:2804] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.752179 25630 raft_consensus.cc:493] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:09.752523 25245 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:09.752588 25630 raft_consensus.cc:3060] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.757305 25627 tablet_bootstrap.cc:492] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.765535 25627 tablet_bootstrap.cc:654] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.766222 25630 raft_consensus.cc:515] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.769834 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c63ddbbe4a8bb3107a8d91a1728d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:09.770414 25373 raft_consensus.cc:3060] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.770738 25629 tablet_bootstrap.cc:492] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:09.771282 25629 ts_tablet_manager.cc:1403] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.048s	user 0.027s	sys 0.000s
I20260709 12:28:09.774399 25629 raft_consensus.cc:359] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.775455 25629 raft_consensus.cc:385] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.775731 25629 raft_consensus.cc:740] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.776539 25629 consensus_queue.cc:260] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.778277 25373 raft_consensus.cc:2468] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 1.
I20260709 12:28:09.779438 25265 leader_election.cc:304] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:09.780268 25578 raft_consensus.cc:2804] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.780746 25578 raft_consensus.cc:697] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:09.781586 25578 consensus_queue.cc:237] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.782122 25629 ts_tablet_manager.cc:1434] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:09.783195 25629 tablet_bootstrap.cc:492] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:09.788371 25628 tablet_bootstrap.cc:492] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.789080 25628 ts_tablet_manager.cc:1403] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.008s
I20260709 12:28:09.789256 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c63ddbbe4a8bb3107a8d91a1728d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:09.790155 25447 raft_consensus.cc:3060] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.795608 25629 tablet_bootstrap.cc:654] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.795528 25628 raft_consensus.cc:359] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.798216 25628 raft_consensus.cc:385] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.798732 25447 raft_consensus.cc:2468] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 1.
I20260709 12:28:09.799101 25628 raft_consensus.cc:740] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.800734 25628 consensus_queue.cc:260] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.789860 25630 leader_election.cc:290] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.806617 25628 ts_tablet_manager.cc:1434] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:28:09.808003 25628 tablet_bootstrap.cc:492] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.816182 25195 catalog_manager.cc:5697] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.818153 25627 tablet_bootstrap.cc:492] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.818775 25627 ts_tablet_manager.cc:1403] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.010s
I20260709 12:28:09.820204 25629 tablet_bootstrap.cc:492] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:09.820730 25629 ts_tablet_manager.cc:1403] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260709 12:28:09.824090 25629 raft_consensus.cc:359] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.824766 25629 raft_consensus.cc:385] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.825080 25629 raft_consensus.cc:740] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.825978 25629 consensus_queue.cc:260] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.828121 25628 tablet_bootstrap.cc:654] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.822371 25627 raft_consensus.cc:359] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.831626 25627 raft_consensus.cc:385] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.831979 25627 raft_consensus.cc:740] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.832732 25627 consensus_queue.cc:260] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.834156 25616 raft_consensus.cc:493] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.834707 25616 raft_consensus.cc:515] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.835820 25629 ts_tablet_manager.cc:1434] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:28:09.835757 25600 raft_consensus.cc:493] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.836382 25600 raft_consensus.cc:515] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.838591 25600 leader_election.cc:290] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.839066 25627 ts_tablet_manager.cc:1434] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.007s
I20260709 12:28:09.838972 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e26345ef00f4ed18f2bc07151c34224" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:09.839761 25298 raft_consensus.cc:2468] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:09.840252 25627 tablet_bootstrap.cc:492] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.840342 25629 tablet_bootstrap.cc:492] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:09.840895 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e26345ef00f4ed18f2bc07151c34224" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:09.844110 25340 leader_election.cc:304] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
W20260709 12:28:09.845688 25337 leader_election.cc:343] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.847780 25578 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.847930 25629 tablet_bootstrap.cc:654] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.848323 25628 tablet_bootstrap.cc:492] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.849022 25628 ts_tablet_manager.cc:1403] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.005s
I20260709 12:28:09.849426 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:09.850059 25447 raft_consensus.cc:2468] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:09.848357 25578 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.854106 25578 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.854983 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:09.856830 25649 raft_consensus.cc:2804] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.857318 25649 raft_consensus.cc:493] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.857627 25649 raft_consensus.cc:3060] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.858812 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:09.858752 25628 raft_consensus.cc:359] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.859838 25628 raft_consensus.cc:385] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.860056 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:09.860271 25628 raft_consensus.cc:740] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.836858 25616 leader_election.cc:290] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.861939 25600 raft_consensus.cc:493] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.861845 25628 consensus_queue.cc:260] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.863211 25373 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 0.
I20260709 12:28:09.862799 25600 raft_consensus.cc:515] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.864938 25628 ts_tablet_manager.cc:1434] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
W20260709 12:28:09.856698 25340 leader_election.cc:343] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.866133 25627 tablet_bootstrap.cc:654] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.867663 25337 leader_election.cc:304] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:09.870414 25628 tablet_bootstrap.cc:492] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.870891 25265 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:09.871938 25616 raft_consensus.cc:2804] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.872435 25616 raft_consensus.cc:493] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.860774 25447 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 0.
I20260709 12:28:09.872699 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:09.874603 25578 raft_consensus.cc:2804] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.875087 25578 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.875504 25578 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:09.875991 25340 leader_election.cc:343] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.877691 25628 tablet_bootstrap.cc:654] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.878258 25629 tablet_bootstrap.cc:492] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:09.878777 25629 ts_tablet_manager.cc:1403] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.010s
I20260709 12:28:09.880553 25616 raft_consensus.cc:3060] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.888335 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:09.869175 25600 leader_election.cc:290] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.889807 25629 raft_consensus.cc:359] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.890275 25628 tablet_bootstrap.cc:492] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:09.892966 25629 raft_consensus.cc:385] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.893334 25629 raft_consensus.cc:740] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.893646 25628 ts_tablet_manager.cc:1403] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
W20260709 12:28:09.894073 25337 leader_election.cc:343] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.895109 25337 leader_election.cc:304] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:09.896694 25628 raft_consensus.cc:359] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.896214 25629 consensus_queue.cc:260] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.897428 25600 raft_consensus.cc:2749] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:09.897450 25628 raft_consensus.cc:385] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.897176 25649 raft_consensus.cc:515] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.898543 25628 raft_consensus.cc:740] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.897588 25627 tablet_bootstrap.cc:492] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.899570 25627 ts_tablet_manager.cc:1403] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.009s
I20260709 12:28:09.902624 25627 raft_consensus.cc:359] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.903306 25627 raft_consensus.cc:385] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.903623 25627 raft_consensus.cc:740] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.904383 25627 consensus_queue.cc:260] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.906668 25627 ts_tablet_manager.cc:1434] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:09.907652 25627 tablet_bootstrap.cc:492] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.909368 25628 consensus_queue.cc:260] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.911742 25628 ts_tablet_manager.cc:1434] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:28:09.912736 25628 tablet_bootstrap.cc:492] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:09.915179 25600 raft_consensus.cc:493] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.915789 25600 raft_consensus.cc:515] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.922420 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec2509b88c54187acb6e491188960f3" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
W20260709 12:28:09.924021 25340 leader_election.cc:343] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.925253 25600 leader_election.cc:290] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.926689 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec2509b88c54187acb6e491188960f3" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:09.927618 25447 raft_consensus.cc:2468] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:09.928884 25337 leader_election.cc:304] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:09.933792 25600 raft_consensus.cc:2804] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:09.936424 25600 raft_consensus.cc:493] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.936932 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e26345ef00f4ed18f2bc07151c34224" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:09.942144 25298 raft_consensus.cc:3060] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.942521 25627 tablet_bootstrap.cc:654] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.947161 25627 tablet_bootstrap.cc:492] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.947575 25627 ts_tablet_manager.cc:1403] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:28:09.949241 25600 raft_consensus.cc:3060] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.939626 25628 tablet_bootstrap.cc:654] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.951170 25298 raft_consensus.cc:2468] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:09.940369 25649 leader_election.cc:290] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.939678 25629 ts_tablet_manager.cc:1434] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 12:28:09.952711 25340 leader_election.cc:304] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:09.953665 25649 raft_consensus.cc:2804] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.953936 25629 tablet_bootstrap.cc:492] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:09.954159 25649 raft_consensus.cc:697] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:09.955147 25649 consensus_queue.cc:237] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.955157 25627 raft_consensus.cc:359] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.956151 25627 raft_consensus.cc:385] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.956453 25627 raft_consensus.cc:740] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.957183 25627 consensus_queue.cc:260] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.959419 25627 ts_tablet_manager.cc:1434] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:28:09.960376 25627 tablet_bootstrap.cc:492] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:09.940871 25578 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.949417 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e26345ef00f4ed18f2bc07151c34224" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
W20260709 12:28:09.963271 25337 leader_election.cc:343] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:09.967085 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:09.967448 25629 tablet_bootstrap.cc:654] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.967687 25373 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.938517 25616 raft_consensus.cc:515] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.978492 25627 tablet_bootstrap.cc:654] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.980712 25616 leader_election.cc:290] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:09.982141 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:09.984323 25447 raft_consensus.cc:3060] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.993971 25600 raft_consensus.cc:515] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.994843 25627 tablet_bootstrap.cc:492] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:09.983036 25373 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 1.
I20260709 12:28:09.996608 25265 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:09.995390 25627 ts_tablet_manager.cc:1403] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.002s
I20260709 12:28:09.997493 25630 raft_consensus.cc:2804] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.997920 25629 tablet_bootstrap.cc:492] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:09.998446 25629 ts_tablet_manager.cc:1403] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.000s
I20260709 12:28:09.998296 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec2509b88c54187acb6e491188960f3" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:09.998912 25299 raft_consensus.cc:3060] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.999444 25600 leader_election.cc:290] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.001539 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec2509b88c54187acb6e491188960f3" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.002233 25446 raft_consensus.cc:3060] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.001573 25627 raft_consensus.cc:359] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.002751 25627 raft_consensus.cc:385] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.003150 25627 raft_consensus.cc:740] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.001695 25629 raft_consensus.cc:359] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:09.997977 25630 raft_consensus.cc:697] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:10.006781 25630 consensus_queue.cc:237] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.011312 25629 raft_consensus.cc:385] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.011801 25629 raft_consensus.cc:740] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.015578 25446 raft_consensus.cc:2468] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:10.016920 25337 leader_election.cc:304] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:10.017832 25600 raft_consensus.cc:2804] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.018327 25600 raft_consensus.cc:697] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.012782 25629 consensus_queue.cc:260] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.019179 25600 consensus_queue.cc:237] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.020982 25627 consensus_queue.cc:260] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.030210 25629 ts_tablet_manager.cc:1434] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:28:10.031667 25629 tablet_bootstrap.cc:492] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:10.034273 25627 ts_tablet_manager.cc:1434] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 12:28:10.034749 25195 catalog_manager.cc:5697] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.035725 25627 tablet_bootstrap.cc:492] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:10.042621 25299 raft_consensus.cc:2468] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:09.983752 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.048736 25298 raft_consensus.cc:3060] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.053781 25629 tablet_bootstrap.cc:654] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.054538 25627 tablet_bootstrap.cc:654] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.060824 25195 catalog_manager.cc:5697] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.062475 25628 tablet_bootstrap.cc:492] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:10.062986 25628 ts_tablet_manager.cc:1403] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.150s	user 0.034s	sys 0.042s
I20260709 12:28:10.065830 25628 raft_consensus.cc:359] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.066447 25628 raft_consensus.cc:385] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.066706 25628 raft_consensus.cc:740] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.067330 25628 consensus_queue.cc:260] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.069304 25628 ts_tablet_manager.cc:1434] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:10.070236 25628 tablet_bootstrap.cc:492] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: Bootstrap starting.
I20260709 12:28:10.070132 25578 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.071136 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.072268 25446 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.071647 25447 raft_consensus.cc:2468] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:10.073895 25337 leader_election.cc:304] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:10.074746 25600 raft_consensus.cc:2804] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.075415 25600 raft_consensus.cc:697] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.076211 25600 consensus_queue.cc:237] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.078596 25629 tablet_bootstrap.cc:492] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:10.079102 25629 ts_tablet_manager.cc:1403] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.011s
I20260709 12:28:10.084373 25298 raft_consensus.cc:2468] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:10.088043 25629 raft_consensus.cc:359] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.088819 25629 raft_consensus.cc:385] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.089111 25629 raft_consensus.cc:740] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.089902 25629 consensus_queue.cc:260] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.089582 25197 catalog_manager.cc:5697] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.092226 25629 ts_tablet_manager.cc:1434] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:28:10.094058 25629 tablet_bootstrap.cc:492] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:10.102334 25628 tablet_bootstrap.cc:654] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.111598 25196 catalog_manager.cc:5697] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.113341 25514 raft_consensus.cc:493] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.113901 25514 raft_consensus.cc:515] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.114712 25446 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 1.
I20260709 12:28:10.116091 25514 leader_election.cc:290] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.118177 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:10.118572 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:10.118824 25298 raft_consensus.cc:2468] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:10.119231 25373 raft_consensus.cc:2468] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:10.120440 25414 leader_election.cc:304] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.121248 25514 raft_consensus.cc:2804] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.121690 25514 raft_consensus.cc:493] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.122049 25514 raft_consensus.cc:3060] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.125941 25627 tablet_bootstrap.cc:492] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:10.126376 25627 ts_tablet_manager.cc:1403] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.091s	user 0.003s	sys 0.013s
I20260709 12:28:10.128379 25627 raft_consensus.cc:359] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.128849 25627 raft_consensus.cc:385] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.129096 25627 raft_consensus.cc:740] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.129681 25627 consensus_queue.cc:260] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.132479 25514 raft_consensus.cc:515] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.134625 25629 tablet_bootstrap.cc:654] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.134650 25627 ts_tablet_manager.cc:1434] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:10.138249 25627 tablet_bootstrap.cc:492] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: Bootstrap starting.
I20260709 12:28:10.142356 25628 tablet_bootstrap.cc:492] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: No bootstrap required, opened a new log
I20260709 12:28:10.142867 25628 ts_tablet_manager.cc:1403] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.006s
I20260709 12:28:10.145589 25628 raft_consensus.cc:359] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.146098 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.146314 25628 raft_consensus.cc:385] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.146724 25298 raft_consensus.cc:3060] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.147266 25514 leader_election.cc:290] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.146726 25628 raft_consensus.cc:740] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.148593 25628 consensus_queue.cc:260] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.149127 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:10.149708 25373 raft_consensus.cc:3060] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.153708 25628 ts_tablet_manager.cc:1434] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:10.154752 25627 tablet_bootstrap.cc:654] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.156158 25629 tablet_bootstrap.cc:492] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:10.156379 25373 raft_consensus.cc:2468] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:10.156683 25629 ts_tablet_manager.cc:1403] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:28:10.157509 25414 leader_election.cc:304] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:10.159739 25629 raft_consensus.cc:359] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.160352 25629 raft_consensus.cc:385] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.160591 25629 raft_consensus.cc:740] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.161237 25629 consensus_queue.cc:260] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.163558 25600 raft_consensus.cc:493] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.164042 25600 raft_consensus.cc:515] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.166780 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:10.167342 25299 raft_consensus.cc:2468] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 0.
I20260709 12:28:10.168012 25630 raft_consensus.cc:493] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.168529 25340 leader_election.cc:304] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.168510 25630 raft_consensus.cc:515] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.169143 25667 raft_consensus.cc:2804] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.169584 25649 raft_consensus.cc:2804] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.169984 25649 raft_consensus.cc:493] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.170316 25649 raft_consensus.cc:3060] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.170730 25630 leader_election.cc:290] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.171588 25629 ts_tablet_manager.cc:1434] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:28:10.172580 25629 tablet_bootstrap.cc:492] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: Bootstrap starting.
I20260709 12:28:10.173179 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:10.173833 25446 raft_consensus.cc:2468] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 0.
I20260709 12:28:10.175002 25262 leader_election.cc:304] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.176841 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:10.177482 25374 raft_consensus.cc:2468] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 0.
I20260709 12:28:10.179518 25630 raft_consensus.cc:2804] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.179840 25629 tablet_bootstrap.cc:654] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.179937 25630 raft_consensus.cc:493] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.180445 25630 raft_consensus.cc:3060] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.182794 25667 raft_consensus.cc:697] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:10.183876 25667 consensus_queue.cc:237] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.184726 25600 leader_election.cc:290] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.185755 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
W20260709 12:28:10.187278 25337 leader_election.cc:343] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.191785 25649 raft_consensus.cc:515] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.194104 25298 raft_consensus.cc:2468] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:10.200989 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.201316 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.201685 25298 raft_consensus.cc:3060] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:10.202605 25337 leader_election.cc:343] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.203498 25649 leader_election.cc:290] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.203850 25197 catalog_manager.cc:5697] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 0 to 1, leader changed from <none> to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 1 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.208609 25630 raft_consensus.cc:515] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.211817 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:10.212170 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.212370 25373 raft_consensus.cc:3060] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.212795 25446 raft_consensus.cc:3060] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.219381 25446 raft_consensus.cc:2468] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 1.
I20260709 12:28:10.219604 25373 raft_consensus.cc:2468] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 1.
I20260709 12:28:10.220570 25262 leader_election.cc:304] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.221640 25615 raft_consensus.cc:2804] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.222141 25615 raft_consensus.cc:697] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:10.223001 25615 consensus_queue.cc:237] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.227227 25629 tablet_bootstrap.cc:492] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: No bootstrap required, opened a new log
I20260709 12:28:10.227721 25629 ts_tablet_manager.cc:1403] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.027s
I20260709 12:28:10.229269 25630 leader_election.cc:290] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 1 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.230517 25629 raft_consensus.cc:359] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.231238 25629 raft_consensus.cc:385] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.231518 25629 raft_consensus.cc:740] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.235531 25298 raft_consensus.cc:2468] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:10.236917 25340 leader_election.cc:304] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:10.238000 25627 tablet_bootstrap.cc:492] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: No bootstrap required, opened a new log
I20260709 12:28:10.238104 25649 raft_consensus.cc:2804] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.238557 25627 ts_tablet_manager.cc:1403] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.003s
I20260709 12:28:10.239158 25197 catalog_manager.cc:5697] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 1 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.239979 25649 raft_consensus.cc:697] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.241076 25629 consensus_queue.cc:260] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.240976 25649 consensus_queue.cc:237] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.245826 25629 ts_tablet_manager.cc:1434] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:28:10.241578 25627 raft_consensus.cc:359] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.251623 25627 raft_consensus.cc:385] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.251962 25627 raft_consensus.cc:740] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.252985 25627 consensus_queue.cc:260] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.258543 25627 ts_tablet_manager.cc:1434] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:28:10.266748 25194 catalog_manager.cc:5697] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 1 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.292225 25630 consensus_queue.cc:1048] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.304473 25578 consensus_queue.cc:1048] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.306110 25667 raft_consensus.cc:493] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.306656 25667 raft_consensus.cc:515] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.308894 25667 leader_election.cc:290] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.310374 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:10.318500 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:10.319455 25298 raft_consensus.cc:2393] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af6560cefe984f6e964ec81cd195ddde in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:10.321621 25414 leader_election.cc:304] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:10.322448 25667 raft_consensus.cc:3060] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.329144 25667 raft_consensus.cc:2749] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.341279 25667 raft_consensus.cc:493] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.341678 25667 raft_consensus.cc:515] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.343189 25667 leader_election.cc:290] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.343963 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:10.344364 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:10.344569 25298 raft_consensus.cc:2468] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:10.345371 25667 raft_consensus.cc:493] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.345630 25414 leader_election.cc:304] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.345085 25373 raft_consensus.cc:2468] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 0.
I20260709 12:28:10.345871 25667 raft_consensus.cc:515] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.346611 25514 raft_consensus.cc:2804] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.347028 25514 raft_consensus.cc:493] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.347394 25514 raft_consensus.cc:3060] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.348925 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e26345ef00f4ed18f2bc07151c34224" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:10.349661 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e26345ef00f4ed18f2bc07151c34224" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:10.349162 25667 leader_election.cc:290] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.350546 25298 raft_consensus.cc:2393] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af6560cefe984f6e964ec81cd195ddde in current term 1: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:10.352291 25414 leader_election.cc:304] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:10.352937 25667 raft_consensus.cc:3060] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.355403 25514 raft_consensus.cc:515] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.357573 25514 leader_election.cc:290] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.358389 25667 raft_consensus.cc:2749] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.358348 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.358902 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:10.359261 25298 raft_consensus.cc:3060] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.359453 25373 raft_consensus.cc:3060] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.363915 25373 raft_consensus.cc:2468] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:10.364712 25414 leader_election.cc:304] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:10.365355 25667 raft_consensus.cc:2804] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.365785 25667 raft_consensus.cc:697] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:10.366827 25667 consensus_queue.cc:237] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.366890 25298 raft_consensus.cc:2468] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:10.375481 25195 catalog_manager.cc:5697] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 0 to 1, leader changed from <none> to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 1 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:10.420158 25649 consensus_queue.cc:1048] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.433142 25649 consensus_queue.cc:1048] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.508215 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bec2509b88c54187acb6e491188960f3"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:10.508720 25373 raft_consensus.cc:606] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:10.514073 25373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:10.514532 25373 raft_consensus.cc:606] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:10.522193 25447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
mode: GRACEFUL
new_leader_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:59178
I20260709 12:28:10.522735 25447 raft_consensus.cc:606] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Received request to transfer leadership to TS 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:10.540939 25298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
mode: GRACEFUL
new_leader_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:38250
I20260709 12:28:10.541566 25298 raft_consensus.cc:606] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Received request to transfer leadership to TS 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:10.541437 25649 consensus_queue.cc:1048] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.548094 25447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
mode: GRACEFUL
new_leader_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:59178
I20260709 12:28:10.548816 25447 raft_consensus.cc:606] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Received request to transfer leadership to TS 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:10.551733 25649 consensus_queue.cc:1048] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.560636 25374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:46252
I20260709 12:28:10.561362 25374 raft_consensus.cc:606] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:10.562049 25616 raft_consensus.cc:993] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:10.562626 25616 raft_consensus.cc:1081] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:10.566401 25298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:28:10.566995 25298 raft_consensus.cc:493] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:10.567408 25298 raft_consensus.cc:3060] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.574767 25298 raft_consensus.cc:515] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.577149 25299 raft_consensus.cc:1240] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4a048992a7f94b00849e378603ec4ae6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:10.577384 25298 leader_election.cc:290] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.578713 25600 consensus_queue.cc:1048] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.579658 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:10.580046 25600 consensus_queue.cc:1048] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.581027 25616 consensus_queue.cc:1059] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.581347 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf6a3d0f5e04742bef671e9876c9f8a" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.581974 25446 raft_consensus.cc:3060] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.580302 25374 raft_consensus.cc:3055] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:10.585402 25374 raft_consensus.cc:740] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.586856 25374 consensus_queue.cc:260] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.594725 25374 raft_consensus.cc:3060] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.593885 25446 raft_consensus.cc:2468] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:10.602057 25447 raft_consensus.cc:1240] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Rejecting Update request from peer 4a048992a7f94b00849e378603ec4ae6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:28:10.602169 25262 leader_election.cc:304] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.603193 25630 raft_consensus.cc:2804] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:10.603636 25630 raft_consensus.cc:697] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:10.604326 25630 consensus_queue.cc:237] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.608772 25374 raft_consensus.cc:2468] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
W20260709 12:28:10.609402 25616 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:28:10.611887 25600 raft_consensus.cc:993] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:10.612387 25600 raft_consensus.cc:1081] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:10.614382 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bec2509b88c54187acb6e491188960f3"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:28:10.614975 25299 raft_consensus.cc:493] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:10.615368 25299 raft_consensus.cc:3060] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.617022 25578 consensus_queue.cc:1048] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.616884 25195 catalog_manager.cc:5697] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.627460 25630 consensus_queue.cc:1048] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.637830 25615 consensus_queue.cc:1048] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.656769 25299 raft_consensus.cc:515] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.660032 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec2509b88c54187acb6e491188960f3" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:10.660662 25374 raft_consensus.cc:3055] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:10.660997 25374 raft_consensus.cc:740] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.661908 25374 consensus_queue.cc:260] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.665323 25374 raft_consensus.cc:3060] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.665710 25615 consensus_queue.cc:1048] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.680691 25299 leader_election.cc:290] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.681573 25667 consensus_queue.cc:1048] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.685077 25374 raft_consensus.cc:2468] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:10.686051 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec2509b88c54187acb6e491188960f3" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.686554 25265 leader_election.cc:304] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.686939 25446 raft_consensus.cc:3060] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.688035 25615 raft_consensus.cc:2804] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:10.688661 25615 raft_consensus.cc:697] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:10.689719 25615 consensus_queue.cc:237] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.695838 25446 raft_consensus.cc:2468] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:10.699971 25667 raft_consensus.cc:993] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: : Instructing follower 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:10.700414 25667 raft_consensus.cc:1081] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Signalling peer 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:10.712934 25197 catalog_manager.cc:5697] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.720432 25578 raft_consensus.cc:993] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: : Instructing follower 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:10.721014 25578 raft_consensus.cc:1081] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Signalling peer 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:10.721551 25373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:46226
I20260709 12:28:10.722170 25373 raft_consensus.cc:493] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:10.722563 25373 raft_consensus.cc:3060] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.724685 25694 consensus_queue.cc:1048] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.726612 25374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:46238
I20260709 12:28:10.727382 25374 raft_consensus.cc:493] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:10.727838 25374 raft_consensus.cc:3060] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.732791 25373 raft_consensus.cc:515] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.735566 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.735867 25373 leader_election.cc:290] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.737160 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.737910 25446 raft_consensus.cc:3055] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:10.738282 25446 raft_consensus.cc:740] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:10.739245 25446 consensus_queue.cc:260] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.740684 25446 raft_consensus.cc:3060] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.750161 25374 raft_consensus.cc:515] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.750669 25446 raft_consensus.cc:2468] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:10.752089 25337 leader_election.cc:304] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:10.752808 25374 leader_election.cc:290] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.754102 25616 raft_consensus.cc:2804] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:10.754029 25694 consensus_queue.cc:1048] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.754801 25616 raft_consensus.cc:697] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.755780 25616 consensus_queue.cc:237] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.756438 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.757061 25299 raft_consensus.cc:3055] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:10.757342 25299 raft_consensus.cc:740] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:10.758031 25299 consensus_queue.cc:260] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.759023 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7d2268ad3324f9d80a3465852da568d" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.759233 25299 raft_consensus.cc:3060] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.759716 25447 raft_consensus.cc:3060] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.766469 25299 raft_consensus.cc:2468] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:10.767748 25340 leader_election.cc:304] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.768545 25600 raft_consensus.cc:2804] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:10.769011 25600 raft_consensus.cc:697] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.769825 25600 consensus_queue.cc:237] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.774259 25447 raft_consensus.cc:2468] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:10.776453 25197 catalog_manager.cc:5697] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 1 to 2, leader changed from af6560cefe984f6e964ec81cd195ddde (127.14.78.67) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.780406 25514 raft_consensus.cc:993] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: : Instructing follower 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:10.780882 25514 raft_consensus.cc:1081] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Signalling peer 4a048992a7f94b00849e378603ec4ae6 to start an election
I20260709 12:28:10.785849 25373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
 from {username='slave'} at 127.0.0.1:46226
I20260709 12:28:10.786386 25373 raft_consensus.cc:493] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:10.786736 25373 raft_consensus.cc:3060] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.796312 25373 raft_consensus.cc:515] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.797273 25694 consensus_queue.cc:1048] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.798271 25373 leader_election.cc:290] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:10.798983 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.799593 25298 raft_consensus.cc:3060] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.806083 25195 catalog_manager.cc:5697] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 1 to 2, leader changed from b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.807492 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:10.808012 25298 raft_consensus.cc:2468] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:10.808128 25447 raft_consensus.cc:3055] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:10.808593 25447 raft_consensus.cc:740] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:10.809507 25447 consensus_queue.cc:260] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.810281 25299 raft_consensus.cc:1240] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Rejecting Update request from peer af6560cefe984f6e964ec81cd195ddde for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:28:10.810564 25447 raft_consensus.cc:3060] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.811420 25340 leader_election.cc:304] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:10.813352 25600 raft_consensus.cc:2804] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:10.813841 25600 raft_consensus.cc:697] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.814687 25600 consensus_queue.cc:237] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.817977 25447 raft_consensus.cc:2468] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:10.824631 25195 catalog_manager.cc:5697] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 1 to 2, leader changed from af6560cefe984f6e964ec81cd195ddde (127.14.78.67) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 2 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.845827 25600 consensus_queue.cc:1048] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:10.852645 25652 raft_consensus.cc:993] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:10.853171 25649 raft_consensus.cc:1081] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:10.859319 25447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:28:10.859833 25447 raft_consensus.cc:493] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:10.860189 25447 raft_consensus.cc:3060] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.860796 25649 consensus_queue.cc:1048] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:10.867199 25447 raft_consensus.cc:515] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.869136 25447 leader_election.cc:290] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:10.869856 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:10.871949 25373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:10.873868 25373 raft_consensus.cc:3055] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:10.874220 25373 raft_consensus.cc:740] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:10.875159 25373 consensus_queue.cc:260] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.876533 25373 raft_consensus.cc:3060] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.888190 25373 raft_consensus.cc:2468] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:10.889406 25414 leader_election.cc:304] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:10.890295 25693 raft_consensus.cc:2804] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:10.890767 25693 raft_consensus.cc:697] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:10.891605 25693 consensus_queue.cc:237] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:10.899910 25195 catalog_manager.cc:5697] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 2 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.129637 25373 raft_consensus.cc:1275] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.130810 25615 consensus_queue.cc:1048] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.138578 25447 raft_consensus.cc:1275] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.139380 25446 raft_consensus.cc:1275] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.141944 25578 consensus_queue.cc:1048] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.143265 25578 consensus_queue.cc:1048] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.156332 25373 raft_consensus.cc:1275] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.157764 25630 consensus_queue.cc:1048] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.186729 25298 raft_consensus.cc:3060] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.192080 25298 raft_consensus.cc:1275] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.193310 25600 consensus_queue.cc:1048] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.201699 25447 raft_consensus.cc:1275] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.203190 25616 consensus_queue.cc:1048] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.231860 25298 raft_consensus.cc:1275] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.232946 25616 consensus_queue.cc:1048] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.241379 25447 raft_consensus.cc:1275] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.242945 25600 consensus_queue.cc:1048] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.291755 25447 raft_consensus.cc:1275] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.293085 25600 consensus_queue.cc:1048] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.303900 25298 raft_consensus.cc:1275] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.305691 25600 consensus_queue.cc:1048] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.386808 25372 raft_consensus.cc:1275] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.389549 25693 consensus_queue.cc:1048] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.398089 25298 raft_consensus.cc:3060] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.403754 25298 raft_consensus.cc:1275] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.405324 25694 consensus_queue.cc:1048] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:13.565442 25196 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:28:13.584399 25196 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:28:13.629643 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:13.701923 25340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.65:42045, user_credentials={real_user=slave}} blocked reactor thread for 47466.7us
W20260709 12:28:13.712657 25337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.78.67:45289, user_credentials={real_user=slave}} blocked reactor thread for 62291.5us
I20260709 12:28:13.734643 25298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
mode: GRACEFUL
new_leader_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:38258
I20260709 12:28:13.735437 25298 raft_consensus.cc:606] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Received request to transfer leadership to TS af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:13.769646 25745 tablet.cc:1724] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:13.790664 25717 log.cc:927] Time spent T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:28:13.794129 25757 tablet.cc:1724] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.807236 25760 tablet.cc:1724] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.815086 25756 tablet.cc:1724] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.829129 25755 tablet.cc:1724] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.859890 25769 tablet.cc:1724] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.863281 25764 tablet.cc:1724] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.831719 25762 tablet.cc:1724] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.836107 25747 tablet.cc:1724] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.856652 25770 tablet.cc:1724] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.882009 25765 tablet.cc:1724] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.880024 25196 catalog_manager.cc:5789] TS 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723) does not have the latest schema for tablet 8d2cad4e90934a738b4cc8354078f905 (table soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]). Expected version 1 got 0
I20260709 12:28:13.892530 25745 tablet.cc:1724] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.894202 25757 tablet.cc:1724] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.902990 25196 catalog_manager.cc:5789] TS 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723) does not have the latest schema for tablet e7d2268ad3324f9d80a3465852da568d (table soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]). Expected version 1 got 0
I20260709 12:28:13.905429 25196 catalog_manager.cc:5789] TS 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723) does not have the latest schema for tablet fc27ec7172664142b174ef62a077ba9c (table soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]). Expected version 1 got 0
I20260709 12:28:13.909488 25766 tablet.cc:1724] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.919021 25770 tablet.cc:1724] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.921923 25374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:28:13.922619 25374 raft_consensus.cc:606] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Received request to transfer leadership to TS af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:13.924228 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:13.924876 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:13.928740 25760 tablet.cc:1724] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.930219 25757 tablet.cc:1724] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.935544 25769 tablet.cc:1724] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.940905 25757 tablet.cc:1724] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.947743 25755 tablet.cc:1724] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.948490 25756 tablet.cc:1724] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.958541 25745 tablet.cc:1724] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.960049 25197 catalog_manager.cc:5789] TS b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045) does not have the latest schema for tablet f7ffa7c1e90b49b9804fe836f6bb5b8a (table soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]). Expected version 1 got 0
I20260709 12:28:13.962541 25764 tablet.cc:1724] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.963550 25747 tablet.cc:1724] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.964570 25756 tablet.cc:1724] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.977003 25764 tablet.cc:1724] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.965016 25766 tablet.cc:1724] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:13.960908 25197 catalog_manager.cc:5789] TS b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045) does not have the latest schema for tablet 6ab2c63ddbbe4a8bb3107a8d91a1728d (table soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16]). Expected version 1 got 0
I20260709 12:28:14.009583 25194 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530: soft_deleted_table [id=dee37181b08b415fb51c53216efd8b16] alter complete (version 1)
I20260709 12:28:14.135987 25754 raft_consensus.cc:993] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: : Instructing follower af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:14.136633 25758 raft_consensus.cc:1081] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Signalling peer af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:14.138113 25446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:59174
I20260709 12:28:14.138691 25446 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:14.139084 25446 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:14.144129 25446 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:14.145818 25446 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:14.146597 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:14.146957 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:14.147225 25299 raft_consensus.cc:3055] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:14.147600 25374 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:14.147610 25299 raft_consensus.cc:740] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:14.148604 25299 consensus_queue.cc:260] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:14.149648 25299 raft_consensus.cc:3060] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:14.153131 25374 raft_consensus.cc:2468] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 3.
I20260709 12:28:14.154000 25299 raft_consensus.cc:2468] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 3.
I20260709 12:28:14.154218 25414 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:14.155151 25767 raft_consensus.cc:2804] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:14.155543 25767 raft_consensus.cc:697] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:14.156186 25767 consensus_queue.cc:237] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:14.163033 25196 catalog_manager.cc:5697] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 2 to 3, leader changed from b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65) to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 3 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:14.501101 25616 raft_consensus.cc:993] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:14.501634 25727 raft_consensus.cc:1081] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Signalling peer af6560cefe984f6e964ec81cd195ddde to start an election
I20260709 12:28:14.502918 25446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358"
dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:28:14.503397 25446 raft_consensus.cc:493] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:14.503682 25446 raft_consensus.cc:3060] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:14.510538 25446 raft_consensus.cc:515] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:14.512094 25446 leader_election.cc:290] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:14.512773 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:14.513079 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:14.513407 25299 raft_consensus.cc:3060] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:14.513705 25374 raft_consensus.cc:3055] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:14.514016 25374 raft_consensus.cc:740] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:14.514703 25374 consensus_queue.cc:260] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:14.515694 25374 raft_consensus.cc:3060] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:14.518042 25299 raft_consensus.cc:2468] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:14.518909 25414 leader_election.cc:304] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:14.519598 25767 raft_consensus.cc:2804] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:14.520073 25767 raft_consensus.cc:697] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:14.520939 25767 consensus_queue.cc:237] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:14.521415 25374 raft_consensus.cc:2468] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:14.528607 25196 catalog_manager.cc:5697] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 2 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:14.545641 25374 raft_consensus.cc:1275] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:14.546669 25767 consensus_queue.cc:1048] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:14.556419 25299 raft_consensus.cc:1275] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:14.559324 25767 consensus_queue.cc:1048] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:15.011775 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:15.020669 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:15.021601 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:16.007261 25781 raft_consensus.cc:493] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader af6560cefe984f6e964ec81cd195ddde)
I20260709 12:28:16.017791 25781 raft_consensus.cc:515] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.022817 25781 leader_election.cc:290] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.024080 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:16.028174 25781 raft_consensus.cc:493] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.029906 25781 raft_consensus.cc:515] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.033800 25783 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.034983 25783 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.037846 25781 leader_election.cc:290] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.038635 25781 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.039507 25781 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.042256 25781 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.066989 25786 raft_consensus.cc:493] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader af6560cefe984f6e964ec81cd195ddde)
I20260709 12:28:16.068282 25786 raft_consensus.cc:515] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.072304 25787 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.076503 25783 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045)
I20260709 12:28:16.081017 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:16.090061 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:16.086803 25783 raft_consensus.cc:493] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:16.097003 25783 raft_consensus.cc:515] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.097534 25788 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:16.105240 25786 leader_election.cc:290] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.101784 25788 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.120569 25783 leader_election.cc:290] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:16.122641 25788 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:16.124655 25787 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.127883 25787 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:16.128616 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.129804 25374 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:16.137564 25785 raft_consensus.cc:493] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:16.138435 25785 raft_consensus.cc:515] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.139201 25786 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.141260 25785 leader_election.cc:290] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.143172 25785 raft_consensus.cc:493] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.143949 25298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.143862 25785 raft_consensus.cc:515] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.144748 25298 raft_consensus.cc:2468] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:16.147394 25374 raft_consensus.cc:1275] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:16.140406 25786 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.150053 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.150301 25786 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.155926 25795 raft_consensus.cc:493] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:16.156669 25793 raft_consensus.cc:493] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:16.157166 25297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.157670 25296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.157524 25793 raft_consensus.cc:515] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.158910 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.158986 25295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.160143 25793 leader_election.cc:290] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.160319 25795 raft_consensus.cc:515] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.163229 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.166865 25795 leader_election.cc:290] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.168431 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.168591 25372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.170882 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.168460 25295 raft_consensus.cc:1275] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:16.169977 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.171875 25371 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 1.
I20260709 12:28:16.175479 25443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5128e8a2ec9a4f6d93a220f15ba4702b" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.175793 25446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.176723 25446 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 2.
I20260709 12:28:16.176774 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7042106730424de6bfbaf01a1c846b12" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.178400 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba28bf13bf74b6abf948410461d2d86" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.178929 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.179191 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.179963 25448 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 1.
I20260709 12:28:16.185211 25370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.185138 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.170110 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:16.192154 25414 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:16.186550 25785 leader_election.cc:290] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.194803 25448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94639ef55f6d46d8b77e672e1580d1d8" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.195830 25442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.198124 25701 raft_consensus.cc:2804] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:16.195148 25447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc27ec7172664142b174ef62a077ba9c" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.198586 25701 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:16.200692 25701 raft_consensus.cc:3060] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.198566 25337 leader_election.cc:304] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.199168 25796 consensus_queue.cc:1048] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:16.202958 25794 raft_consensus.cc:2749] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:16.202183 25414 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.204270 25337 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.204702 25787 raft_consensus.cc:2804] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:16.205180 25787 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting leader election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.205605 25787 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.199375 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2cad4e90934a738b4cc8354078f905" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:16.205801 25414 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.205938 25789 consensus_queue.cc:1048] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:16.207434 25789 raft_consensus.cc:2804] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:16.207890 25789 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Starting leader election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.208256 25789 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.217350 25794 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:16.217569 25414 leader_election.cc:304] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.217815 25794 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.218451 25794 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.218644 25791 raft_consensus.cc:2749] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.219323 25787 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.217839 25262 leader_election.cc:304] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:16.222724 25793 raft_consensus.cc:2749] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.223755 25787 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045)
I20260709 12:28:16.225355 25701 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.226614 25371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:16.226750 25337 leader_election.cc:304] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.229828 25789 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.228884 25794 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.228091 25295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:16.230954 25781 raft_consensus.cc:2749] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.231681 25337 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.232690 25790 raft_consensus.cc:2804] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:16.232947 25337 leader_election.cc:304] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.233192 25790 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:16.233711 25794 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.234019 25790 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.234234 25789 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:16.246150 25295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:16.246590 25265 leader_election.cc:304] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:16.247439 25793 raft_consensus.cc:2749] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.247717 25701 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:16.246172 25794 raft_consensus.cc:2749] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:16.248617 25265 leader_election.cc:304] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:16.249563 25793 raft_consensus.cc:2749] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.250240 25790 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.251953 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:16.252341 25790 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:16.252986 25294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:16.256196 25337 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.256419 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:16.254112 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dfe9b37c6480495e7ad61f3068358" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:16.257894 25794 raft_consensus.cc:2749] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.259406 25337 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6; no voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.260058 25265 leader_election.cc:304] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:16.260625 25414 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.261010 25793 raft_consensus.cc:2749] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.261443 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:16.261848 25794 raft_consensus.cc:2749] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:16.261981 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:16.262173 25789 raft_consensus.cc:2749] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:16.264508 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:16.265427 25414 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.265648 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:16.266307 25787 raft_consensus.cc:2749] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:16.268297 25414 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde; no voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:16.269287 25787 raft_consensus.cc:2749] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:16.550879 25374 raft_consensus.cc:1240] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Rejecting Update request from peer b111caf8dbec46cbbc4089a376eed9d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:16.552342 25793 consensus_queue.cc:1059] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:16.553174 25795 raft_consensus.cc:3055] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.553490 25795 raft_consensus.cc:740] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:16.554234 25795 consensus_queue.cc:260] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.555383 25795 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.654488 25444 raft_consensus.cc:1240] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Rejecting Update request from peer b111caf8dbec46cbbc4089a376eed9d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:16.655763 25793 consensus_queue.cc:1059] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:16.656520 25795 raft_consensus.cc:3055] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:16.656824 25795 raft_consensus.cc:740] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:16.657665 25795 consensus_queue.cc:260] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.659124 25795 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.659799 25444 raft_consensus.cc:1240] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Rejecting Update request from peer 4a048992a7f94b00849e378603ec4ae6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:16.661134 25790 consensus_queue.cc:1059] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:16.662004 25794 raft_consensus.cc:3055] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.662353 25794 raft_consensus.cc:740] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:16.663245 25794 consensus_queue.cc:260] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.664280 25794 raft_consensus.cc:3060] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.710366 25374 raft_consensus.cc:1240] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Rejecting Update request from peer b111caf8dbec46cbbc4089a376eed9d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:16.711572 25795 consensus_queue.cc:1059] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:16.712355 25793 raft_consensus.cc:3055] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:16.712677 25793 raft_consensus.cc:740] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:16.713641 25793 consensus_queue.cc:260] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:16.714859 25793 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:17.038354 25469 debug-util.cc:398] Leaking SignalData structure 0x7b0800060160 after lost signal to thread 14652
W20260709 12:28:17.039603 25469 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea9c0 after lost signal to thread 25231
W20260709 12:28:17.040782 25469 debug-util.cc:398] Leaking SignalData structure 0x7b080036bec0 after lost signal to thread 25323
W20260709 12:28:17.041842 25469 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd4c0 after lost signal to thread 25398
W20260709 12:28:17.042810 25469 debug-util.cc:398] Leaking SignalData structure 0x7b0800254b20 after lost signal to thread 25472
I20260709 12:28:17.102854 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:17.111720 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:17.112341 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:17.676065 25793 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:17.676602 25793 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.678308 25793 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:17.679186 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:17.679478 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:17.679812 25374 raft_consensus.cc:2468] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:17.680410 25444 raft_consensus.cc:2393] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 2: Already voted for candidate af6560cefe984f6e964ec81cd195ddde in this term.
I20260709 12:28:17.681000 25265 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:17.681818 25793 raft_consensus.cc:2804] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:17.682224 25793 raft_consensus.cc:493] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4a048992a7f94b00849e378603ec4ae6)
I20260709 12:28:17.682546 25793 raft_consensus.cc:3060] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:17.687772 25793 raft_consensus.cc:515] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.689427 25793 leader_election.cc:290] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:17.690040 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:17.690412 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f77b9b635e4433791979648f28c0ecb" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:17.691082 25444 raft_consensus.cc:2393] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b111caf8dbec46cbbc4089a376eed9d8 in current term 2: Already voted for candidate af6560cefe984f6e964ec81cd195ddde in this term.
I20260709 12:28:17.698503 25374 raft_consensus.cc:2468] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 2.
I20260709 12:28:17.699626 25265 leader_election.cc:304] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:17.700399 25793 raft_consensus.cc:2804] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:17.701539 25793 raft_consensus.cc:697] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:17.702567 25793 consensus_queue.cc:237] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.710664 25196 catalog_manager.cc:5697] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 1 to 2, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 2 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:17.832695 25790 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:17.833223 25790 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.835505 25790 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:17.836265 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:17.836265 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:17.837121 25299 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 3.
I20260709 12:28:17.837339 25444 raft_consensus.cc:2393] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a048992a7f94b00849e378603ec4ae6 in current term 3: Already voted for candidate af6560cefe984f6e964ec81cd195ddde in this term.
I20260709 12:28:17.838531 25340 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:17.839298 25790 raft_consensus.cc:2804] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:17.839768 25790 raft_consensus.cc:493] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:17.840096 25790 raft_consensus.cc:3060] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:17.845474 25790 raft_consensus.cc:515] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.847173 25790 leader_election.cc:290] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:17.847724 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:17.848150 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a8dfb5a094f83ba09e9acc49bbe55" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:17.848841 25444 raft_consensus.cc:2393] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a048992a7f94b00849e378603ec4ae6 in current term 3: Already voted for candidate af6560cefe984f6e964ec81cd195ddde in this term.
I20260709 12:28:17.856346 25299 raft_consensus.cc:2468] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 3.
I20260709 12:28:17.857544 25789 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:17.857606 25340 leader_election.cc:304] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:17.858098 25789 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.858598 25790 raft_consensus.cc:2804] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:17.859084 25790 raft_consensus.cc:697] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 3 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:17.860284 25789 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:17.860163 25790 consensus_queue.cc:237] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.861603 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:17.862344 25374 raft_consensus.cc:2393] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate af6560cefe984f6e964ec81cd195ddde in current term 3: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:17.861356 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:17.864639 25299 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 3.
I20260709 12:28:17.866075 25414 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:17.867419 25789 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:17.867818 25789 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting leader election (detected failure of leader b111caf8dbec46cbbc4089a376eed9d8)
I20260709 12:28:17.868197 25789 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:17.871517 25196 catalog_manager.cc:5697] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 2 to 3, leader changed from b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 3 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:17.878089 25789 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.881130 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:17.881148 25789 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:17.882102 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:17.882825 25374 raft_consensus.cc:2393] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate af6560cefe984f6e964ec81cd195ddde in current term 3: Already voted for candidate 4a048992a7f94b00849e378603ec4ae6 in this term.
I20260709 12:28:17.886623 25299 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 3.
I20260709 12:28:17.887609 25414 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 4a048992a7f94b00849e378603ec4ae6
I20260709 12:28:17.888428 25789 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:17.889709 25789 raft_consensus.cc:697] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:17.890719 25789 consensus_queue.cc:237] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:17.899348 25196 catalog_manager.cc:5697] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 2 to 3, leader changed from b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65) to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 3 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:18.023118 25809 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.023806 25809 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.026520 25809 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:18.027097 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:18.027726 25299 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 3.
I20260709 12:28:18.027652 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde" is_pre_election: true
I20260709 12:28:18.028883 25340 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:18.029767 25809 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:18.030171 25809 raft_consensus.cc:493] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.030560 25809 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:18.039316 25809 raft_consensus.cc:515] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.041689 25809 leader_election.cc:290] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:18.042486 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:18.043090 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ce2d227220499b8a45c74150b65632" candidate_uuid: "4a048992a7f94b00849e378603ec4ae6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:18.043128 25299 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:18.049755 25299 raft_consensus.cc:2468] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a048992a7f94b00849e378603ec4ae6 in term 4.
I20260709 12:28:18.050582 25340 leader_election.cc:304] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, b111caf8dbec46cbbc4089a376eed9d8; no voters: af6560cefe984f6e964ec81cd195ddde
I20260709 12:28:18.051292 25809 raft_consensus.cc:2804] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:18.051891 25809 raft_consensus.cc:697] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 4 LEADER]: Becoming Leader. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:18.053120 25809 consensus_queue.cc:237] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.062166 25196 catalog_manager.cc:5697] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 reported cstate change: term changed from 3 to 4, leader changed from af6560cefe984f6e964ec81cd195ddde (127.14.78.67) to 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66). New cstate: current_term: 4 leader_uuid: "4a048992a7f94b00849e378603ec4ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:18.087247 25789 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.087757 25789 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.089413 25789 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:18.090062 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8" is_pre_election: true
I20260709 12:28:18.090583 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6" is_pre_election: true
I20260709 12:28:18.091166 25374 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:18.092757 25414 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:18.094024 25789 raft_consensus.cc:2804] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:18.094439 25789 raft_consensus.cc:493] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.095434 25789 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:18.090729 25299 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 2.
I20260709 12:28:18.101689 25789 raft_consensus.cc:515] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.103304 25789 leader_election.cc:290] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Requested vote from peers b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045), 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723)
I20260709 12:28:18.103924 25299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
I20260709 12:28:18.104142 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ffa7c1e90b49b9804fe836f6bb5b8a" candidate_uuid: "af6560cefe984f6e964ec81cd195ddde" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:18.104648 25299 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:18.104730 25374 raft_consensus.cc:3060] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:18.111241 25374 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 3.
I20260709 12:28:18.112298 25414 leader_election.cc:304] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a048992a7f94b00849e378603ec4ae6, af6560cefe984f6e964ec81cd195ddde; no voters: 
I20260709 12:28:18.113093 25789 raft_consensus.cc:2804] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:18.113528 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:18.113602 25789 raft_consensus.cc:697] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Becoming Leader. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:18.114183 25299 raft_consensus.cc:2468] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6560cefe984f6e964ec81cd195ddde in term 3.
I20260709 12:28:18.115366 25789 consensus_queue.cc:237] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.121284 25444 raft_consensus.cc:1275] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:18.123180 25793 consensus_queue.cc:1048] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:18.133476 25371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e"
dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
mode: GRACEFUL
new_leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:28:18.134217 25371 raft_consensus.cc:606] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Received request to transfer leadership to TS b111caf8dbec46cbbc4089a376eed9d8
I20260709 12:28:18.135885 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:18.136641 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:18.143239 25196 catalog_manager.cc:5697] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde reported cstate change: term changed from 1 to 3, leader changed from b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65) to af6560cefe984f6e964ec81cd195ddde (127.14.78.67). New cstate: current_term: 3 leader_uuid: "af6560cefe984f6e964ec81cd195ddde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:18.156414 25374 raft_consensus.cc:1275] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:18.158466 25803 consensus_queue.cc:1048] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:18.199168 25790 raft_consensus.cc:993] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: : Instructing follower b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:18.199709 25809 raft_consensus.cc:1081] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Signalling peer b111caf8dbec46cbbc4089a376eed9d8 to start an election
I20260709 12:28:18.201361 25299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e"
dest_uuid: "b111caf8dbec46cbbc4089a376eed9d8"
 from {username='slave'} at 127.0.0.1:46198
I20260709 12:28:18.201864 25299 raft_consensus.cc:493] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:18.202158 25299 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:18.207479 25299 raft_consensus.cc:515] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.209761 25299 leader_election.cc:290] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 election: Requested vote from peers 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723), af6560cefe984f6e964ec81cd195ddde (127.14.78.67:45289)
I20260709 12:28:18.210114 25444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "af6560cefe984f6e964ec81cd195ddde"
I20260709 12:28:18.211347 25444 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:18.216604 25444 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 3.
I20260709 12:28:18.217232 25374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9493dad0e0a74e6eb3f00267c3c34e8e" candidate_uuid: "b111caf8dbec46cbbc4089a376eed9d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a048992a7f94b00849e378603ec4ae6"
I20260709 12:28:18.217555 25262 leader_election.cc:304] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6560cefe984f6e964ec81cd195ddde, b111caf8dbec46cbbc4089a376eed9d8; no voters: 
I20260709 12:28:18.217944 25374 raft_consensus.cc:3055] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:18.218294 25374 raft_consensus.cc:740] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a048992a7f94b00849e378603ec4ae6, State: Running, Role: LEADER
I20260709 12:28:18.218506 25803 raft_consensus.cc:2804] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:18.219408 25374 consensus_queue.cc:260] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.219838 25803 raft_consensus.cc:697] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 3 LEADER]: Becoming Leader. State: Replica: b111caf8dbec46cbbc4089a376eed9d8, State: Running, Role: LEADER
I20260709 12:28:18.219930 25444 raft_consensus.cc:1240] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Rejecting Update request from peer 4a048992a7f94b00849e378603ec4ae6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:18.220651 25374 raft_consensus.cc:3060] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:18.221165 25803 consensus_queue.cc:237] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.228091 25374 raft_consensus.cc:2468] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b111caf8dbec46cbbc4089a376eed9d8 in term 3.
I20260709 12:28:18.229611 25196 catalog_manager.cc:5697] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 reported cstate change: term changed from 2 to 3, leader changed from 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66) to b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65). New cstate: current_term: 3 leader_uuid: "b111caf8dbec46cbbc4089a376eed9d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:18.304124 25374 raft_consensus.cc:1240] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 4 LEADER]: Rejecting Update request from peer af6560cefe984f6e964ec81cd195ddde for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:18.305387 25789 consensus_queue.cc:1059] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.306121 25789 consensus_queue.cc:1243] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [LEADER]: Peer 4a048992a7f94b00849e378603ec4ae6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:28:18.306600 25811 raft_consensus.cc:3055] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:18.306986 25811 raft_consensus.cc:740] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Becoming Follower/Learner. State: Replica: af6560cefe984f6e964ec81cd195ddde, State: Running, Role: LEADER
I20260709 12:28:18.307878 25811 consensus_queue.cc:260] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 } } peers { permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 } } peers { permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 } }
I20260709 12:28:18.309175 25811 raft_consensus.cc:3060] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:18.370831 25299 raft_consensus.cc:1275] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:18.372045 25790 consensus_queue.cc:1048] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.381932 25444 raft_consensus.cc:1275] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:18.383668 25790 consensus_queue.cc:1048] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.519023 25299 raft_consensus.cc:1275] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:18.520426 25811 consensus_queue.cc:1048] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.531649 25374 raft_consensus.cc:1275] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Refusing update from remote peer af6560cefe984f6e964ec81cd195ddde: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:18.533898 25811 consensus_queue.cc:1048] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.601120 25299 raft_consensus.cc:1275] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 4 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:18.602276 25790 consensus_queue.cc:1048] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b111caf8dbec46cbbc4089a376eed9d8" member_type: VOTER last_known_addr { host: "127.14.78.65" port: 42045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.614584 25444 raft_consensus.cc:1275] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 4 FOLLOWER]: Refusing update from remote peer 4a048992a7f94b00849e378603ec4ae6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:28:18.614964 25444 pending_rounds.cc:85] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: Aborting all ops after (but not including) 2
I20260709 12:28:18.615221 25444 pending_rounds.cc:107] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:28:18.615514 25444 raft_consensus.cc:2889] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:18.617183 25809 consensus_queue.cc:1048] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.684160 25444 raft_consensus.cc:1275] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:18.685527 25803 consensus_queue.cc:1048] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6560cefe984f6e964ec81cd195ddde" member_type: VOTER last_known_addr { host: "127.14.78.67" port: 45289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:18.698252 25374 raft_consensus.cc:1275] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Refusing update from remote peer b111caf8dbec46cbbc4089a376eed9d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:18.700884 25793 consensus_queue.cc:1048] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a048992a7f94b00849e378603ec4ae6" member_type: VOTER last_known_addr { host: "127.14.78.66" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:19.137653 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:19.143224 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:19.143734 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:20.144661 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:20.150345 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:20.150735 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:21.151793 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:21.156673 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:21.157094 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:22.158017 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:22.163025 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:22.163431 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:23.164381 14649 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:23.169517 14649 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:23.169924 14649 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:755: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20260709 12:28:24.224925 14649 tablet_server.cc:179] TabletServer@127.14.78.65:0 shutting down...
W20260709 12:28:24.247511 25340 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:28:24.252205 25340 consensus_peers.cc:597] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 -> Peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Couldn't send request to peer b111caf8dbec46cbbc4089a376eed9d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.259531 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:24.260286 14649 tablet_replica.cc:333] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.261003 14649 raft_consensus.cc:2243] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.261550 14649 raft_consensus.cc:2272] T 8d2cad4e90934a738b4cc8354078f905 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.264020 14649 tablet_replica.cc:333] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.264580 14649 raft_consensus.cc:2243] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.265139 14649 raft_consensus.cc:2272] T 7ba28bf13bf74b6abf948410461d2d86 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.267355 14649 tablet_replica.cc:333] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.267968 14649 raft_consensus.cc:2243] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.268755 14649 raft_consensus.cc:2272] T bec2509b88c54187acb6e491188960f3 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.271332 14649 tablet_replica.cc:333] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.272256 14649 raft_consensus.cc:2243] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.272836 14649 raft_consensus.cc:2272] T fc27ec7172664142b174ef62a077ba9c P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:24.273975 25414 consensus_peers.cc:597] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde -> Peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Couldn't send request to peer b111caf8dbec46cbbc4089a376eed9d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.275485 14649 tablet_replica.cc:333] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.276121 14649 raft_consensus.cc:2243] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.276582 14649 raft_consensus.cc:2272] T e7d2268ad3324f9d80a3465852da568d P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.279130 14649 tablet_replica.cc:333] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.279740 14649 raft_consensus.cc:2243] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.280244 14649 raft_consensus.cc:2272] T f381a053607e43a79f6be90d737ee089 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.282608 14649 tablet_replica.cc:333] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.283169 14649 raft_consensus.cc:2243] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.283547 14649 raft_consensus.cc:2272] T f7ffa7c1e90b49b9804fe836f6bb5b8a P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.285584 14649 tablet_replica.cc:333] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.286132 14649 raft_consensus.cc:2243] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.286953 14649 raft_consensus.cc:2272] T 5128e8a2ec9a4f6d93a220f15ba4702b P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.289733 14649 tablet_replica.cc:333] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.290326 14649 raft_consensus.cc:2243] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.290910 14649 raft_consensus.cc:2272] T 9e26345ef00f4ed18f2bc07151c34224 P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.293282 14649 tablet_replica.cc:333] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.293816 14649 raft_consensus.cc:2243] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.294624 14649 raft_consensus.cc:2272] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P b111caf8dbec46cbbc4089a376eed9d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.296671 14649 tablet_replica.cc:333] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.297302 14649 raft_consensus.cc:2243] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.297675 14649 raft_consensus.cc:2272] T 7042106730424de6bfbaf01a1c846b12 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.299739 14649 tablet_replica.cc:333] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.300196 14649 raft_consensus.cc:2243] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.300837 14649 raft_consensus.cc:2272] T 9493dad0e0a74e6eb3f00267c3c34e8e P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.302831 14649 tablet_replica.cc:333] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.303303 14649 raft_consensus.cc:2243] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.303630 14649 raft_consensus.cc:2272] T 78ce2d227220499b8a45c74150b65632 P b111caf8dbec46cbbc4089a376eed9d8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.305713 14649 tablet_replica.cc:333] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.306231 14649 raft_consensus.cc:2243] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.306562 14649 raft_consensus.cc:2272] T e55a8dfb5a094f83ba09e9acc49bbe55 P b111caf8dbec46cbbc4089a376eed9d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.308712 14649 tablet_replica.cc:333] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.309232 14649 raft_consensus.cc:2243] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.309609 14649 raft_consensus.cc:2272] T 94639ef55f6d46d8b77e672e1580d1d8 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.311547 14649 tablet_replica.cc:333] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.312007 14649 raft_consensus.cc:2243] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.312640 14649 raft_consensus.cc:2272] T 6f77b9b635e4433791979648f28c0ecb P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.314707 14649 tablet_replica.cc:333] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.315165 14649 raft_consensus.cc:2243] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.315871 14649 raft_consensus.cc:2272] T faf6a3d0f5e04742bef671e9876c9f8a P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.317906 14649 tablet_replica.cc:333] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8: stopping tablet replica
I20260709 12:28:24.318320 14649 raft_consensus.cc:2243] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.318665 14649 raft_consensus.cc:2272] T ab1dfe9b37c6480495e7ad61f3068358 P b111caf8dbec46cbbc4089a376eed9d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:24.323051 25414 consensus_peers.cc:597] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde -> Peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Couldn't send request to peer b111caf8dbec46cbbc4089a376eed9d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.351612 14649 tablet_server.cc:196] TabletServer@127.14.78.65:0 shutdown complete.
I20260709 12:28:24.388182 14649 tablet_server.cc:179] TabletServer@127.14.78.66:0 shutting down...
W20260709 12:28:24.402355 25414 consensus_peers.cc:597] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde -> Peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Couldn't send request to peer 4a048992a7f94b00849e378603ec4ae6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:24.412626 25340 consensus_peers.cc:597] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 -> Peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Couldn't send request to peer b111caf8dbec46cbbc4089a376eed9d8. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.425133 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:24.425897 14649 tablet_replica.cc:333] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.426699 14649 raft_consensus.cc:2243] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.427711 14649 raft_consensus.cc:2272] T 8d2cad4e90934a738b4cc8354078f905 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.429952 14649 tablet_replica.cc:333] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.430526 14649 raft_consensus.cc:2243] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.431046 14649 raft_consensus.cc:2272] T 7ba28bf13bf74b6abf948410461d2d86 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.433266 14649 tablet_replica.cc:333] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.433897 14649 raft_consensus.cc:2243] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.434674 14649 raft_consensus.cc:2272] T e7d2268ad3324f9d80a3465852da568d P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.436777 14649 tablet_replica.cc:333] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.437397 14649 raft_consensus.cc:2243] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.437862 14649 raft_consensus.cc:2272] T f7ffa7c1e90b49b9804fe836f6bb5b8a P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.439805 14649 tablet_replica.cc:333] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.440394 14649 raft_consensus.cc:2243] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.440872 14649 raft_consensus.cc:2272] T bec2509b88c54187acb6e491188960f3 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.442937 14649 tablet_replica.cc:333] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.443531 14649 raft_consensus.cc:2243] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.443984 14649 raft_consensus.cc:2272] T 5128e8a2ec9a4f6d93a220f15ba4702b P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.445950 14649 tablet_replica.cc:333] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.446491 14649 raft_consensus.cc:2243] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.447247 14649 raft_consensus.cc:2272] T 9e26345ef00f4ed18f2bc07151c34224 P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.449296 14649 tablet_replica.cc:333] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.449839 14649 raft_consensus.cc:2243] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.450299 14649 raft_consensus.cc:2272] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P 4a048992a7f94b00849e378603ec4ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.452327 14649 tablet_replica.cc:333] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.452920 14649 raft_consensus.cc:2243] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.453414 14649 raft_consensus.cc:2272] T 7042106730424de6bfbaf01a1c846b12 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.455544 14649 tablet_replica.cc:333] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.456156 14649 raft_consensus.cc:2243] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.456501 14649 raft_consensus.cc:2272] T 9493dad0e0a74e6eb3f00267c3c34e8e P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.458388 14649 tablet_replica.cc:333] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.458827 14649 raft_consensus.cc:2243] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.459204 14649 raft_consensus.cc:2272] T f381a053607e43a79f6be90d737ee089 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.461138 14649 tablet_replica.cc:333] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.461738 14649 raft_consensus.cc:2243] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.462157 14649 raft_consensus.cc:2272] T 6f77b9b635e4433791979648f28c0ecb P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.464581 14649 tablet_replica.cc:333] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.465215 14649 raft_consensus.cc:2243] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.465730 14649 raft_consensus.cc:2272] T faf6a3d0f5e04742bef671e9876c9f8a P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:24.466749 25414 consensus_peers.cc:597] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde -> Peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Couldn't send request to peer b111caf8dbec46cbbc4089a376eed9d8. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.467911 14649 tablet_replica.cc:333] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.468535 14649 raft_consensus.cc:2243] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.469002 14649 raft_consensus.cc:2272] T ab1dfe9b37c6480495e7ad61f3068358 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.470960 14649 tablet_replica.cc:333] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.471496 14649 raft_consensus.cc:2243] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.472188 14649 raft_consensus.cc:2272] T 78ce2d227220499b8a45c74150b65632 P 4a048992a7f94b00849e378603ec4ae6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.474210 14649 tablet_replica.cc:333] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.474710 14649 raft_consensus.cc:2243] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.475442 14649 raft_consensus.cc:2272] T fc27ec7172664142b174ef62a077ba9c P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.477380 14649 tablet_replica.cc:333] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.477837 14649 raft_consensus.cc:2243] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.478596 14649 raft_consensus.cc:2272] T 94639ef55f6d46d8b77e672e1580d1d8 P 4a048992a7f94b00849e378603ec4ae6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.480568 14649 tablet_replica.cc:333] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6: stopping tablet replica
I20260709 12:28:24.481027 14649 raft_consensus.cc:2243] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.481763 14649 raft_consensus.cc:2272] T e55a8dfb5a094f83ba09e9acc49bbe55 P 4a048992a7f94b00849e378603ec4ae6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:24.487864 25414 consensus_peers.cc:597] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde -> Peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Couldn't send request to peer 4a048992a7f94b00849e378603ec4ae6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.540789 14649 tablet_server.cc:196] TabletServer@127.14.78.66:0 shutdown complete.
W20260709 12:28:24.573732 25414 consensus_peers.cc:597] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde -> Peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Couldn't send request to peer 4a048992a7f94b00849e378603ec4ae6. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:37723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.579510 14649 tablet_server.cc:179] TabletServer@127.14.78.67:0 shutting down...
W20260709 12:28:24.602308 25414 consensus_peers.cc:597] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde -> Peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Couldn't send request to peer 4a048992a7f94b00849e378603ec4ae6. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:37723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.612228 14649 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:24.613029 14649 tablet_replica.cc:333] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.613746 14649 raft_consensus.cc:2243] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.614600 14649 raft_consensus.cc:2272] T 7ba28bf13bf74b6abf948410461d2d86 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.616998 14649 tablet_replica.cc:333] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.617604 14649 raft_consensus.cc:2243] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.618116 14649 raft_consensus.cc:2272] T 8d2cad4e90934a738b4cc8354078f905 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.620416 14649 tablet_replica.cc:333] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
W20260709 12:28:24.620922 25414 consensus_peers.cc:597] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde -> Peer b111caf8dbec46cbbc4089a376eed9d8 (127.14.78.65:42045): Couldn't send request to peer b111caf8dbec46cbbc4089a376eed9d8. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.65:42045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.621272 14649 raft_consensus.cc:2243] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.621889 14649 raft_consensus.cc:2272] T e7d2268ad3324f9d80a3465852da568d P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.623988 14649 tablet_replica.cc:333] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.624526 14649 raft_consensus.cc:2243] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.624930 14649 raft_consensus.cc:2272] T fc27ec7172664142b174ef62a077ba9c P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.626883 14649 tablet_replica.cc:333] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.627395 14649 raft_consensus.cc:2243] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.628065 14649 raft_consensus.cc:2272] T f7ffa7c1e90b49b9804fe836f6bb5b8a P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.630138 14649 tablet_replica.cc:333] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.630717 14649 raft_consensus.cc:2243] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.631186 14649 raft_consensus.cc:2272] T bec2509b88c54187acb6e491188960f3 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.633419 14649 tablet_replica.cc:333] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.633972 14649 raft_consensus.cc:2243] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:24.634200 25414 consensus_peers.cc:597] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde -> Peer 4a048992a7f94b00849e378603ec4ae6 (127.14.78.66:37723): Couldn't send request to peer 4a048992a7f94b00849e378603ec4ae6. Status: Network error: Client connection negotiation failed: client connection to 127.14.78.66:37723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:24.635179 14649 raft_consensus.cc:2272] T f381a053607e43a79f6be90d737ee089 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.637207 14649 tablet_replica.cc:333] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.637724 14649 raft_consensus.cc:2243] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.638156 14649 raft_consensus.cc:2272] T 5128e8a2ec9a4f6d93a220f15ba4702b P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.640105 14649 tablet_replica.cc:333] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.640640 14649 raft_consensus.cc:2243] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.641192 14649 raft_consensus.cc:2272] T faf6a3d0f5e04742bef671e9876c9f8a P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.643100 14649 tablet_replica.cc:333] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.643626 14649 raft_consensus.cc:2243] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.644348 14649 raft_consensus.cc:2272] T ab1dfe9b37c6480495e7ad61f3068358 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.646399 14649 tablet_replica.cc:333] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.646926 14649 raft_consensus.cc:2243] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.647336 14649 raft_consensus.cc:2272] T 6f77b9b635e4433791979648f28c0ecb P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.649226 14649 tablet_replica.cc:333] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.649745 14649 raft_consensus.cc:2243] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.650182 14649 raft_consensus.cc:2272] T 9e26345ef00f4ed18f2bc07151c34224 P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.652089 14649 tablet_replica.cc:333] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.652576 14649 raft_consensus.cc:2243] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.653162 14649 raft_consensus.cc:2272] T 6ab2c63ddbbe4a8bb3107a8d91a1728d P af6560cefe984f6e964ec81cd195ddde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.655239 14649 tablet_replica.cc:333] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.655673 14649 raft_consensus.cc:2243] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.656443 14649 raft_consensus.cc:2272] T 7042106730424de6bfbaf01a1c846b12 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.658327 14649 tablet_replica.cc:333] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.658756 14649 raft_consensus.cc:2243] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.659116 14649 raft_consensus.cc:2272] T 9493dad0e0a74e6eb3f00267c3c34e8e P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.660907 14649 tablet_replica.cc:333] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.661402 14649 raft_consensus.cc:2243] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.661765 14649 raft_consensus.cc:2272] T 78ce2d227220499b8a45c74150b65632 P af6560cefe984f6e964ec81cd195ddde [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.663532 14649 tablet_replica.cc:333] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.663928 14649 raft_consensus.cc:2243] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.664285 14649 raft_consensus.cc:2272] T e55a8dfb5a094f83ba09e9acc49bbe55 P af6560cefe984f6e964ec81cd195ddde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.666174 14649 tablet_replica.cc:333] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde: stopping tablet replica
I20260709 12:28:24.666605 14649 raft_consensus.cc:2243] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:24.667006 14649 raft_consensus.cc:2272] T 94639ef55f6d46d8b77e672e1580d1d8 P af6560cefe984f6e964ec81cd195ddde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.727941 14649 tablet_server.cc:196] TabletServer@127.14.78.67:0 shutdown complete.
I20260709 12:28:24.762169 14649 master.cc:562] Master@127.14.78.126:42075 shutting down...
I20260709 12:28:24.786196 14649 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:24.786693 14649 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:24.786976 14649 tablet_replica.cc:333] T 00000000000000000000000000000000 P a0d7848ed3f94ebeb754f85ba9c56530: stopping tablet replica
I20260709 12:28:24.807426 14649 master.cc:584] Master@127.14.78.126:42075 shutdown complete.
I20260709 12:28:24.843571 14649 test_util.cc:182] -----------------------------------------------
I20260709 12:28:24.843786 14649 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task1Ffri8/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746538276-14649-0
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (22275 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44960 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (358148 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true

 1 FAILED TEST
I20260709 12:28:24.850411 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2164 messages since previous log ~33 seconds ago
I20260709 12:28:24.850597 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2164 messages since previous log ~33 seconds ago
I20260709 12:28:24.850737 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2161 messages since previous log ~33 seconds ago
I20260709 12:28:24.850904 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:28:24.851046 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:28:24.851194 14649 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 7 messages since previous log ~216 seconds ago
I20260709 12:28:24.851348 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 7 messages since previous log ~216 seconds ago
I20260709 12:28:24.851483 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~156 seconds ago
I20260709 12:28:24.851668 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:28:24.851913 14649 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
